Latest from scratch pre-training. Gemma architecture (~164M parameters), C4 dataset, 50k steps. Almost 47 hours on my RTX 3070.