Whether a 70M or 410M pythia lang model, it looks like it takes about 8 reps to memorize a list of single sentence samples. This is pure memorize, no generalizing.