@lee_joey50709
LLM pretraining, optimization and architecture @openbmb, master @tsinghua_uni, opinions are my own
AI
A user ties the potential increase to data repetition; overfitting means fitting training examples too closely.