Researcher Calls Synthetic Data Use Unsatisfying for LLM Teaching
Reactions from ranked influencers
2 posts
@srchvrs @alexkreimer @gneubig @jxmnop (and data creation is clearly much more of a "science" (or art)) than whatever "scaling laws" thingies the "researchers" are playing with)
@srchvrs @alexkreimer @gneubig @jxmnop no, i totally agree here. i was teaching a class on LLMs this semester, and "to get this kind of data, we create synthetic data using gpt-4.1" is really not satisfying from the teaching / intellectual perspective. even if practically it the model is very strong.