Prime Intellect's kalomaze argues a WildChat dataset outlier generating thousands of niche fanfiction undermines the 'user data flywheel' theory

This is why you never look at WildChat

@hradzka I understood that reference, and I hate myself for understanding and you for reminding me.

@kalomaze you might think we left these in olmo sft bc we didnt look at data...

...nah bruh we read them all and adjusted sampling based on distribution of character names

@hradzka incredible

@hradzka We gotta update that: you were creating training context for your agents.

@kalomaze Which way, western man?

@xlr8harder why would you deprive yourself of free entertainment

@kalomaze How is this somehow worse than that one tiktok of a mha character giving birth

@kalomaze I wish this was an "extreme outlier"

@kalomaze *snorts*

@hradzka @eigenrobot Shut up before I flash some lights at you.