Adding AI-generated web text reportedly leaves models worse off than adding no new data

A researcher says their team pretrained hundreds of models with different mixes of human-written and AI-generated web text. Across most standard training budgets, adding AI text made models worse than adding no new training data, they found. They also say almost a third of FineWeb-filtered web text was AI-generated as of September 2026, and that the share was rising.