Beren Millidge

@berenmillidge

Understanding Intelligence. CTO @ZyphraAI

following
followers

Zyphra introduces hierarchical attention as a path to subquadratic scaling

ZHA searches a learned tree of compressed summaries; Zyphra projects a 35× speedup over dense attention at 10 million tokens.

19 Sources, 6d ago, updated 6d ago

Dwarkesh announces an episode on automated AI research and what comes next

The host’s agenda asks how automated AI researchers will be trained, whether long-horizon reinforcement learning will elicit artificial general intelligence, and how much progress is explained by data.

18 Sources, 59d ago, first seen 59d ago

Featured in

Zyphra introduces hierarchical attention as a path to subquadratic scaling

Dwarkesh announces an episode on automated AI research and what comes next

Featured in

Zyphra introduces hierarchical attention as a path to subquadratic scaling

Dwarkesh announces an episode on automated AI research and what comes next