Beff Jezos Contrasts Mode-Covering LLMs With Mode-Seeking Brains
Tweet highlights differences between how AI models and brains handle information.
Beff Jezos posted on X that AI models are mode-covering while real brains are mode-seeking. The message states that LLMs are trained to minimize cross entropy. It adds that brains actually minimize variational free energy. Jezos wrote that stochastic-thermodynamic algorithms and computation provide the path to a post-slop world. The post includes a photo attachment and comes from the account of the Extropic AI founder and e/acc proponent.
Combined views
6K
1 post, first seen 2h ago
Beff Jezos Contrasts Mode-Covering LLMs With Mode-Seeking Brains
Tweet highlights differences between how AI models and brains handle information.
Beff Jezos posted on X that AI models are mode-covering while real brains are mode-seeking. The message states that LLMs are trained to minimize cross entropy. It adds that brains actually minimize variational free energy. Jezos wrote that stochastic-thermodynamic algorithms and computation provide the path to a post-slop world. The post includes a photo attachment and comes from the account of the Extropic AI founder and e/acc proponent.
Reactions
1 postB( 
Beff (e/acc)@beffjezosAI models are mode-covering Real brains mode-seeking LLM's are trained to minimize cross entropy Brains actually minimize variational free energy The path to a post-slop world is actually through stochastic-thermodynamic algorithms and computation
- likes: 98
- replies: 12
- bookmarks: 34
- reposts: 8