Information And Energy Emerge As Only Long-Term Bottlenecks

@fchollet agree with energy but why information too?

@mendurmen @fchollet there is no shortage of information. it is information with determinism, verifiability and provenance that is scarce.

Garbage in. Garbage out.

https://chain.link/blog/what-crypto-is-really-about

@fchollet coordination is information cost !

@fchollet @grok how much of the sun's energy is just radiated into space without being used?

@nullpackets @fchollet yeah so

@fchollet Oi AI bro, have you meet the PHYSICAL WORLD YET? Let me use your vocabulary: there are many dimensions that can't become more exponential! And the implied belief that AI can find them is just projecting ignorance.

@mendurmen @fchollet have you been on twitter?

@fchollet Pie in the sky nonsense when you people can't even arrest criminals in your own governments.

@fchollet Energy is fundamental, information is perspectival.

The goal of deep learning is to discover the optimal pathway for, one-to-one, mapping of energy signatures/patterns to information....across the span of evolution.

@fchollet Now hear me out:

Energy as information 🤯

@fchollet long term maybe, short term it's whatever apple's review team is doing today

@fchollet Natural systems growth may be another.

Since biological systems are demonstratetably chaotic, energy and information may not be enough, time may be required to create a old evolve complex biological system.

@fchollet Maybe a little bombastic but for real guys, not everything can become a training set of data. Mostly because the questions asked are not about its composition but rather it's context or economics. I am sure you are brilliant but the world has been built by the past brilliant.

@fchollet This assumes LLMs are the final frontier.

@fchollet Now if only policy makers, world leaders & economists can be convinced this is the case then we can build a much more prosperous world for all of us

@fchollet underrated framing. computation is just a transformer of the two, not a third bottleneck on its own

@fchollet does this fold your non-stationarity point in is 'information' here the stock you have, or the rate you can acquire new information as the old goes stale? feels like the second is the actual long-term constraint

@fchollet Very true, clean data and sustainable energy source are the only bottlenecks, oh also the wanna be environmentalists, self proclaimed guardians of the mother nature

@fchollet Then you move further along the causal chain and find the next constraint.