Researchers Discuss LLMs and Shannon Text Redundancy

Ahmad Beirami retweeted a post by docmilanfar referencing Claude Shannon's estimate from over 75 years ago that English text is roughly 75 percent redundant. The post and a generated headline claim modern LLMs compress English below Shannon's one bit per character limit. Christian Szegedy quoted the same thread and stated that optimizing for language compression produced current AI capabilities. The packet records these public posts on X without independent confirmation of the compression results.