• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    The claim that 96% of Claude and GPT-5's weights are “literally useless”

    The post cites a 2019 pruning experiment that it says showed 96% of a neural network's weights could be deleted without performance loss, and extends that argument to Claude and GPT-5.

    GT
    FI
    2 Sources, ,

    TLDR

    A user sharing a video they describe as an 18-minute scaling explainer argues that most of Claude and GPT-5's weights—the numerical parameters inside a neural network—are unnecessary. Citing what they describe as 2019 MIT research, they claim a much smaller “winning lottery ticket” network does the real work. The post uses that argument to claim AI labs waste 90%-plus of their Nvidia budgets.

    Combined views

    733.3K

    2 Sources, first seen 18d ago

    Combined views

    733.3K

    2 Sources, first seen 18d ago

    5.2K likes
    18d ago
    first seen 18d ago
    5.2K likes
    98 comments
    8.3K saves
    573 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    98 comments
    8.3K saves
    573 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    @_yusufknlAs someone who ships LLM systems in production, this scaling video is the closest thing to a "why 96% of Claude and GPT-5's weights are literally useless" explainer I've ever seen released for free. Everyone thinks trillion-parameter models need every parameter. They don't. A 2019 pruning experiment proved you can delete 96% of a neural net's weights with zero performance loss - meaning most of Claude and GPT-5 is empty scaffolding around a tiny "winning lottery ticket" network doing all the real work. Bookmark this 18-min video and watch tonight. Same lottery ticket math from 2019 MIT research, now the reason every AI lab wastes 90%+ of its Nvidia budget.
    @garrytanRT @_yusufknl: As someone who ships LLM systems in production, this scaling video is the closest thing to a "why 96% of Claude and GPT-5's…

    2 Sources

    @_yusufknlAs someone who ships LLM systems in production, this scaling video is the closest thing to a "why 96% of Claude and GPT-5's weights are literally useless" explainer I've ever seen released for free. Everyone thinks trillion-parameter models need every parameter. They don't. A 2019 pruning experiment proved you can delete 96% of a neural net's weights with zero performance loss - meaning most of Claude and GPT-5 is empty scaffolding around a tiny "winning lottery ticket" network doing all the real work. Bookmark this 18-min video and watch tonight. Same lottery ticket math from 2019 MIT research, now the reason every AI lab wastes 90%+ of its Nvidia budget.
    @garrytanRT @_yusufknl: As someone who ships LLM systems in production, this scaling video is the closest thing to a "why 96% of Claude and GPT-5's…