• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Users argue for better training data over new AI post-training algorithms

    One user recommends spending 80% of language-model post-training effort on data: having experts review tasks, removing suspicious samples, and ensuring tasks are passable and varied.

    KA
    T(
    MN
    4 Sources, ,

    TLDR

    One user interprets DeepSeek’s position as saying that improving data quality offers far greater returns than developing new post-training algorithms. They recommend devoting 80% of post-training effort to data, including expert task reviews, manually removing suspicious samples, checking that tasks are passable, and ensuring variety in difficulty and category. Another user challenges the portrayal of DeepSeek as focused on post-training algorithm design, while defending what they describe as its view that the existing algorithms are good enough.

    Combined views

    29.9K

    4 Sources, first seen 19d ago

    Combined views

    29.9K

    4 Sources, first seen 19d ago

    276 likes
    19d ago
    first seen 19d ago
    276 likes
    17 comments
    63 saves
    12 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    17 comments
    63 saves
    12 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    4 Sources

    @teortaxesTexDeepSeek has never been into post-training algorithm design. They invented GRPO; after R1, updated it. Added MOPD. Now they think the algos are Fine. And are they wrong? ByteDance, Alibaba, Google, Meta publish a ton on post-training algos, and underperform their GPU endowments.
    @menhguinthis is mildly bearish AI compute capex. if you had a billion dollars to spend on more compute or data, and data is marginally more useful, you spend less on compute. companies w/ or enabling data moats likely benefit.
    @yacineMTBRT @teortaxesTex: DeepSeek has never been into post-training algorithm design. They invented GRPO; after R1, updated it. Added MOPD. Now th…

    4 Sources

    @teortaxesTexDeepSeek has never been into post-training algorithm design. They invented GRPO; after R1, updated it. Added MOPD. Now they think the algos are Fine. And are they wrong? ByteDance, Alibaba, Google, Meta publish a ton on post-training algos, and underperform their GPU endowments.
    @menhguinthis is mildly bearish AI compute capex. if you had a billion dollars to spend on more compute or data, and data is marginally more useful, you spend less on compute. companies w/ or enabling data moats likely benefit.
    @yacineMTBRT @teortaxesTex: DeepSeek has never been into post-training algorithm design. They invented GRPO; after R1, updated it. Added MOPD. Now th…