• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Reaction

    The case for looking beyond benchmark speed in AI-optimized software

    A user argues that models can produce results that look fast on a benchmark but fall short when no one examines the approach.

    C🎉
    PE
    2 Sources, 3h ago, first seen 3h ago

    TLDR

    A user says they keep seeing people ask AI models to optimize an end goal without looking at how they do it. The result can look fast on a benchmark but still be poor software, they argue. Software engineering still matters.

    Combined views

    4.1K

    2 Sources, first seen 3h ago

    Combined views

    4.1K

    2 Sources, first seen 3h ago

    121 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    121 likes
    13 comments
    13 saves
    11 reposts
    13 comments
    13 saves
    11 reposts
    Featured Source

    2 Sources

    @pdrmnvdthere’s a special form of ai psychosis i keep seeing over and over where people are convinced that they can tell the models to optimize some end goal without ever looking at the approach and then they end up with something that looks fast on a benchmark but actually sucks. unfortunately the new bitter lesson we will have to learn is that this doesn’t actually work and you still need to care about software engineering.3h
    @charles_irlRT @pdrmnvd: there’s a special form of ai psychosis i keep seeing over and over where people are convinced that they can tell the models to…2h

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    @pdrmnvdthere’s a special form of ai psychosis i keep seeing over and over where people are convinced that they can tell the models to optimize some end goal without ever looking at the approach and then they end up with something that looks fast on a benchmark but actually sucks. unfortunately the new bitter lesson we will have to learn is that this doesn’t actually work and you still need to care about software engineering.3h
    @charles_irlRT @pdrmnvd: there’s a special form of ai psychosis i keep seeing over and over where people are convinced that they can tell the models to…2h