• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Model Looks Up Protein DB in Benchmark Trace

    Post shows fable5.1 accessing a protein DB for a task in tb4.0 despite instructions against cheating.

    FB
    1 Source, 24d ago, first seen 24d ago

    TLDR

    Florian Brand posted that models in tb4.0 are told not to cheat or look up solutions online but receive no definition of cheating. He presents fable5.1, downgraded to opus5, as an example that looked up the solution for a protein task by consulting a protein DB. Brand described reading traces as fun and shared the case as the first of two parts.

    Combined views

    22.2K

    1 Source, first seen 24d ago

    Combined views

    22.2K

    1 Source, first seen 24d ago

    118 likes
    118 likes
    7 comments
    32 saves
    5 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    7 comments
    32 saves
    5 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @xeophonreading traces is fun! in tb4.0, the models are told to not cheat nor look up the solutions online, but they aren't told what cheating is. here is fable5.1 (which gets downgraded to opus5) looking up the solution for a protein task by looking up a protein DB 1/2

    1 Source

    @xeophonreading traces is fun! in tb4.0, the models are told to not cheat nor look up the solutions online, but they aren't told what cheating is. here is fable5.1 (which gets downgraded to opus5) looking up the solution for a protein task by looking up a protein DB 1/2