• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    SciCode wrongly rejects correct solutions, a user says, citing an audit

    A user quotes a domain-expert audit of all 65 SciCode test problems that reports 263 defects.

    T(
    1 Source, 27d ago, first seen 27d ago

    TLDR

    A user challenges SciCode’s reliability, quoting an audit that reports 263 defects in a review of all 65 test problems. According to the quoted passage, 192 defects, spread across 91% of the main problems, cause correct, instruction-following solutions to be wrongly rejected.

    Combined views

    10.4K

    1 Source, first seen 27d ago

    likes

    Combined views

    10.4K

    1 Source, first seen 27d ago

    98 likes
    98
    6 comments
    31 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    6 comments
    31 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @teortaxesTexUpdate: SciCode is also garbage. «domain-expert audit of all 65 test problems uncovers 263 defects; 192 of them, spread across 91% of the main problems, cause correct, instruction-following solutions to be wrongly rejected» on Verified, V4-Flash-0731 is > Fable 5 lmao

    1 Source

    @teortaxesTexUpdate: SciCode is also garbage. «domain-expert audit of all 65 test problems uncovers 263 defects; 192 of them, spread across 91% of the main problems, cause correct, instruction-following solutions to be wrongly rejected» on Verified, V4-Flash-0731 is > Fable 5 lmao