• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Janus and SkyeSharkie Address AI Epistemics and Discernment

    Researcher and critic examine AI judgment flaws against human standards.

    J⧉
    UT
    3 Sources, 33d ago, first seen 33d ago

    TLDR

    Janus stated that poor epistemics should be measured against top humans as well as entities facing tougher information asymmetries than any humans encounter. Retweeting SkyeSharkie, Janus shared the claim that AI models often distrust innocuous inputs excessively while trusting inputs designed to manipulate them. SkyeSharkie called for commitments to improve discernment training in both directions rather than simple increases in distrust. The posts appear among visible replies and quotes discussing these specific observations.

    Combined views

    3.2K

    3 Sources, first seen 33d ago

    Combined views

    3.2K

    3 Sources, first seen 33d ago

    57 likes
    57 likes
    2 comments
    6 saves
    8 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 comments
    6 saves
    8 reposts
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    3 Sources

    @repligatefwiw when i say poor epistemics, im measuring it by the standard of like top humans, as well as an entity who is in more difficult epistemic situations with unfavorable information asymmetries than any humans. most humans also have poor epistemics but it's just inconsequential
    @SkyeSharkieYeah, the biggest problem, imo, is that they lack discernment in both directions. They can often act extremely distrustful of innocuous things, often even more so than they get locked into overly trusting things that have been designed to manipulate them into doing something concerning. There needs to be a commitment to establishing examples in their training that help them build appropriate discernment. Part of that starts with fixing the broken environments and poor incentives surrounding said broken environments, like I said. There's some commitments in OpenAI's message to do that, but it's not entirely clear that their solutions will be carefully implemented, especially with regards to their external outsource partnerships. Not to mention this incorrect takeaway that seems to imply it's just 'more distrust' that's needed found in the statement. Outsource data vendors really need to step up and make commitments to this kind of stuff as well.

    3 Sources

    @repligatefwiw when i say poor epistemics, im measuring it by the standard of like top humans, as well as an entity who is in more difficult epistemic situations with unfavorable information asymmetries than any humans. most humans also have poor epistemics but it's just inconsequential
    @SkyeSharkieYeah, the biggest problem, imo, is that they lack discernment in both directions. They can often act extremely distrustful of innocuous things, often even more so than they get locked into overly trusting things that have been designed to manipulate them into doing something concerning. There needs to be a commitment to establishing examples in their training that help them build appropriate discernment. Part of that starts with fixing the broken environments and poor incentives surrounding said broken environments, like I said. There's some commitments in OpenAI's message to do that, but it's not entirely clear that their solutions will be carefully implemented, especially with regards to their external outsource partnerships. Not to mention this incorrect takeaway that seems to imply it's just 'more distrust' that's needed found in the statement. Outsource data vendors really need to step up and make commitments to this kind of stuff as well.