• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    LLM self-reports showed selective links to behavior in tests of 11 models

    A researcher says the Theory of Planned Behavior reached human-level coherence within a shared conversation; broad Big Five traits did not.

    Prof. Anima AnandkumarPA
    1 Source, 3h ago, first seen 3h ago

    TLDR

    A researcher says tests of 11 frontier LLMs across four behavioral tasks found selective links between psychometric self-reports and behavior. Within a shared conversation, the Theory of Planned Behavior reached human-level coherence; broad Big Five traits did not. Across separate conversations, coherence held for behaviors such as implicit bias but collapsed for context-driven behaviors such as sycophancy. Persona prompting made self-reports more consistent without bringing behavior into alignment.

    Combined views

    41

    1 Source, first seen 3h ago

    Combined views

    41

    1 Source, first seen 3h ago

    5 reposts
    5 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    Prof. Anima Anandkumar@AnimaAnandkumarRT @RKocielnik: Heading to San Francisco to present our paper "Rethinking Psychometric Evaluation of LLMs: When and Why Self-Reports Predic…3h

    1 Source

    Prof. Anima Anandkumar@AnimaAnandkumarRT @RKocielnik: Heading to San Francisco to present our paper "Rethinking Psychometric Evaluation of LLMs: When and Why Self-Reports Predic…3h