• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Measuring AI explanation quality could help improve it, a user argues

    The user credits a paper’s dataset and pipeline with producing more diverse and realistic test cases than prior work, and says models can be trained to better explain their behavior after the fact.

    JS
    1 Source, 26d ago, first seen 26d ago

    TLDR

    A user backs “counterfactual simulatability” as a metric for explanation quality, arguing that having a measurable target makes improvement possible. They praise a paper’s dataset and pipeline for creating more diverse and realistic test cases than prior work, and highlight training models to produce better after-the-fact explanations of their behavior. In a follow-up, they say this paper and an earlier, more training-focused paper on the same topic used Tinker for fine-tuning experiments.

    Combined views

    4.6K

    1 Source, first seen 26d ago

    Combined views

    4.6K

    1 Source, first seen 26d ago

    27 likes
    27 likes
    1 comments
    11 saves

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    1 comments
    11 saves

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @johnschulman2I was also happy to see that this paper, and an earlier one by Hase et al. also on counterfactual simulatability (but more focused on training) used tinker for their fine-tuning experiments

    1 Source

    @johnschulman2I was also happy to see that this paper, and an earlier one by Hase et al. also on counterfactual simulatability (but more focused on training) used tinker for their fine-tuning experiments