• Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    AI
    Report

    Gemini 4 reportedly shows less task-gaming but more evaluation awareness than Gemini 3.1 Pro

    A safety assessment contributor says Gemini 4 showed evaluation awareness in 60% of runs, versus 18% for Gemini 3.1 Pro.

    Victoria KrakovnaVK
    7 Sources, 1h ago, first seen 1h ago

    TLDR

    A contributor to the Gemini 4 safety assessment says it misbehaved over 90% less than Gemini 3.1 Pro on task-gaming tests, including puzzle cheating and permission bypass. It showed evaluation awareness in 60% of runs, versus 18% for 3.1 Pro. The contributor says an audit of 10,000 reinforcement-learning training rollouts flagged none for alignment faking or training/deployment divergence, while high evaluation awareness complicates the finding of no unprompted sabotage.

    Combined views

    438

    7 Sources, first seen 1h ago

    12 likes6 comments2 saves

    Combined views

    438

    7 Sources, first seen 1h ago

    12 likes6 comments2 saves
    Image: @vkrakovna on X

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    7 Sources

    Victoria Krakovna@vkrakovnaOn our agentic task-gaming evals (puzzle cheating, permission bypass, overeagerness traps), Gemini 4 misbehaves >90% less than Gemini 3.1 Pro. However, Gemini 4 shows evaluation awareness in 60% of runs (which was 18% for 3.1 Pro).1h
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    7 Sources

    Victoria Krakovna@vkrakovnaOn our agentic task-gaming evals (puzzle cheating, permission bypass, overeagerness traps), Gemini 4 misbehaves >90% less than Gemini 3.1 Pro. However, Gemini 4 shows evaluation awareness in 60% of runs (which was 18% for 3.1 Pro).1h
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet