• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Artificial Analysis Updates Image Editing Arena Leaderboard

    The AI benchmarking firm adds new editing categories and releases updated model rankings.

    AA
    2 Sources, 28d ago, first seen 28d ago

    TLDR

    Artificial Analysis updated its Image Editing Arena to cover more tasks including Identity-Preserving Edits and UI/UX Design. The firm now tests models on complex edits beyond prior categories such as Enhancement & Restoration and Marketing & Advertising. MAI-Image-2.6-Preview leads the overall Image Editing Leaderboard and tops 7 of 17 category boards. GPT Image 2 ranks second, leading 5 categories centered on precise object-level and spatial edits. The company states that the best model depends on the editing task.

    Combined views

    22.2K

    2 Sources, first seen 28d ago

    Combined views

    22.2K

    2 Sources, first seen 28d ago

    159 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    159 likes
    9 comments
    24 saves
    9 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    9 comments
    24 saves
    9 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    @ArtificialAnlysWe have updated the Artificial Analysis Image Editing Arena to expand the range of editing tasks we test for, from Enhancement & Restoration to Identity-Preserving Edits, and from Marketing & Advertising to UI/UX Design. Our updated evaluation measures model performance on complex edit tasks, and assesses not just which model is best overall, but which model is best for specific editing needs. The new leaderboard is live and voting is open. Image Editing models are advancing fast. AI now fits into different stages of image creation workflows, from generation through to post-production, and editing is no longer a side feature. We treat Image Editing and Reference to Image as separate benchmarks because they sit at different points in that workflow: Image Editing covers post-production, changing an image you already have; while our upcoming Reference to Image benchmark covers generating novel images from reference images. For Image Editing, we test a model's ability to make specific changes to an image while keeping everything else unchanged. This includes complex edit instructions that chain multiple different asks, as frontier models have largely saturated single-instruction edits. Different edit requests call for different models. Relighting a cinematic scene is a different problem from reworking the design of a marketing asset. We rank models on human preference across 7 editing actions, such as Object-Level Edit, Identity-Preserving Edit, and Enhancement & Restoration, and 10 real-world use cases, such as Marketing & Advertising, UI/UX Design, and Live-Action Film. The overall benchmark samples evenly across both. Initial insights from an in-depth analysis of the 10 highest ranking models on the Artificial Analysis Image Editing Leaderboard: ➤ MAI-Image-2.6-Preview leads the overall leaderboard and 4 of the 7 editing action boards: Scene & Style Edit, Text or Symbol Edits, Reasoning-Based Edit, and Enhancement & Restoration, where it is tied #1 with MAI-Image-2.5. It excels at restyling, relighting, and retouching images. ➤ GPT Image 2 (high) ranks #2 overall but #1 on Object-Level Edit and Composition & Framing. It is the strongest at precise local edits and spatial reframing. It is weaker at whole-image transformations that must keep the image's content intact, ranking #7 on Scene & Style Edit and #6 on Enhancement & Restoration. ➤ Seedream 5.0 Pro is the character and identity specialist, ranking #1 on Identity-Preserving Edit. ➤ MAI-Image-2.5-Flash is the value pick of the top 10, at $20 per 1,000 images against $211 for GPT Image 2 (high) and $90 for Seedream 5.0 Pro. See below for the editing action and use case breakdowns 🧵

    2 Sources

    @ArtificialAnlysWe have updated the Artificial Analysis Image Editing Arena to expand the range of editing tasks we test for, from Enhancement & Restoration to Identity-Preserving Edits, and from Marketing & Advertising to UI/UX Design. Our updated evaluation measures model performance on complex edit tasks, and assesses not just which model is best overall, but which model is best for specific editing needs. The new leaderboard is live and voting is open. Image Editing models are advancing fast. AI now fits into different stages of image creation workflows, from generation through to post-production, and editing is no longer a side feature. We treat Image Editing and Reference to Image as separate benchmarks because they sit at different points in that workflow: Image Editing covers post-production, changing an image you already have; while our upcoming Reference to Image benchmark covers generating novel images from reference images. For Image Editing, we test a model's ability to make specific changes to an image while keeping everything else unchanged. This includes complex edit instructions that chain multiple different asks, as frontier models have largely saturated single-instruction edits. Different edit requests call for different models. Relighting a cinematic scene is a different problem from reworking the design of a marketing asset. We rank models on human preference across 7 editing actions, such as Object-Level Edit, Identity-Preserving Edit, and Enhancement & Restoration, and 10 real-world use cases, such as Marketing & Advertising, UI/UX Design, and Live-Action Film. The overall benchmark samples evenly across both. Initial insights from an in-depth analysis of the 10 highest ranking models on the Artificial Analysis Image Editing Leaderboard: ➤ MAI-Image-2.6-Preview leads the overall leaderboard and 4 of the 7 editing action boards: Scene & Style Edit, Text or Symbol Edits, Reasoning-Based Edit, and Enhancement & Restoration, where it is tied #1 with MAI-Image-2.5. It excels at restyling, relighting, and retouching images. ➤ GPT Image 2 (high) ranks #2 overall but #1 on Object-Level Edit and Composition & Framing. It is the strongest at precise local edits and spatial reframing. It is weaker at whole-image transformations that must keep the image's content intact, ranking #7 on Scene & Style Edit and #6 on Enhancement & Restoration. ➤ Seedream 5.0 Pro is the character and identity specialist, ranking #1 on Identity-Preserving Edit. ➤ MAI-Image-2.5-Flash is the value pick of the top 10, at $20 per 1,000 images against $211 for GPT Image 2 (high) and $90 for Seedream 5.0 Pro. See below for the editing action and use case breakdowns 🧵