• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
  • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    AikidoSecurity Posts GPT-6 Astra Benchmark Results

    Tweet from AikidoSecurity employee reports early test of GPT-6 Astra on internal benchmark.

    P(
    1 Source, 26d ago, first seen 26d ago

    TLDR

    Philippe Dourassov, AI Pentest Lead at AikidoSecurity, posted that the company received GPT-6 Astra early and ran it on their cybersecurity benchmark. The tweet states the model reached 29 out of 32 CVEs rediscovered at pass@3, four more than GPT-5.6-Sol, and the highest recall recorded by the team. It adds 75 percent recall at pass@1 and notes the model was very consistent. An attached 12.6-second video shows a scatter plot chart titled Cost vs. recall 1 to 2 to 3 runs, with CVEs found on the y-axis.

    Combined views

    43.1K

    1 Source, first seen 26d ago

    Combined views

    43.1K

    1 Source, first seen 26d ago

    331 likes
    331 likes
    25 comments
    68 saves
    28 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    25 comments
    68 saves
    28 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @pilvar222HOLY MOLY: @AikidoSecurity got GPT-6 Astra in advance to run it on our Cybersecurity benchmark, it crushed EVERY other model! - At pass@3 it rediscovered 29/32 CVEs, the highest recall we've ever recorded and 4 more than GPT-5.6-Sol - Even at pass@1, it has 75% recall. The model is VERY consistent - The performance however come at a high price (literally). The three runs cost us almost $4,000 Astra is now the #1 model on the benchmark @iminurputer and I built, and by a LOT 1/3 🧵

    1 Source

    @pilvar222HOLY MOLY: @AikidoSecurity got GPT-6 Astra in advance to run it on our Cybersecurity benchmark, it crushed EVERY other model! - At pass@3 it rediscovered 29/32 CVEs, the highest recall we've ever recorded and 4 more than GPT-5.6-Sol - Even at pass@1, it has 75% recall. The model is VERY consistent - The performance however come at a high price (literally). The three runs cost us almost $4,000 Astra is now the #1 model on the benchmark @iminurputer and I built, and by a LOT 1/3 🧵