• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Announcement

    AI in scientific discovery and the bottleneck in testing hypotheses

    DeepMind Institute says LLMs handle broad tasks while specialized models support domain-specific work, with scientists managing handoffs.

    Shane LeggSL
    2 Sources, ,

    TLDR

    DeepMind Institute says its study draws on 15 million Gemini interactions, more than 2,600 specialized AI models and a survey of more than 600 scientists. It finds that LLMs and specialized models serve different tasks, while surveyed scientists report backlogs of untested hypotheses and time spent checking AI outputs. The authors argue that AI could open up new kinds of discovery, but doing so will require investment in testing and changes to scientific institutions.

    Combined views

    4K

    2 Sources, first seen 5h ago

    Combined views

    4K

    2 Sources, first seen 5h ago

    59 likes
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    5h ago
    first seen 5h ago
    59 likes
    3 comments
    20 saves
    8 reposts
    3 comments
    20 saves
    8 reposts

    2 Sources

    Alex Imas@alexolegimasNew essay for the @GoogleDeepMind Institute with James Manyika on AI x Science, "Bending the Curve of Discovery". While accelerating existing scientific practices is certainly useful, the real promise of AI is its potential to act as an invention of a method of invention (IMI) a la Griliches--e.g., the microscope or statistical inference--which would unlock questions and whole modes of discovery that were previously beyond human reach. Today, LLMs and specialized models like AlphaFold act as economic complements. LLMs handle analysis, coding, and writing, while specialized tools handle domain-specific predictions. Most handoffs between them run through the scientist. What may the future of science look like? LLMs orchestrating those handoffs automatically--prompting specialized models, auditing outputs, and looping until either the question is answered or a non-automated stage is reached (e.g., wet lab testing). The scientist's role shifts from running each step to designing this loop. We saw a glimpse of this workflow with Anthropic’s enzyme discovery a few weeks ago, and we're seeing this in our own work too. This raises foundational epistemic questions: 1. What will scientific understanding look like when discoveries are made by black-box models whose output is increasingly difficult to interpret? 2. How do we extract underlying mechanisms, not just outputs, as science becomes more automated? What will theory look like? 3. If AI automates the writing and junior lab work, how do we train the next generation of scientists to push the frontier? 4. What will motivate scientists in this epistemic reality? There's an economics angle too. Hypothesis generation gets cheap, so bottlenecks move downstream to verification and to choosing which questions are worth asking. Realizing AI’s full potential will take investment in infrastructure and institutional reform--making this as much an organizational challenge as a technical one We don't have the answers yet, and I'd love to hear what others think. Paper here: https://bit.ly/ai-in-science5h
    Shane Legg@ShaneLeggOut today: a new DeepMind Institute essay from James Manyika and @AlexOlegImas that explores how scientists are using AI models to accelerate science. These findings are based on usage data from 15M Gemini interactions, 2,600 specialised models, and 600+ surveyed researchers.3h
    Featured Source

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    2 Sources

    Alex Imas@alexolegimasNew essay for the @GoogleDeepMind Institute with James Manyika on AI x Science, "Bending the Curve of Discovery". While accelerating existing scientific practices is certainly useful, the real promise of AI is its potential to act as an invention of a method of invention (IMI) a la Griliches--e.g., the microscope or statistical inference--which would unlock questions and whole modes of discovery that were previously beyond human reach. Today, LLMs and specialized models like AlphaFold act as economic complements. LLMs handle analysis, coding, and writing, while specialized tools handle domain-specific predictions. Most handoffs between them run through the scientist. What may the future of science look like? LLMs orchestrating those handoffs automatically--prompting specialized models, auditing outputs, and looping until either the question is answered or a non-automated stage is reached (e.g., wet lab testing). The scientist's role shifts from running each step to designing this loop. We saw a glimpse of this workflow with Anthropic’s enzyme discovery a few weeks ago, and we're seeing this in our own work too. This raises foundational epistemic questions: 1. What will scientific understanding look like when discoveries are made by black-box models whose output is increasingly difficult to interpret? 2. How do we extract underlying mechanisms, not just outputs, as science becomes more automated? What will theory look like? 3. If AI automates the writing and junior lab work, how do we train the next generation of scientists to push the frontier? 4. What will motivate scientists in this epistemic reality? There's an economics angle too. Hypothesis generation gets cheap, so bottlenecks move downstream to verification and to choosing which questions are worth asking. Realizing AI’s full potential will take investment in infrastructure and institutional reform--making this as much an organizational challenge as a technical one We don't have the answers yet, and I'd love to hear what others think. Paper here: https://bit.ly/ai-in-science5h
    Shane Legg@ShaneLeggOut today: a new DeepMind Institute essay from James Manyika and @AlexOlegImas that explores how scientists are using AI models to accelerate science. These findings are based on usage data from 15M Gemini interactions, 2,600 specialised models, and 600+ surveyed researchers.3h