• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Flow Reasoning Models aim to solve reasoning problems by looping predictions

    A researcher describes work that turns a flow model into a recurrent model for tasks such as Sudoku. Predictions are fed back as inputs and refined on successive passes.

    Nando de FreitasND
    Rohan PaulRP
    Alec HelblingAH
    4 Sources, ,

    TLDR

    Flow Reasoning Models repeatedly reuse their predictions as inputs to refine them, according to a researcher describing the team’s work on reasoning problems such as Sudoku. The researcher says each pass gets its own local training loss, with no backpropagation through time.

    Combined views

    47K

    4 Sources, first seen 20d ago

    Combined views

    47K

    4 Sources, first seen 20d ago

    1K likes
    20d ago
    first seen 20d ago
    1K likes
    29 comments
    824 saves
    250 reposts
    29 comments
    824 saves
    250 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    4 Sources

    Alec Helbling@alec_helblingFlow Reasoning Models are looped models. In our recent work, we turn a flow model into a recurrent model to solve reasoning problems (e.g. Sudoku). Predictions are fed back as inputs and iteratively refined. Each pass gets its own local loss. No backprop through time.21d
    Rohan Paul@rohanpaul_aiNew Carnegie Mellon + Oxford Univ paper shows a model can "think longer" by repeatedly improving hidden state rather than writing a longer chain-of-thought. and looped flows show those extra steps can materially raise accuracy. that small models can reason better by refining hidden state for more steps, so test-time compute does not have to mean generating more tokens. The problem is that recurrent models are hard to train over long loops: the model may keep updating its hidden state, but those updates can become unstable or stop helping. Looped flows fix this by training each update on a small denoising task while making sure the hidden state remains useful for the next update. This lets the model keep improving the same internal representation at inference time.20d
    Nando de Freitas@NandoDFRT @alec_helbling: Flow Reasoning Models are looped models. In our recent work, we turn a flow model into a recurrent model to solve reaso…19d

    4 Sources

    Alec Helbling@alec_helblingFlow Reasoning Models are looped models. In our recent work, we turn a flow model into a recurrent model to solve reasoning problems (e.g. Sudoku). Predictions are fed back as inputs and iteratively refined. Each pass gets its own local loss. No backprop through time.21d
    Rohan Paul@rohanpaul_aiNew Carnegie Mellon + Oxford Univ paper shows a model can "think longer" by repeatedly improving hidden state rather than writing a longer chain-of-thought. and looped flows show those extra steps can materially raise accuracy. that small models can reason better by refining hidden state for more steps, so test-time compute does not have to mean generating more tokens. The problem is that recurrent models are hard to train over long loops: the model may keep updating its hidden state, but those updates can become unstable or stop helping. Looped flows fix this by training each update on a small denoising task while making sure the hidden state remains useful for the next update. This lets the model keep improving the same internal representation at inference time.20d
    Nando de Freitas@NandoDFRT @alec_helbling: Flow Reasoning Models are looped models. In our recent work, we turn a flow model into a recurrent model to solve reaso…19d