Frontier LLMs scored 0% on the same benchmark.
xuan (ɕɥɛn / sh-yen)#745
Introducing Lattice Deduction Transformers: An 800k-parameter looped transformer that reasons like a SAT solver achieves 100% on Sudoku-Extreme with only 15 minutes of training.
A collaboration between @axiommathai, @AmherstCollege and @BarnardCollege.
Latest breakthrough: 100% on Sudoku-Extreme (800k parameter) and 99.9% on Maze-Hard (1.8M parameter), while frontier LLMs one-shot score 0%.
Lattice Deduction Transformers (LDT) born out of this wonderful research colab between @axiommathai @AmherstCollege and @BarnardCollege !
Introducing Lattice Deduction Transformers: An 800k-parameter looped transformer that reasons like a SAT solver achieves 100% on Sudoku-Extreme with only 15 minutes of training.
A collaboration between @axiommathai, @AmherstCollege and @BarnardCollege.
Neurosymbolic rising!
Frontier LLMs scored 0% on the same benchmark.
xuan (ɕɥɛn / sh-yen)#745Introducing Lattice Deduction Transformers: An 800k-parameter looped transformer that reasons like a SAT solver achieves 100% on Sudoku-Extreme with only 15 minutes of training.
A collaboration between @axiommathai, @AmherstCollege and @BarnardCollege.
Users praised Lattice Deduction Transformers for solving Sudoku-Extreme because it shows architectural priors outperforming scale, while others called the approach inefficient and pointless.
