1d ago

Graphcore Research Uncovers Bias in Stochastic Rounding for AI Training

——0——
Original post
Andrew Fitzgibbon#1916@AWFIDIUSOPGraphcore ResearchGraphcore Research@GCRESEARCHTEAM

A tiny implementation detail in low-precision arithmetic could be biasing your AI training 😲 This interactive deep dive from Graphcore Research's @Awfidius uncovers a subtle failure mode in stochastic rounding that only appears when randomness is limited, and how it can be addressed with one simple fix 🎲 Check it out in the link below! 👇

5:30 AM · May 18, 2026 View on X
QUOTE POSTAndrew Fitzgibbon#1916Andrew Fitzgibbon@AWFIDIUS

Hey, I wrote a blog - I think it's fun, hope you do too!

Graphcore ResearchGraphcore Research@GCResearchTeam

A tiny implementation detail in low-precision arithmetic could be biasing your AI training 😲 This interactive deep dive from Graphcore Research's @Awfidius uncovers a subtle failure mode in stochastic rounding that only appears when randomness is limited, and how it can be addressed with one simple fix 🎲 Check it out in the link below! 👇

12:30 PM · May 18, 2026 · 2.5K Views
3:12 PM · May 18, 2026 · 2K Views