ORIGINAL POST
#863Charles 🎉 Frye@CHARLES_IRL
#863Charles 🎉 Frye@CHARLES_IRLAdded a fun lil widget to the LLM Engineer's Almanac -- a "Token Timing Simulator" so you can get a visceral feel for what a benchmark perf number means.
Here's @_dcw02's latest work with @zhijianliu_'s DFlash technique in @sgl_project -- ~1k TPS!
modal.com
LLM Engineer's Almanac - Token Timing Simulator
Simulate TTFT and TPOT to explore LLM UX
7:00 PM · May 15, 2026 · 14.2K Views
@_dcw02 @zhijianliu_ @sgl_project @jianchen1799 big fan of the architecture and how y'all have demonstrated its benefits. major inspiration for this <3
Charles 🎉 Frye@charles_irlAdded a fun lil widget to the LLM Engineer's Almanac -- a "Token Timing Simulator" so you can get a visceral feel for what a benchmark perf number means. Here's @_dcw02's latest work with @zhijianliu_'s DFlash technique in @sgl_project -- ~1k TPS! https://modal.com/llm-almanac/token-timing-simulator
7:00 PM · May 15, 2026 · 14.2K Views
7:52 PM · May 15, 2026 · 417 Views