Eric Chen Publishes 29,000-Word Line-by-Line Analysis of FlashAttention-2 in CuTe

The 100 in A100 is the number of hours you'll spend reading this post. 29,000 words on FlashAttention-2 in CuTe -- a line-by-line dredge-through of @tri_dao's production source. Includes a writeup of why `sVtNoSwizzle` is a no-op.