Forcing Flash Attention onto a TPU and Learning the Hard Way · Archer Zhang
archerzhang.me
This is the fifth post in a series on LLM internals. Part 1 covered attention, Part 2 covered generation, Part 3 covered the Flash Attention algorithm, Part ...