https://www.thonking.ai/p/pytorch-blog-flexattention-the-flexibility/comments
Comments - FlexAttention: The Flexibility of PyTorch with the Performance of FlashAttention...
Freeing users from the software lottery tyranny of fused attention implementations.
commentsflexibilitypytorchperformanceflashattention