FlashAttention in PyTorch (opens in new tab)

(github.com)

2 pointsshreyansh262y ago1 comments

1 comments

A simplified implementation of FlashAttention in PyTorch for educational purpose.

j / k navigate · click thread line to collapse

(github.com)

2 pointsshreyansh262y ago1 comments

A simplified implementation of FlashAttention in PyTorch for educational purpose.

j / k navigate · click thread line to collapse