Repository

candle-flash-attn-v1

Candle Flash Attention v1 Layer

README

Candle Flash Attention v1 Layer

Flash Attention v2 does not support Turing GPUs (T4, RTX 2080). This layer can be used in replacement of the official
flash attention Candle layer in the meantime.