Flash attention#7977

Merged

KumoLiu merged 12 commits intoProject-MONAI:devfrom virginiafdez:flash-attention

Aug 6, 2024

+223-61

Commits on Jul 31, 2024

Addition of norm_eps parameter to spade_autoencoderkl.py in response to issue Project-MONAI#7946 .
Virginia Fernandez
committed

Commits on Aug 1, 2024

Addition of flash_attention (using new PyTorch functionality for torch >= 2.0) to cross attention and self attention blocks, and addition of parameters to diffusion model unet and to transformer bl…
virginiafdez
committed
Merge branch 'dev' into flash-attention
KumoLiu
authored
Addition of flash_attention (using new PyTorch functionality for torch >= 2.0) to cross attention and self attention blocks, and addition of parameters to diffusion model unet and to transformer bl…
virginiafdez
committed
Updates
Virginia Fernandez
committed

Commits on Aug 2, 2024

Addition of flash_attention (using new PyTorch functionality for torch >= 2.0) to cross attention and self attention blocks, and addition of parameters to diffusion model unet and to transformer bl…
virginiafdez
committed

Commits on Aug 5, 2024

Commits on Aug 6, 2024

Addressing suggested changes from PR: Project-MONAI#7977
Virginia Fernandez
committed
Addressing suggested changes from PR: Project-MONAI#7977
virginiafdez
committed
Addressing suggested changes from PR: Project-MONAI#7977
virginiafdez
committed
Docstrings change in transformerblock.py
virginiafdez
committed