[shardformer] Support 4D parallel + Flash Attention#5789
Merged
Edenzzzz merged 12 commits intohpcaitech:mainfrom Edenzzzz:sp_flash_attnJun 17, 2024
+192-373
Commits
Commits on Jun 6, 2024
![pre-commit-ci[bot]](https://avatars.githubusercontent.com/in/68672?v=4&size=32){kind=avatar}
Commits on Jun 13, 2024
Commits on Jun 15, 2024
- committed
Commits on Jun 16, 2024
- committed
Commits on Jun 17, 2024
- committed
- committed
- committed