WIP
A tiny flash attention implement in python, rust, cuda and c for learning purpose.
- python version
- triton version
- [c version]
- [rust version]
my env: cutlass v3.4, torch 1.14, cuda 12.4
forked from 66RING/tiny-flash-attention
-
Notifications
You must be signed in to change notification settings - Fork 0
flash attention tutorial written in python, triton, cuda, cutlass
License
hxdtest/tiny-flash-attention
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
flash attention tutorial written in python, triton, cuda, cutlass
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Cuda 56.8%
- Python 20.9%
- C++ 20.1%
- Other 2.2%