Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Update on "[BE][4/n] split pipeline_llama into a separate file"
- `parallelize_llama.py` has become a almost 600 lines file, which is too big to read. Let's separate the PP part out, as it does not interact with the rest spmd code. - Making `ParallelDims` into a standalone file, as it's used by `parallelize_llama.py` and `pipeline_llama.py`. - Renaming `float8_linear.py` to `float8.py` and adding it to the `README.md` - Some other minor changes. [ghstack-poisoned]
- Loading branch information