-
Notifications
You must be signed in to change notification settings - Fork 84
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add the option to upload a selected list of CUDA arch to pypi #5217
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 1 Ignored Deployment
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I am generally okay with this but perhaps it might be good in the future to think about splitting these functionalities into their own re-usable actions so people can use them piece meal instead of part of the bigger workflow.
I think building more and more functionality into a singular happy path workflow makes it difficult for it to be flexible enough to support everything well
* Add nightly build workflow * Fix wrong env script path * Install pip deps * Try to install gxx_linux-64 and gcc_linux-64 * Another attempt * Set TORCH_CUDA_ARCH_LIST * Does this work? * Attempt to upload to pypi * Pass the arch * Try pypa/gh-action-pypi-publish@release/v1 * Wrong workflow syntax * Try auditwheel * Repair wheel manylinux2014_x86_64 * Debug * Debug * Almost there * Debug * Almost there * Pass -y to uninstall * Final testing * Upload other python versions * Remove debug * Remove build.yml * Add more validations * Run all unit tests * Fix typo * Run only test_ops * Passing the secrets * Move pypi upload to test-infra * Enable CPU build * Switch back to main after landing pytorch/test-infra#5217 * Remove unrelated copy/paste comments
A follow-up after #5217 and pytorch/ao#250, repo like `torch/ao` doesn't have a nightly branch and build nightly directly out of main on a daily schedule.
A follow-up after #5217 and pytorch/ao#250, repo like torch/ao doesn't have a nightly branch and build nightly directly out of main on a daily schedule. This was missed in #5222. It's a bit tricky to get this right off the bat. Also need to land D57657633 to allow nightly upload on the AWS side.
* Add nightly build workflow * Fix wrong env script path * Install pip deps * Try to install gxx_linux-64 and gcc_linux-64 * Another attempt * Set TORCH_CUDA_ARCH_LIST * Does this work? * Attempt to upload to pypi * Pass the arch * Try pypa/gh-action-pypi-publish@release/v1 * Wrong workflow syntax * Try auditwheel * Repair wheel manylinux2014_x86_64 * Debug * Debug * Almost there * Debug * Almost there * Pass -y to uninstall * Final testing * Upload other python versions * Remove debug * Remove build.yml * Add more validations * Run all unit tests * Fix typo * Run only test_ops * Passing the secrets * Move pypi upload to test-infra * Enable CPU build * Switch back to main after landing pytorch/test-infra#5217 * Remove unrelated copy/paste comments
This is to support torchao use case where it uploads 12.1 CUDA nightly build to https://pypi.org/project/torchao-nightly
Testing
Do some testing on torchao pytorch/ao#250: