Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the option to upload a selected list of CUDA arch to pypi #5217

Merged
merged 5 commits into from
May 20, 2024

Conversation

huydhn
Copy link
Contributor

@huydhn huydhn commented May 19, 2024

This is to support torchao use case where it uploads 12.1 CUDA nightly build to https://pypi.org/project/torchao-nightly

Testing

Do some testing on torchao pytorch/ao#250:

Copy link

vercel bot commented May 19, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
torchci ⬜️ Ignored (Inspect) Visit Preview May 19, 2024 2:42am

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 19, 2024
@huydhn huydhn requested review from seemethere and atalman May 19, 2024 02:41
Copy link
Member

@seemethere seemethere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am generally okay with this but perhaps it might be good in the future to think about splitting these functionalities into their own re-usable actions so people can use them piece meal instead of part of the bigger workflow.

I think building more and more functionality into a singular happy path workflow makes it difficult for it to be flexible enough to support everything well

@huydhn huydhn merged commit 220a802 into main May 20, 2024
38 checks passed
huydhn added a commit to pytorch/ao that referenced this pull request May 20, 2024
@seemethere seemethere deleted the nova-workflow-upload-to-pypi branch May 20, 2024 17:55
huydhn added a commit to pytorch/ao that referenced this pull request May 20, 2024
* Add nightly build workflow

* Fix wrong env script path

* Install pip deps

* Try to install gxx_linux-64 and gcc_linux-64

* Another attempt

* Set TORCH_CUDA_ARCH_LIST

* Does this work?

* Attempt to upload to pypi

* Pass the arch

* Try pypa/gh-action-pypi-publish@release/v1

* Wrong workflow syntax

* Try auditwheel

* Repair wheel manylinux2014_x86_64

* Debug

* Debug

* Almost there

* Debug

* Almost there

* Pass -y to uninstall

* Final testing

* Upload other python versions

* Remove debug

* Remove build.yml

* Add more validations

* Run all unit tests

* Fix typo

* Run only test_ops

* Passing the secrets

* Move pypi upload to test-infra

* Enable CPU build

* Switch back to main after landing pytorch/test-infra#5217

* Remove unrelated copy/paste comments
huydhn added a commit that referenced this pull request May 21, 2024
A follow-up after #5217 and
pytorch/ao#250, repo like `torch/ao` doesn't
have a nightly branch and build nightly directly out of main on a daily
schedule.
huydhn added a commit that referenced this pull request May 22, 2024
A follow-up after #5217 and
pytorch/ao#250, repo like torch/ao doesn't have
a nightly branch and build nightly directly out of main on a daily
schedule. This was missed in
#5222. It's a bit tricky to
get this right off the bat.

Also need to land D57657633 to allow nightly upload on the AWS side.
dbyoung18 pushed a commit to dbyoung18/ao that referenced this pull request Jul 31, 2024
* Add nightly build workflow

* Fix wrong env script path

* Install pip deps

* Try to install gxx_linux-64 and gcc_linux-64

* Another attempt

* Set TORCH_CUDA_ARCH_LIST

* Does this work?

* Attempt to upload to pypi

* Pass the arch

* Try pypa/gh-action-pypi-publish@release/v1

* Wrong workflow syntax

* Try auditwheel

* Repair wheel manylinux2014_x86_64

* Debug

* Debug

* Almost there

* Debug

* Almost there

* Pass -y to uninstall

* Final testing

* Upload other python versions

* Remove debug

* Remove build.yml

* Add more validations

* Run all unit tests

* Fix typo

* Run only test_ops

* Passing the secrets

* Move pypi upload to test-infra

* Enable CPU build

* Switch back to main after landing pytorch/test-infra#5217

* Remove unrelated copy/paste comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants