Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update TP examples to align with tutorials #1243

Merged
merged 1 commit into from
Apr 11, 2024
Merged

Update TP examples to align with tutorials #1243

merged 1 commit into from
Apr 11, 2024

Conversation

wanchaol
Copy link
Contributor

@wanchaol wanchaol commented Apr 9, 2024

as titled

Copy link

netlify bot commented Apr 9, 2024

Deploy Preview for pytorch-examples-preview canceled.

Name Link
🔨 Latest commit b851c3e
🔍 Latest deploy log https://app.netlify.com/sites/pytorch-examples-preview/deploys/6617789ee4ded30008451e3f

Copy link
Contributor

@tianyu-l tianyu-l left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Had a minor suggestion.

distributed/tensor_parallelism/README.md Outdated Show resolved Hide resolved
@tianyu-l
Copy link
Contributor

tianyu-l commented Apr 9, 2024

not sure why the import fails... pls fix

@wanchaol wanchaol force-pushed the tp_tutorial branch 4 times, most recently from db7e1ce to 9b3dd53 Compare April 10, 2024 21:36
@wanchaol wanchaol requested a review from msaroufim April 10, 2024 21:51
@@ -3,4 +3,4 @@
--pre
--extra-index-url https://download.pytorch.org/whl/nightly/cu118
--extra-index-url https://download.pytorch.org/whl/nightly/cu121
torch >= 2.2.0.dev0; sys_platform == "linux"
torch >= 2.3.0.dev0; sys_platform == "linux"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

btw would this example work on T4 GPUs? Most of the distributed work here is still untested but there's no real reason for that IMO

Setting up distributed CI is as simple as runs-on: 4-core-ubuntu-gpu-t4

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cool let me try this!

@wanchaol wanchaol force-pushed the tp_tutorial branch 7 times, most recently from 9ca0137 to 14f4f6e Compare April 11, 2024 05:15
@wanchaol wanchaol merged commit ecd951d into main Apr 11, 2024
8 checks passed
@wanchaol wanchaol deleted the tp_tutorial branch April 11, 2024 06:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants