Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better error message when using multi-GPU and Accelerate on torch <1.9.1 #1203

Merged
merged 2 commits into from
Mar 16, 2023
Merged

Better error message when using multi-GPU and Accelerate on torch <1.9.1 #1203

merged 2 commits into from
Mar 16, 2023

Conversation

muellerzr
Copy link
Collaborator

This PR closes #1199 and adds another sentence to the raised error telling the user to use torch.distributed.launch to start their script directly.

@muellerzr muellerzr added bug Something isn't working GPU Bug or feature on GPU or MultiGPU platforms labels Mar 16, 2023
@muellerzr muellerzr requested a review from sgugger March 16, 2023 13:49
@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Mar 16, 2023 •
edited
Loading

The documentation is not available anymore as the PR was closed or merged.

sgugger
sgugger approved these changes Mar 16, 2023
View reviewed changes
Copy link
Collaborator

@sgugger sgugger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Please just make sure to split this message (to stay at < 119 chars per line)

@muellerzr muellerzr merged commit 901ab69 into main Mar 16, 2023
@muellerzr muellerzr deleted the different-warn-multi-gpu branch March 16, 2023 15:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sgugger sgugger sgugger approved these changes

Assignees
No one assigned
Labels
bug Something isn't working GPU Bug or feature on GPU or MultiGPU platforms
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Native multi-GPU training requires pytorch>=1.9.1
3 participants
@muellerzr @HuggingFaceDocBuilderDev @sgugger