why CUDA_VISIBLE_DEVICES="" when preprocess datasets? #1380
-
|
i found that if i set bf16: true in yml, preprocess will get an error "Value error, bf16 requested, but AMP is not supported on this GPU. Requires Ampere series or above. ". I had to set bf16: auto or remove CUDA_VISIBLE_DEVICES="" to make it run. so why CUDA_VISIBLE_DEVICES="" when preprocess datasets? will it work correct if i remove it? thanks |
Beta Was this translation helpful? Give feedback.
Answered by
NanoCode012
Apr 3, 2024
Replies: 1 comment
-
|
Hey, you can also run it with single gpu! It's just to prevent multiple gpus trying to preprocess. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
NanoCode012
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hey, you can also run it with single gpu! It's just to prevent multiple gpus trying to preprocess.