Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mac M1 GPU support via Pytorch and MPS #2018

Closed
ajrnz opened this issue Sep 15, 2022 · 1 comment
Closed

Mac M1 GPU support via Pytorch and MPS #2018

ajrnz opened this issue Sep 15, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@ajrnz
Copy link

ajrnz commented Sep 15, 2022

Given that pytorch supports GPUs (via Metal/MPS) on Mac M1 machines (since version pytorch 1.12, should it not be possible to enable this in the pytorch engine?

How much work would this be now that the JNI bindings are now ARM (aarch64)

The speed up is significant for Mac M1 users.

References

https://pytorch.org/blog/introducing-accelerated-pytorch-training-on-mac/
@ajrnz ajrnz added the enhancement New feature or request label Sep 15, 2022
@lanking520
Copy link
Contributor

Currently we are already using the offical torch 1.12.1 MacOS Arm64 wheel to build the JNI. So it has capabitlity to extend to GPU, but we didn't implement the MPS device yet. We are welcome for any contribution to this device addition. You can try to get it work by adding MPS device in the code

@demq demq mentioned this issue Sep 27, 2022
Merged
@xyang16 xyang16 closed this as completed Oct 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ajrnz @lanking520 @xyang16