Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] SYCL kernel support for Intel GPU #1699

Closed
wants to merge 5 commits into from

Conversation

abhilash1910
Copy link
Contributor

Thanks for creating the project. This is an initial effort to upstream SYCL kernel support for our Intel GPUs. (cxx compiler)

@abhilash1910 abhilash1910 marked this pull request as draft November 17, 2023 08:25
@WoosukKwon
Copy link
Collaborator

Hi @abhilash1910, thanks for submitting the great work! Can we chat about the PR? We'd like to know more about the background and your (team's) plan. If you're interested, please reach out to my email: woosuk.kwon[at]berkeley.edu

@abhilash1910
Copy link
Contributor Author

Thanks @WoosukKwon , I will connect with you .

@jikunshang
Copy link
Contributor

Hi @abhilash1910 @WoosukKwon, Thanks for your great effort to provide this PR. It's really a good start but it seems not able to build or run. Instead of migrating CUDA kernels to SYCL directly, we redesigned Intel XPU support for vllm via dispatching operators to customized SYCL kernels/functions.
Currently, our approach could run an easy e2e example(offline_inference.py) using opt-125m model. The development is in progress, still have a lot to be done. Details can be found in PR #2378. Please take a review, thanks!
cc @bigPYJ1151 @maktukmak

@abhilash1910
Copy link
Contributor Author

Diverted to #2378 for consolidated porting.

@WoosukKwon WoosukKwon closed this Jun 22, 2024
@WoosukKwon
Copy link
Collaborator

Closing this PR as we merged #3814

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants