[Intel GPU] Add NestedTensorXPU to parseDispatchKey and codegen

[min-jean-cho]

Part of intel/torch-xpu-ops#1141.

Add NestedTensorXPU dispatch key.

>>> nt = torch.nested.nested_tensor([]).to("xpu")
>>> nt
nested_tensor([

], device='xpu:0')
>>> nt.is_xpu
True

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/140461

• 📄 Preview Python docs built from this PR
• 📄 Preview C++ docs built from this PR
• ❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• GLIBC not found in Nova workflows

✅ No Failures

As of commit c894cb3 with merge base 9a051f6 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

Attention! native_functions.yaml was changed

If you are adding a new function or defaulted argument to native_functions.yaml, you cannot use it from pre-existing Python frontend code until our FC window passes (two weeks). Split your PR into two PRs, one which adds the new C++ functionality, and one that makes use of it from Python, and land them two weeks apart. See https://github.com/pytorch/pytorch/wiki/PyTorch's-Python-Frontend-Backward-and-Forward-Compatibility-Policy#forwards-compatibility-fc for more info.

---

Caused by:

• aten/src/ATen/native/native_functions.yaml

[EikanWang]

@min-jean-cho , pls. help evaluate the failed cases.

[EikanWang]

It is a known issue and we will fix it -

xpu / linux-jammy-xpu-py3.9 / test (default, 2, 4, linux.idc.xpu) (gh)
inductor/test_decompose_mem_bound_mm.py::TestDecomposeMemMM::test_check_device

[fengyuan14]

We only need definition of NestedTensorXPU in PyTorch in-tree at the current stage. As a part of operator implementation, NestedTensorXPU is only used in torch-xpu-ops native_functions.yaml to declare a dispatch for XPU.

[min-jean-cho]

Thanks, updated.

[guangyey]

Could we refine the title. NextedTensorXPU is already existed in PyTorch. Actually, this PR aims to add support for parsing NestedTensorXPU and codegen.

[min-jean-cho]

Thanks @guangyey for feedback, updated.

[ezyang]

@pytorchbot merge -r

[pytorchmergebot]

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

[pytorchmergebot]

Successfully rebased minjean/xpu_nested_tensor onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout minjean/xpu_nested_tensor && git pull --rebase)

[pytorchmergebot]

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here