Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is the process to convert .safetensors to .pte documented? #7958

Open
arjunsingri opened this issue Jan 25, 2025 · 2 comments
Open

Is the process to convert .safetensors to .pte documented? #7958

arjunsingri opened this issue Jan 25, 2025 · 2 comments
Assignees
Labels
module: examples Issues related to demos under examples/ module: llm Issues related to LLM examples and apps, and to the extensions/llm/ code triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Comments

@arjunsingri
Copy link

arjunsingri commented Jan 25, 2025

I am looking methods to convert hugging face models to executorch format. Is that process documented somewhere?

cc @mergennachin @cccclai @helunwencser @dvorjackz

@arjunsingri arjunsingri changed the title Is the process to convert .safetensor to .pte documented? Is the process to convert .safetensors to .pte documented? Jan 25, 2025
@kirklandsign kirklandsign added module: examples Issues related to demos under examples/ module: llm Issues related to LLM examples and apps, and to the extensions/llm/ code labels Jan 27, 2025
@guangy10
Copy link
Contributor

Hi @arjunsingri, We created an end-to-end (e2e) path that allows users to export Hugging Face Transformers to ExecuTorch using Optimum. This PR (huggingface/optimum#2090) showcases the capabilities we have enabled so far, with the process previously documented and accessible at https://huggingface.co/docs/optimum.

However, very unfortunate, the documentation was unintentionally removed during the migration of Optimum + ExecuTorch to a new dedicated repository, huggingface/optimum-executorch. The migration is still WIP, and we are actively working to reinstate the documentation in huggingface/optimum-executorch#2.

@arjunsingri
Copy link
Author

Thanks for the response, I appreciate it. Looking forward to the new docs.

I think executorch's potential is not being realized to its full extent because the process of converting any model to executorch isn't straightforward.

@manuelcandales manuelcandales added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
module: examples Issues related to demos under examples/ module: llm Issues related to LLM examples and apps, and to the extensions/llm/ code triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
None yet
Development

No branches or pull requests

4 participants