merge peft model to base for deployment #8916
Unanswered
Nima-Nilchian
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, I have fine-tuned a PEFT model using the NeMo Framework container, following the lora.ipynb notebook example. Now, I want to proceed with NeMo Framework inference container and deploy the fine-tuned model. How can I merge this PEFT model with the base model for deployment? generally how to deploy the PEFT fine-tuned model?
Beta Was this translation helpful? Give feedback.
All reactions