-
Notifications
You must be signed in to change notification settings - Fork 696
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SDK] Use HuggingFace Data Collator for more Transformers in LLM Trainer #2032
Comments
i am interested to contribute on this just i ping on this thread if any help is required |
what type of transformer we are looking . i have look for given below transformer model Data Collator can be used
|
Thank you for your interest @live2awesome! |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
/remove lifecycle/stale |
/lifecycle frozen |
More context: #2031 (comment).
Currently, we apply HuggingFace Data Collator only for
AutoModelForCausalLM
Transformer in HF LLM Trainer.We need to investigate if we should apply it for other Transformers for language modelling models.
The text was updated successfully, but these errors were encountered: