-
Notifications
You must be signed in to change notification settings - Fork 44
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: Add DataClass Arguments to Activate Padding-Free and MultiPack …
…Plugin and FastKernels (#280) * add arguments to activate ilab plugin Signed-off-by: 1000960000 user <aaron.chew1@ibm.com> Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * plugin rename Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * added multipack dataclass Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * formatted scripts Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * fix unit tests Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * additional fmt fixes Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * fix import Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com> Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * removed unit test enforcing pretokenized datasets with paddingfree Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * modifications to dataclasses to support fast kernels on full finetuning Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * minor syntax fixes and fmt Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * added more checks and unit tests Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * Addressed changes from code review Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * formatting fixes to README Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> * removed experimental status for fused lora and fast kernels Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> --------- Signed-off-by: 1000960000 user <aaron.chew1@ibm.com> Signed-off-by: 1000850000 user <aaron.chew1@ibm.com> Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com> Co-authored-by: Yu Chin Fabian Lim <flim@sg.ibm.com>
- Loading branch information
Showing
10 changed files
with
455 additions
and
49 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.