Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[LowLevelZero] low level zero support lora #5153

Merged
merged 16 commits into from
Dec 21, 2023
Merged

[LowLevelZero] low level zero support lora #5153

merged 16 commits into from
Dec 21, 2023

Conversation

flybird11111
Copy link
Contributor

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

#5152

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

low level zero support lora

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

@flybird11111 flybird11111 marked this pull request as draft December 3, 2023 15:48
@flybird11111 flybird11111 marked this pull request as ready for review December 3, 2023 16:11
@flybird11111
fix
4997393 
fix

fix

fix
@flybird11111 flybird11111 force-pushed the feature/lora branch 2 times, most recently from 766ce04 to 987728a Compare December 11, 2023 04:12
@flybird11111 flybird11111 force-pushed the feature/lora branch 2 times, most recently from 8a8c0ba to 9e4739a Compare December 11, 2023 10:14
@flybird11111
fix
a69c139 
fix

fix

fix

fix

fix

fix
@flybird11111 flybird11111 force-pushed the feature/lora branch 2 times, most recently from f331a2c to 4cc6b11 Compare December 13, 2023 09:12
@flybird11111
git # This is a combination of 3 commits.
80fdc4d 
Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix
@flybird11111
Copy link
Contributor Author

image All tests have passed.

@flybird11111 flybird11111 force-pushed the feature/lora branch 4 times, most recently from df10452 to ffcd036 Compare December 21, 2023 07:02
@flybird11111
Copy link
Contributor Author

image All tests have passed.

@flybird11111
fix naming
db94ff9 
fix naming

fix naming

fix
@ver217 ver217 merged commit cabc128 into hpcaitech:feature/lora Dec 21, 2023
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Mar 13, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
2a2e193 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Apr 7, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
0cd05dd 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Apr 7, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
38433aa 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
@flybird11111 flybird11111 deleted the feature/lora branch April 11, 2024 03:12
@flybird11111 flybird11111 restored the feature/lora branch April 11, 2024 03:12
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Apr 17, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
2f59b12 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Apr 22, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
502e2ca 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Apr 23, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
b747453 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
linsj20 pushed a commit to linsj20/ColossalAI that referenced this pull request Apr 23, 2024
@flybird11111 @linsj20
[LowLevelZero] low level zero support lora (hpcaitech#5153)
815b956 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
ver217 pushed a commit to ver217/ColossalAI that referenced this pull request Apr 26, 2024
@flybird11111 @ver217
[LowLevelZero] low level zero support lora (hpcaitech#5153)
25f2dd6 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
ver217 pushed a commit that referenced this pull request Apr 28, 2024
@flybird11111 @ver217
[LowLevelZero] low level zero support lora (#5153)
8954a0c 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
wangbluo pushed a commit to wangbluo/ColossalAI that referenced this pull request May 7, 2024
@flybird11111 @wangbluo
[LowLevelZero] low level zero support lora (hpcaitech#5153)
e7a9ab7 
* low level zero support lora

low level zero support lora

* add checkpoint test

* add checkpoint test

* fix

* fix

* fix

* fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* fix

fix

fix

fix

fix

fix

fix

* fix

* test ci

* git # This is a combination of 3 commits.

Update low_level_zero_plugin.py

Update low_level_zero_plugin.py

fix

fix

fix

* fix naming

fix naming

fix naming

fix
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Fridge003 Fridge003 Fridge003 left review comments

@ver217 ver217 ver217 approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@flybird11111 @ver217 @Fridge003