Skip to content

TanZheling/MedForge

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
img
img
 
 
distill_dm.py
distill_dm.py
 
 
model_fusion.py
model_fusion.py
 
 
model_mixture.py
model_mixture.py
 
 
readme.md
readme.md
 
 
train_lora.py
train_lora.py
 
 

Repository files navigation

MedForge: Building Medical Foundation Models Like Open Source Software Development

The official implementation of MedForge. We have released the implementation of our methodology, the complete code will be updated soon. The overview of MedForge: (a) Feature branch development. Branch contributor should commit its branch plugin module and distilled data, then push them to MedForge. MedForge will merge the feature branch with the main branch. In our experiments, we adopt LoRA module as the plugin module. (b) Merging stage. Branch contributors can asynchronously commit and push their branch plugin modules and the distilled datasets to the main branch. Forge items of the main branch will be updated to equip the main branch model with new capabilities.

code description

distill_dm: generate distilled branch datasets.

train_lora: train branch loras on branch datasets for subsequent merging process.

model_fusion: the implementation of MedForge-Fusion.

model_mixture: the implementation of MedForge-Mixture.

About

No description, website, or topics provided.

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages