Skip to content

Commit

Permalink
Add first draft of deepspeed example
Browse files Browse the repository at this point in the history
  • Loading branch information
Lothiraldan committed Apr 24, 2024
1 parent 2c34f38 commit 06b2cf9
Show file tree
Hide file tree
Showing 3 changed files with 856 additions and 0 deletions.
30 changes: 30 additions & 0 deletions integrations/model-training/deepspeed/hello-world-bert/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
# DeepSpeed integration with Comet.ml

[DeepSpeed](TODO) is a TODO.



## Documentation

For more information on using and configuring the DeepSpeed integration, see: [https://www.comet.com/docs/v2/integrations/ml-frameworks/deepspeed/](https://www.comet.com/docs/v2/integrations/ml-frameworks/TODO)

## See it

Take a look at this [public Comet Project](TODO).

## Setup

Install dependencies

```bash
python -m pip install -r requirements.txt
```

## Run the example

This example is based on official example from [DeepSpeed](https://github.com/microsoft/DeepSpeedExamples/tree/master/training/HelloDeepSpeed).


```bash
deepspeed train_bert_ds.py --checkpoint_dir .
```
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
comet_ml
datasets
deepspeed
fire
loguru
pytz
sh
tensorboard
torch
tqdm
transformers
Loading

0 comments on commit 06b2cf9

Please sign in to comment.