Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Combining Inference and PEFT Tokens in a Batch #1153

Merged
merged 306 commits into from
Sep 4, 2024
Merged

Combining Inference and PEFT Tokens in a Batch #1153

merged 306 commits into from
Sep 4, 2024
This pull request is big! We’re only showing the most recent 250 commits.

Commits on Oct 23, 2023

  1. .

    @jiazhihao
    jiazhihao committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    d8e92e9 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. .

    @jiazhihao
    jiazhihao committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    0a512d2 View commit details
    Browse the repository at this point in the history

  2. Update the default cublas behavior when CUDA_VERSION is not specified

    @jiazhihao
    jiazhihao committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    4ee710a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'fix_cublas_default' of https://github.com/flexflow/Flex… 

    …Flow into peft
    @jiazhihao
    jiazhihao committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    2adca3a View commit details
    Browse the repository at this point in the history

  4. fix bugs in IncMHA peft_bwd kernel

    @jiazhihao
    jiazhihao committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    464424e View commit details
    Browse the repository at this point in the history

  5. resolve merge conflict

    @jiazhihao
    jiazhihao committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    82d6e58 View commit details
    Browse the repository at this point in the history

  6. uncomment softmaxbackward

    @jiazhihao
    jiazhihao committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    45c1e01 View commit details
    Browse the repository at this point in the history

  7. add layernorm to align test

    @goliaro
    goliaro committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    07636e8 View commit details
    Browse the repository at this point in the history

  8. add peft test scripts

    @goliaro
    goliaro committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    28a5e84 View commit details
    Browse the repository at this point in the history

  9. fix import

    @goliaro
    goliaro committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    dd94370 View commit details
    Browse the repository at this point in the history

  10. fix

    @goliaro
    goliaro committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    3c01328 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. add code to convert peft models

    @goliaro
    goliaro committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    fa56364 View commit details
    Browse the repository at this point in the history

  2. add script to download peft for c++, fix bug

    @goliaro
    goliaro committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    a484100 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    c83c376 View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2023

  1. add script to fine-tune models

    @goliaro
    goliaro committed Oct 27, 2023
    Configuration menu
    Copy the full SHA
    aa9f004 View commit details
    Browse the repository at this point in the history

Commits on Oct 31, 2023

  1. implement loading lora configs/weights from file

    @goliaro
    goliaro committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    4609e9e View commit details
    Browse the repository at this point in the history

  2. remove peft_bwd assertion failure in embedding

    @goliaro
    goliaro committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    17fa6f3 View commit details
    Browse the repository at this point in the history

  3. fix download script

    @goliaro
    goliaro committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    cdc12e6 View commit details
    Browse the repository at this point in the history

  4. add peft dependencies in dockerfile

    @goliaro
    goliaro committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    eb9e2b8 View commit details
    Browse the repository at this point in the history

  5. fix softmax backward

    @goliaro
    goliaro committed Oct 31, 2023
    Configuration menu
    Copy the full SHA
    3dfa14d View commit details
    Browse the repository at this point in the history

Commits on Nov 1, 2023

  1. fix bc print indentation

    @goliaro
    goliaro committed Nov 1, 2023
    Configuration menu
    Copy the full SHA
    78523e8 View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2023

  1. Temporarily Revert "Update the default cublas behavior when CUDA_VERS… 

    …ION is not specified"

This reverts commit 4ee710a.
    @goliaro
    goliaro committed Nov 2, 2023
    Configuration menu
    Copy the full SHA
    bf78ea4 View commit details
    Browse the repository at this point in the history

  2. Fix cublas default (#1220) 

    * Fix Legion prebuild workflow (2) (#1208)

* fix

* fix

* fix

* fix

* Fix Legion prebuild workflow (3) (#1210)

* fix hip error

* use CUBLAS_COMPUTE_FAST_16F for full-precision gemm

---------

Co-authored-by: Zhihao Jia <zhihao@cmu.edu>
    @goliaro @jiazhihao
    goliaro and jiazhihao authored Nov 2, 2023
    Configuration menu
    Copy the full SHA
    b9e7f60 View commit details
    Browse the repository at this point in the history

Commits on Nov 3, 2023

  1. fix bugs, work on align opt-lora

    @goliaro
    goliaro committed Nov 3, 2023
    Configuration menu
    Copy the full SHA
    463c757 View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2023

  1. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Nov 6, 2023
    Configuration menu
    Copy the full SHA
    1c231ba View commit details
    Browse the repository at this point in the history

  2. update scripts

    @goliaro
    goliaro committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    7c65521 View commit details
    Browse the repository at this point in the history

  3. add code to output peft tensors in hf

    @goliaro
    goliaro committed Nov 6, 2023
    Configuration menu
    Copy the full SHA
    f4b3f8f View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2023

  1. update, fixes

    @goliaro
    goliaro committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    9e5fea9 View commit details
    Browse the repository at this point in the history

  2. linting

    @goliaro
    goliaro committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    62edfaa View commit details
    Browse the repository at this point in the history

  3. fix printing of tensors for numpy

    @goliaro
    goliaro committed Nov 7, 2023
    Configuration menu
    Copy the full SHA
    ddb5c29 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2023

  1. update save_inference_tensors_to_file

    @goliaro
    goliaro committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    d276496 View commit details
    Browse the repository at this point in the history

  2. linting

    @goliaro
    goliaro committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    bc79d3b View commit details
    Browse the repository at this point in the history

  3. update

    @goliaro
    goliaro committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    8e34632 View commit details
    Browse the repository at this point in the history

  4. fix issue with save_inference_tensors_to_file

    @goliaro
    goliaro committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    b11c5e9 View commit details
    Browse the repository at this point in the history

  5. fix layer names for save_inference_tensors_to_file

    @goliaro
    goliaro committed Nov 8, 2023
    Configuration menu
    Copy the full SHA
    fca16cc View commit details
    Browse the repository at this point in the history

Commits on Nov 9, 2023

  1. fix peft

    @goliaro
    goliaro committed Nov 9, 2023
    Configuration menu
    Copy the full SHA
    9095f2b View commit details
    Browse the repository at this point in the history

Commits on Nov 10, 2023

  1. fix bwd bugs

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    9769604 View commit details
    Browse the repository at this point in the history

  2. linting

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    880ede8 View commit details
    Browse the repository at this point in the history

  3. fixes

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    818375d View commit details
    Browse the repository at this point in the history

  4. fix

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    2990e20 View commit details
    Browse the repository at this point in the history

  5. fix

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    6959e68 View commit details
    Browse the repository at this point in the history

  6. fix

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    266368c View commit details
    Browse the repository at this point in the history

  7. add bc fields for peft training

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    06775bd View commit details
    Browse the repository at this point in the history

  8. merge conflicts

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    ca879e2 View commit details
    Browse the repository at this point in the history

  9. linting

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    9f60177 View commit details
    Browse the repository at this point in the history

  10. fix

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    9442b62 View commit details
    Browse the repository at this point in the history

  11. remove ptr check

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    11eccb1 View commit details
    Browse the repository at this point in the history

  12. fix

    @goliaro
    goliaro committed Nov 10, 2023
    Configuration menu
    Copy the full SHA
    9bfc557 View commit details
    Browse the repository at this point in the history

Commits on Nov 12, 2023

  1. implement save_operators for bwd

    @goliaro
    goliaro committed Nov 12, 2023
    Configuration menu
    Copy the full SHA
    bcfae08 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2023

  1. fix bug

    @goliaro
    goliaro committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    d86272c View commit details
    Browse the repository at this point in the history

  2. implement save tensors for bwd

    @goliaro
    goliaro committed Nov 13, 2023
    Configuration menu
    Copy the full SHA
    0a3258a View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. .

    @goliaro
    goliaro committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    e34c405 View commit details
    Browse the repository at this point in the history

  2. bug fix

    @goliaro
    goliaro committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    87fbada View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    52759bd View commit details
    Browse the repository at this point in the history

  4. align linear

    @goliaro
    goliaro committed Nov 15, 2023
    Configuration menu
    Copy the full SHA
    2a5371d View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2023

  1. fix

    @goliaro
    goliaro committed Nov 16, 2023
    Configuration menu
    Copy the full SHA
    ed0be61 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2023

  1. bwd kernel updates

    @goliaro
    goliaro committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    8a0b6ea View commit details
    Browse the repository at this point in the history

  2. undo use of CUBLAS_COMPUTE_32F_FAST_16F for now

    @goliaro
    goliaro committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    b0e686d View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2023

  1. only send dataset entry once

    @goliaro
    goliaro committed Nov 19, 2023
    Configuration menu
    Copy the full SHA
    0daf232 View commit details
    Browse the repository at this point in the history

Commits on Nov 20, 2023

  1. update peft test scripts

    @goliaro
    goliaro committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    ec131c7 View commit details
    Browse the repository at this point in the history

  2. loss

    @xinhaoc
    xinhaoc committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    0431c73 View commit details
    Browse the repository at this point in the history

  3. .

    @xinhaoc
    xinhaoc committed Nov 20, 2023
    Configuration menu
    Copy the full SHA
    371dffd View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2023

  1. update generate/request api to take both inference and fine-tuning pr… 

    …ompts
    @goliaro
    goliaro committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    da690ff View commit details
    Browse the repository at this point in the history

  2. linting

    @goliaro
    goliaro committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    1e5bb72 View commit details
    Browse the repository at this point in the history

  3. alignment fixes in lora & linear layer

    @goliaro
    goliaro committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    f3ff40b View commit details
    Browse the repository at this point in the history

  4. alignment fix

    @goliaro
    goliaro committed Nov 21, 2023
    Configuration menu
    Copy the full SHA
    7efd3a7 View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2023

  1. diagonal

    @xinhaoc
    xinhaoc committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    b6fe334 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    bcf8b19 View commit details
    Browse the repository at this point in the history

  3. alignment fix ssm

    @goliaro
    goliaro committed Nov 22, 2023
    Configuration menu
    Copy the full SHA
    4bfee96 View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. sigmoid-silu-multi now fully aligned

    @goliaro
    goliaro committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    efd1976 View commit details
    Browse the repository at this point in the history

  2. rms norm kernel updates

    @goliaro
    goliaro committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    7ae195a View commit details
    Browse the repository at this point in the history

Commits on Nov 26, 2023

  1. fix

    @goliaro
    goliaro committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    7030814 View commit details
    Browse the repository at this point in the history

  2. in-place residual rms

    @goliaro
    goliaro committed Nov 26, 2023
    Configuration menu
    Copy the full SHA
    eb3b6ab View commit details
    Browse the repository at this point in the history

Commits on Nov 27, 2023

  1. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Nov 27, 2023
    Configuration menu
    Copy the full SHA
    9f26cc1 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2023

  1. bug fix and linting

    @goliaro
    goliaro committed Nov 28, 2023
    Configuration menu
    Copy the full SHA
    a122e30 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. align backward of o_proj, attn_heads, qk_prods_softmax, and v_proj wi… 

    …th huggingface
    @goliaro
    goliaro committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    53e737b View commit details
    Browse the repository at this point in the history

  2. cleanup

    @goliaro
    goliaro committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    edc02af View commit details
    Browse the repository at this point in the history

  3. finished all alignment fixes in attention backward kernel

    @goliaro
    goliaro committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    f00c7e0 View commit details
    Browse the repository at this point in the history

  4. fix

    @goliaro
    goliaro committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    3955b0b View commit details
    Browse the repository at this point in the history

Commits on Dec 3, 2023

  1. Update inc_multihead_self_attention.cu

    @goliaro
    goliaro authored Dec 3, 2023
    Configuration menu
    Copy the full SHA
    c534638 View commit details
    Browse the repository at this point in the history

Commits on Dec 4, 2023

  1. Update inc_multihead_self_attention.cu

    @goliaro
    goliaro authored Dec 4, 2023
    Configuration menu
    Copy the full SHA
    fd956c9 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Dec 4, 2023
    Configuration menu
    Copy the full SHA
    d9b154f View commit details
    Browse the repository at this point in the history

Commits on Dec 6, 2023

  1. use grad to store peft in/output (#1241) 

    * use grad to store peft in/output

* format

* .
    @xinhaoc
    xinhaoc authored Dec 6, 2023
    Configuration menu
    Copy the full SHA
    3a34c88 View commit details
    Browse the repository at this point in the history

  2. format

    @jiazhihao
    jiazhihao committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    94230d9 View commit details
    Browse the repository at this point in the history

  3. enable peft request

    @jiazhihao
    jiazhihao committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    b985cc9 View commit details
    Browse the repository at this point in the history

  4. several hacks for performance measurement; some of the changes should… 

    … be reverted
    @jiazhihao
    jiazhihao committed Dec 6, 2023
    Configuration menu
    Copy the full SHA
    b9c3926 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2023

  1. Update sigmoid_silu_multi.cu

    @goliaro
    goliaro authored Dec 16, 2023
    Configuration menu
    Copy the full SHA
    4d5c3e0 View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2023

  1. RoPE backward

    @goliaro
    goliaro committed Dec 18, 2023
    Configuration menu
    Copy the full SHA
    7bf863a View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. PEFT bug fixes and alignment (#1269) 

    * Revert "several hacks for performance measurement; some of the changes should be reverted"

This reverts commit b9c3926.

* backup

* backup

* updates

* update

* backup

* backup

* backup

* fix

* cleanup

* linting
    @goliaro
    goliaro authored Jan 10, 2024
    Configuration menu
    Copy the full SHA
    960654e View commit details
    Browse the repository at this point in the history

  2. Fuse bias + relu in OPT (#1271) 

    * fuse bias and relu in opt

* fix
    @goliaro
    goliaro authored Jan 10, 2024
    Configuration menu
    Copy the full SHA
    2028900 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    3bbde56 View commit details
    Browse the repository at this point in the history

Commits on Jan 17, 2024

  1. fix

    @goliaro
    goliaro committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    2ebd7f4 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    1b2018b View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2024

  1. Peft alignment & debugging tools (#1288) 

    * Revert "several hacks for performance measurement; some of the changes should be reverted"

This reverts commit b9c3926.

* backup

* backup

* updates

* update

* backup

* backup

* backup

* fix

* cleanup

* fix

* fix

* fix

* update

* simplify tensor names

* fix

* fixes and updates

* fixes

* fix

* cleanup

* .

* restore softmax

* cleanup

* update alignment scripts

* newline
    @goliaro
    goliaro authored Jan 27, 2024
    Configuration menu
    Copy the full SHA
    bc61e9d View commit details
    Browse the repository at this point in the history

  2. fix legion aliasing error

    @goliaro
    goliaro committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    32f0a15 View commit details
    Browse the repository at this point in the history

  3. fix warnings

    @goliaro
    goliaro committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    c97f63a View commit details
    Browse the repository at this point in the history

  4. fix

    @goliaro
    goliaro committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    3d5a37c View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. fix pipeline parallelism

    @goliaro
    goliaro committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    571f0d3 View commit details
    Browse the repository at this point in the history

  2. fix tp issue in combine op

    @goliaro
    goliaro committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    f4a10f3 View commit details
    Browse the repository at this point in the history

  3. fix lora weight loading with tensor parallelism

    @goliaro
    goliaro committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    ca683f7 View commit details
    Browse the repository at this point in the history

  4. fixes, implement Combine::peft_bwd_task

    @goliaro
    goliaro committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    378bdb5 View commit details
    Browse the repository at this point in the history

  5. fix

    @goliaro
    goliaro committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    afdae45 View commit details
    Browse the repository at this point in the history

  6. replicate peft bwd

    @goliaro
    goliaro committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    5660f55 View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. fixes

    @goliaro
    goliaro committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    a9bacd3 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. fix

    @goliaro
    goliaro committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    f3a97ff View commit details
    Browse the repository at this point in the history

  2. fix combine and fwd-bwd pass dependencies

    @goliaro
    goliaro committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    e0a58bb View commit details
    Browse the repository at this point in the history

  3. fix replicate bwd

    @goliaro
    goliaro committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    50fc13d View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2024

  1. fix

    @goliaro
    goliaro committed Feb 1, 2024
    Configuration menu
    Copy the full SHA
    f2c9a05 View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2024

  1. let user control amount of peft memory

    @goliaro
    goliaro committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    cd68f5d View commit details
    Browse the repository at this point in the history

  2. only run peft_bwd if peft is enabled

    @goliaro
    goliaro committed Feb 3, 2024
    Configuration menu
    Copy the full SHA
    64a59d8 View commit details
    Browse the repository at this point in the history

Commits on Feb 6, 2024

  1. fix rms norm inference region reqs

    @goliaro
    goliaro committed Feb 6, 2024
    Configuration menu
    Copy the full SHA
    32a0716 View commit details
    Browse the repository at this point in the history

Commits on Feb 7, 2024

  1. fix in-place fusion (part 1)

    @goliaro
    goliaro committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    a37b173 View commit details
    Browse the repository at this point in the history

  2. fix inplace fusion (part 2)

    @goliaro
    goliaro committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    85f4d40 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    bb56a99 View commit details
    Browse the repository at this point in the history

  4. disable automatic inplace rms norm for now

    @goliaro
    goliaro committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    63f1fce View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2024

  1. fix inf fusion inplace

    @goliaro
    goliaro committed Feb 8, 2024
    Configuration menu
    Copy the full SHA
    0d3aa7e View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. fix rest input grads for peft without inplace residuals

    @goliaro
    goliaro committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    b658061 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    3255fe4 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. fix

    @goliaro
    goliaro committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    ec2002e View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. fix residual rms

    @goliaro
    goliaro committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    098e880 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    5688e16 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    9225e0c View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. enable inf debugging in fusion bwd

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    e12bff1 View commit details
    Browse the repository at this point in the history

  2. hack to silence warning in fused bwd

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    ed9afb7 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    96d0e9b View commit details
    Browse the repository at this point in the history

  4. Merge branch 'inference' into peft

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    fcbeea0 View commit details
    Browse the repository at this point in the history

  5. fix

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    2cbc0b7 View commit details
    Browse the repository at this point in the history

  6. fix build

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    36cb2b3 View commit details
    Browse the repository at this point in the history

  7. fix

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    21b77f1 View commit details
    Browse the repository at this point in the history

  8. fix

    @goliaro
    goliaro committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    9075d3f View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2024

  1. add draft peft test

    @goliaro
    goliaro committed Mar 22, 2024
    Configuration menu
    Copy the full SHA
    0b35b0c View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. Peft python interface (#1306) 

    * update script

* less model renaming

* fix

* fix

* fix

* backup

* .

* update

* .

* fixes

* fix

* fix build

* fix

* fix

* fix issues for downloading peft model

* solved issues for download peft model

* added printouts for debugging

* fix

* fix seg fault

* add test, separate peft script in cpp

* fix

* fixes

* fix

* update peft python interface

* update

* update

* update

* updates

* fix

* fixes

* fix

* fixes

---------

Co-authored-by: april-yyt <aprilytyang@gmail.com>
    @goliaro @april-yyt
    goliaro and april-yyt authored Mar 27, 2024
    Configuration menu
    Copy the full SHA
    b6ada2f View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Apr 8, 2024
    Configuration menu
    Copy the full SHA
    29fcda7 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    0ed889a View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. update

    @goliaro
    goliaro committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    48c431a View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. fix

    @goliaro
    goliaro committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    40649ee View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2024

  1. fix to support prompts larger than max tokens per batch

    @goliaro
    goliaro committed Apr 13, 2024
    Configuration menu
    Copy the full SHA
    0580d7e View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2024

  1. fixes to support benchmarking of finetuning throughput

    @goliaro
    goliaro committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    0affe27 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. many upgrades and updates related to finetuning

    @goliaro
    goliaro committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    d7ebeaf View commit details
    Browse the repository at this point in the history

  2. add ttft statistics

    @goliaro
    goliaro committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    33e873d View commit details
    Browse the repository at this point in the history

  3. add warmup phase

    @goliaro
    goliaro committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    2f92a65 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. add benchmarking code

    @goliaro
    goliaro committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    b1e97b1 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. Add scripts for evaluation with Microsoft Azure trace (#1363) 

    * Add scripts for evaluation

* Add absolute request rate value

* Fix script for target arrival rate

* Fix cpp req rate benchmark

* update to use new dataset

* Fix infinite loop

* update

* add data

---------

Co-authored-by: Remi Delacourt <rdelacou@catalyst-0-9.eth>
Co-authored-by: Gabriele Oliaro <goliaro@cs.cmu.edu>
    @Flechman @goliaro
    3 people authored Apr 17, 2024
    Configuration menu
    Copy the full SHA
    e35ebb2 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Apr 24, 2024
    Configuration menu
    Copy the full SHA
    f3f6226 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2024

  1. fix

    @goliaro
    goliaro committed Apr 25, 2024
    Configuration menu
    Copy the full SHA
    b33f10f View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. fix

    @goliaro
    goliaro committed May 1, 2024
    Configuration menu
    Copy the full SHA
    97562d6 View commit details
    Browse the repository at this point in the history

  2. add peft tests to ci

    @goliaro
    goliaro committed May 1, 2024
    Configuration menu
    Copy the full SHA
    985c254 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'inference' into peft

    @goliaro
    goliaro authored May 1, 2024
    Configuration menu
    Copy the full SHA
    33dbd3d View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. shellcheck

    @goliaro
    goliaro committed May 8, 2024
    Configuration menu
    Copy the full SHA
    f033b4e View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. fix

    @goliaro
    goliaro committed May 9, 2024
    Configuration menu
    Copy the full SHA
    1011927 View commit details
    Browse the repository at this point in the history

  2. fix python requirements

    @goliaro
    goliaro committed May 9, 2024
    Configuration menu
    Copy the full SHA
    9064c2b View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. fix

    @goliaro
    goliaro committed May 10, 2024
    Configuration menu
    Copy the full SHA
    a125e86 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2024

  1. fix

    @goliaro
    goliaro committed May 11, 2024
    Configuration menu
    Copy the full SHA
    d74fe53 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. update ci test

    @goliaro
    goliaro committed May 17, 2024
    Configuration menu
    Copy the full SHA
    0c6ae09 View commit details
    Browse the repository at this point in the history

  2. update alignment doc

    @goliaro
    goliaro committed May 17, 2024
    Configuration menu
    Copy the full SHA
    93b6032 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2024

  1. fix cross entropy loss bug

    @goliaro
    goliaro committed May 19, 2024
    Configuration menu
    Copy the full SHA
    9546239 View commit details
    Browse the repository at this point in the history

  2. update alignment test

    @goliaro
    goliaro committed May 19, 2024
    Configuration menu
    Copy the full SHA
    ff4b703 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. update test

    @goliaro
    goliaro committed May 20, 2024
    Configuration menu
    Copy the full SHA
    b613666 View commit details
    Browse the repository at this point in the history

  2. add llama peft alignment test to ci

    @goliaro
    goliaro committed May 20, 2024
    Configuration menu
    Copy the full SHA
    dde0b61 View commit details
    Browse the repository at this point in the history

Commits on May 24, 2024

  1. Fix values for unused params in incr_decoding

    @Flechman
    Flechman committed May 24, 2024
    Configuration menu
    Copy the full SHA
    1a31b65 View commit details
    Browse the repository at this point in the history

  2. Add PEFTModelID NO_ID singleton instead of None

    @Flechman
    Flechman committed May 24, 2024
    Configuration menu
    Copy the full SHA
    7e3d111 View commit details
    Browse the repository at this point in the history

Commits on May 25, 2024

  1. Fix PEFTModelID::NO_ID reference

    @Flechman
    Flechman authored May 25, 2024
    Configuration menu
    Copy the full SHA
    079ba59 View commit details
    Browse the repository at this point in the history

  2. reduce logging

    @goliaro
    goliaro committed May 25, 2024
    Configuration menu
    Copy the full SHA
    f464eb8 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2024

  1. fix

    @goliaro
    goliaro committed May 26, 2024
    Configuration menu
    Copy the full SHA
    8d89acd View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. fix

    @goliaro
    goliaro committed May 29, 2024
    Configuration menu
    Copy the full SHA
    33c0fef View commit details
    Browse the repository at this point in the history

Commits on Jun 11, 2024

  1. Add peft demo

    @Flechman
    Flechman committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    6727d3a View commit details
    Browse the repository at this point in the history

  2. Add readme for demo

    @Flechman
    Flechman committed Jun 11, 2024
    Configuration menu
    Copy the full SHA
    6d7c245 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. fix alignment issue

    @goliaro
    goliaro committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    511fd64 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Peft optimizer (#1290) 

    * add optimizer config, only allocate weights for training

* sgd 1

* sgd 2

* update

* fix

* linting

* .

* .

* fix

* fix allreduce bug

* update

* update

* add optimizer hook in hf

* update

* update script

* .

* fix

* fwd

* bwd

* start grads

* fix gradient misalignment!

* update

* Add support for llama3

* various fixes

---------

Co-authored-by: Remi Delacourt <remi.delacourt@gmail.com>
    @goliaro @Flechman
    goliaro and Flechman authored Jul 10, 2024
    Configuration menu
    Copy the full SHA
    9948b4e View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Jul 11, 2024
    Configuration menu
    Copy the full SHA
    7df0ac5 View commit details
    Browse the repository at this point in the history

Commits on Jul 15, 2024

  1. Optimizers python interface (#1441) 

    * python interface for optimizer

* update lora linear config to support python interface

* update python interface

* finished lora python interface

* fix

* fix

* update

* update

* more fixes

* fix
    @goliaro
    goliaro authored Jul 15, 2024
    Configuration menu
    Copy the full SHA
    2789705 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. initialize lora weights where needed

    @goliaro
    goliaro committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    4d0657a View commit details
    Browse the repository at this point in the history

  2. Add notebook

    @Flechman
    Flechman committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    70eba7b View commit details
    Browse the repository at this point in the history

  3. Update demo to use dataset

    @Flechman
    Flechman committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    29a2121 View commit details
    Browse the repository at this point in the history

  4. Fix'

    @Flechman
    Flechman committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    69e5e06 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Save weights after end of finetuning (#1446) 

    * support accumulation of gradients without update

* add code to save peft weights

* fix

* save configs

* cleanup
    @goliaro
    goliaro authored Jul 17, 2024
    Configuration menu
    Copy the full SHA
    1c7fd1c View commit details
    Browse the repository at this point in the history

  2. Fully use notebook for demo

    @Flechman
    Flechman committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    fc4e3f5 View commit details
    Browse the repository at this point in the history

  3. Parameterize generation and finetuning configs

    @Flechman
    Flechman committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    786c320 View commit details
    Browse the repository at this point in the history

  4. Comment out inference for now

    @Flechman
    Flechman committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    b3c6242 View commit details
    Browse the repository at this point in the history

  5. fix bug in lora inference only mode

    @goliaro
    goliaro committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    b174a2f View commit details
    Browse the repository at this point in the history

  6. fix

    @goliaro
    goliaro committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    a92daef View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. Add finetuning or inference only flags

    @Flechman
    Flechman committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    c515caa View commit details
    Browse the repository at this point in the history

  2. fix

    @Flechman
    Flechman committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    5b7db51 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    bcc9702 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2024

  1. fix

    @goliaro
    goliaro committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    ab9aa2a View commit details
    Browse the repository at this point in the history

  2. PEFT model upload (#1450) 

    * upload test

* fix
    @goliaro
    goliaro authored Jul 19, 2024
    Configuration menu
    Copy the full SHA
    09e2471 View commit details
    Browse the repository at this point in the history

  3. Make demo_class.py executable

    @Flechman
    Flechman committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    5a44604 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'peft' of https://github.com/flexflow/FlexFlow into peft

    @Flechman
    Flechman committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    bac88c6 View commit details
    Browse the repository at this point in the history

  5. fix

    @goliaro
    goliaro committed Jul 19, 2024
    Configuration menu
    Copy the full SHA
    55eb7ed View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2024

  1. add base_model_name_or_path

    @Flechman
    Flechman committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    ad8308d View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    8d7b35c View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    f4aca75 View commit details
    Browse the repository at this point in the history

  4. support llama-3 tokenizer

    @goliaro
    goliaro committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    2b421e4 View commit details
    Browse the repository at this point in the history

  5. print output tokens when not benchmarking

    @goliaro
    goliaro committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    120bca9 View commit details
    Browse the repository at this point in the history

  6. Use Llama3 in demo_class

    @Flechman
    Flechman committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    dc36d39 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'peft' of https://github.com/flexflow/FlexFlow into peft

    @Flechman
    Flechman committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    ab547f7 View commit details
    Browse the repository at this point in the history

  8. Use Llama3 in demo

    @Flechman
    Flechman committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    6b904f6 View commit details
    Browse the repository at this point in the history

  9. fix data loading for llama-3

    @goliaro
    goliaro committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    242bbe5 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2024

  1. Add download models to demo

    @Flechman
    Flechman committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    7dfb3d0 View commit details
    Browse the repository at this point in the history

  2. return/print loss at each finetuning step

    @goliaro
    goliaro committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    4066467 View commit details
    Browse the repository at this point in the history

  3. fix

    @goliaro
    goliaro committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    c1eae6d View commit details
    Browse the repository at this point in the history

  4. Adjust demo parameters

    @Flechman
    Flechman committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    716bcf1 View commit details
    Browse the repository at this point in the history

  5. Fix for finetuning

    @Flechman
    Flechman committed Jul 21, 2024
    Configuration menu
    Copy the full SHA
    7c48428 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. pass finetuning losses to python interface

    @goliaro
    goliaro committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    6394bff View commit details
    Browse the repository at this point in the history

  2. Update demo

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    da6d516 View commit details
    Browse the repository at this point in the history

  3. Fix upload

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    00d83fb View commit details
    Browse the repository at this point in the history

  4. Refactor demo

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    a9d2385 View commit details
    Browse the repository at this point in the history

  5. rename demo_class to demo

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    6cd0650 View commit details
    Browse the repository at this point in the history

  6. fix

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    03c2f2e View commit details
    Browse the repository at this point in the history

  7. remove epoch from loss print

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    e240537 View commit details
    Browse the repository at this point in the history

  8. Finish demo

    @Flechman
    Flechman committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    fc731ec View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2024

  1. fix test

    @goliaro
    goliaro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    7c371eb View commit details
    Browse the repository at this point in the history

  2. rocm fixes

    @goliaro
    goliaro committed Aug 4, 2024
    Configuration menu
    Copy the full SHA
    52f4564 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. more rocm fixes

    @goliaro
    goliaro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    556d564 View commit details
    Browse the repository at this point in the history

  2. fix rocm build

    @goliaro
    goliaro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    5604c4d View commit details
    Browse the repository at this point in the history

  3. docker fix

    @goliaro
    goliaro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    97a4898 View commit details
    Browse the repository at this point in the history

  4. fix inference test

    @goliaro
    goliaro committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    6936cb6 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. fix workflow

    @goliaro
    goliaro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a8d9bc3 View commit details
    Browse the repository at this point in the history

  2. fix makefile

    @goliaro
    goliaro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    00a70f3 View commit details
    Browse the repository at this point in the history

  3. fix peft test

    @goliaro
    goliaro committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    925027f View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. fix all-reduce issue with lora for TP scenario

    @goliaro
    goliaro committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    b0af3b8 View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2024

  1. fix bwd lm head

    @goliaro
    goliaro authored and Gabriele Oliaro committed Aug 11, 2024
    Configuration menu
    Copy the full SHA
    6d18f7b View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. fixes

    @goliaro
    goliaro authored and Gabriele Oliaro committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    440ad3d View commit details
    Browse the repository at this point in the history

  2. more fixes

    @goliaro
    goliaro authored and Gabriele Oliaro committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    5cbe1a4 View commit details
    Browse the repository at this point in the history

  3. update

    @goliaro
    goliaro authored and Gabriele Oliaro committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    9ca3687 View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. fix alignment up to input ln

    @goliaro
    goliaro committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    d0e98ec View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. finished aligning all backward (tp>1)

    @goliaro
    goliaro committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    6ebea46 View commit details
    Browse the repository at this point in the history

  2. align all peft

    @goliaro
    goliaro committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    f98999c View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Merge branch 'inference' into peft

    @goliaro
    goliaro authored Sep 2, 2024
    Configuration menu
    Copy the full SHA
    5f73328 View commit details
    Browse the repository at this point in the history

  2. fix

    @goliaro
    goliaro committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    b06ed1a View commit details
    Browse the repository at this point in the history

  3. fix broken link

    @goliaro
    goliaro committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    3fe93dc View commit details
    Browse the repository at this point in the history

  4. formatting

    @goliaro
    goliaro committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    1a2fce3 View commit details
    Browse the repository at this point in the history

  5. fix

    @goliaro
    goliaro committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    cf4525f View commit details
    Browse the repository at this point in the history

  6. update

    @goliaro
    goliaro committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    90b2c87 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Revert "update" 

    This reverts commit 90b2c87.
    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    eae9b12 View commit details
    Browse the repository at this point in the history

  2. update

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    828f72e View commit details
    Browse the repository at this point in the history

  3. fix hip build

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    a8294e8 View commit details
    Browse the repository at this point in the history

  4. fix gpu ci

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    ccb28b1 View commit details
    Browse the repository at this point in the history

  5. fix gpu ci

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    ec472c2 View commit details
    Browse the repository at this point in the history

  6. update default gpu ci version to 12.0

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    aa1aa7b View commit details
    Browse the repository at this point in the history

  7. update ci to 12.0

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    9b2bd47 View commit details
    Browse the repository at this point in the history

  8. fix

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    f929cca View commit details
    Browse the repository at this point in the history

  9. fix

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    39b8d49 View commit details
    Browse the repository at this point in the history

  10. update

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    a60618b View commit details
    Browse the repository at this point in the history

  11. fix

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    b8be6f5 View commit details
    Browse the repository at this point in the history

  12. fix

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    0330272 View commit details
    Browse the repository at this point in the history

  13. update

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    5ab1da5 View commit details
    Browse the repository at this point in the history

  14. fix

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    08012b0 View commit details
    Browse the repository at this point in the history

  15. add cleanup

    @goliaro
    goliaro committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    e5785e6 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. downgrade to cuda=11.8

    @goliaro
    goliaro committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    c37f363 View commit details
    Browse the repository at this point in the history