-
Notifications
You must be signed in to change notification settings - Fork 2.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Standalone diarization+ASR evaluation script #5439
Commits on Nov 16, 2022
-
first commit on eval_diar_with_asr.py
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 19cbe6f - Browse repository at this point
Copy the full SHA 19cbe6fView commit details -
Add a standalone diarization-ASR evaluation transcript
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for d85efa2 - Browse repository at this point
Copy the full SHA d85efa2View commit details -
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for c1e7cf4 - Browse repository at this point
Copy the full SHA c1e7cf4View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for aea2e6c - Browse repository at this point
Copy the full SHA aea2e6cView commit details -
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for c48bf07 - Browse repository at this point
Copy the full SHA c48bf07View commit details -
Configuration menu - View commit details
-
Copy full SHA for cdc3235 - Browse repository at this point
Copy the full SHA cdc3235View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for b9feb6b - Browse repository at this point
Copy the full SHA b9feb6bView commit details
Commits on Nov 17, 2022
-
Configuration menu - View commit details
-
Copy full SHA for af94a2e - Browse repository at this point
Copy the full SHA af94a2eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 902c088 - Browse repository at this point
Copy the full SHA 902c088View commit details -
Configuration menu - View commit details
-
Copy full SHA for 11a7188 - Browse repository at this point
Copy the full SHA 11a7188View commit details -
Added description on eval modes
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 979ec60 - Browse repository at this point
Copy the full SHA 979ec60View commit details -
Merge branch 'mulspk_asr_eval_script' of https://github.com/NVIDIA/NeMo…
… into mulspk_asr_eval_script
Configuration menu - View commit details
-
Copy full SHA for 2731413 - Browse repository at this point
Copy the full SHA 2731413View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9a48743 - Browse repository at this point
Copy the full SHA 9a48743View commit details -
adding diar_infer_general.yaml
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for e449287 - Browse repository at this point
Copy the full SHA e449287View commit details -
Merge branch 'mulspk_asr_eval_script' of https://github.com/NVIDIA/NeMo…
… into mulspk_asr_eval_script
Configuration menu - View commit details
-
Copy full SHA for a4cbd7a - Browse repository at this point
Copy the full SHA a4cbd7aView commit details -
fix msdd_model in general yaml file
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for e35629d - Browse repository at this point
Copy the full SHA e35629dView commit details -
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for db31725 - Browse repository at this point
Copy the full SHA db31725View commit details -
Configuration menu - View commit details
-
Copy full SHA for 50f8417 - Browse repository at this point
Copy the full SHA 50f8417View commit details -
Added description on eval modes
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 61b4809 - Browse repository at this point
Copy the full SHA 61b4809View commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 250468c - Browse repository at this point
Copy the full SHA 250468cView commit details -
Add MoE support for T5 model (w/o expert parallel) (#5409)
* clean Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * kwarg ref Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * fix Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * fix Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * extra args Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * test Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * rm prints Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * style Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * review comments Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * review comments Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * review comments Signed-off-by: Abhinav Khattar <aklife97@gmail.com> * fix Signed-off-by: Abhinav Khattar <aklife97@gmail.com> Signed-off-by: Abhinav Khattar <aklife97@gmail.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 9e2acca - Browse repository at this point
Copy the full SHA 9e2accaView commit details -
Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca>
Configuration menu - View commit details
-
Copy full SHA for 0abcbaf - Browse repository at this point
Copy the full SHA 0abcbafView commit details -
Fix for concat map dataset (#5133)
* change for concat map dataset * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Exhaust longest dataset * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Co-authored-by: 1-800-BAD-CODE <> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca>
Configuration menu - View commit details
-
Copy full SHA for 54a87d2 - Browse repository at this point
Copy the full SHA 54a87d2View commit details -
Add temporary fix for CUDA issue in Dockerfile (#5421) (#5422)
Signed-off-by: Yu Yao <yuya@nvidia.com> Signed-off-by: Yu Yao <yuya@nvidia.com> Signed-off-by: Yu Yao <yuya@nvidia.com> Co-authored-by: yaoyu-33 <54727607+yaoyu-33@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for dd3f3aa - Browse repository at this point
Copy the full SHA dd3f3aaView commit details -
Fix GPT generation when using sentencepiece tokenizer (#5413) (#5428)
* Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Yi Dong <yidong@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Yi Dong <yidong@nvidia.com> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for a2145ba - Browse repository at this point
Copy the full SHA a2145baView commit details -
Support for finetuning and finetuning inference with .ckpt files & ba…
…tch size refactoring (#5339) * Initial refactor Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Resolve config before passing to load_from_checkpoint Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes for model parallel and nemo restore Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fixes for eval Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Revert config changes Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Refactor Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix typo Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove comments Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Minor Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fix validation reconfiguration Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Remove old comment Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Fixes for test_ds Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 4d7b8cf - Browse repository at this point
Copy the full SHA 4d7b8cfView commit details -
Revert "Add temporary fix for CUDA issue in Dockerfile (#5421)" (#5431)…
Configuration menu - View commit details
-
Copy full SHA for cb6f339 - Browse repository at this point
Copy the full SHA cb6f339View commit details -
[ITN] fix year date graph, cardinals extension for hundreds (#5435)
* wip Signed-off-by: ekmb <ebakhturina@nvidia.com> * add lociko's hundreds extension for cardinals Signed-off-by: ekmb <ebakhturina@nvidia.com> * add optional end Signed-off-by: ekmb <ebakhturina@nvidia.com> * restart ci Signed-off-by: ekmb <ebakhturina@nvidia.com> Signed-off-by: ekmb <ebakhturina@nvidia.com>
Configuration menu - View commit details
-
Copy full SHA for 0f56bdb - Browse repository at this point
Copy the full SHA 0f56bdbView commit details -
update doc in terms of get_label for lang id model (#5366)
* reflect PR 5278 ion doc Signed-off-by: fayejf <fayejf07@gmail.com> * reflect comment Signed-off-by: fayejf <fayejf07@gmail.com> Signed-off-by: fayejf <fayejf07@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 6a97bc9 - Browse repository at this point
Copy the full SHA 6a97bc9View commit details -
Revert workaround for T5 that sets number of workers to 0 & sync_batc…
…h_comm=False (#5420) (#5433) * Revert workers workaround Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix in config Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> * Fix Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com> Signed-off-by: MaximumEntropy <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca> Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for cec4715 - Browse repository at this point
Copy the full SHA cec4715View commit details -
Fixed bug in notebook (#5382) (#5394)
Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Signed-off-by: Virginia Adams <vadams@nvidia.com> Co-authored-by: Virginia Adams <78445382+vadam5@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 785426c - Browse repository at this point
Copy the full SHA 785426cView commit details -
Fixing bug in Megatron BERT when loss mask is all zeros (#5424)
* Fixing bug when loss mask is fully zero Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update megatron_bert_model.py Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com> * Update dataset_utils.py Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * Update dataset_utils.py Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com> * Update dataset_utils.py Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com> Signed-off-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca>
Configuration menu - View commit details
-
Copy full SHA for 6b018da - Browse repository at this point
Copy the full SHA 6b018daView commit details -
Use updated API for overlapping grad sync with pipeline parallelism (#…
…5236) Signed-off-by: Tim Moon <tmoon@nvidia.com> Signed-off-by: Tim Moon <tmoon@nvidia.com>
Configuration menu - View commit details
-
Copy full SHA for 51250e9 - Browse repository at this point
Copy the full SHA 51250e9View commit details -
support to disable sequence length + 1 input tokens for each sample i…
…n MegatronGPT (#5363) * support to disable sequence length + 1 input tokens for MegatronGPT * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Co-authored-by: Anmol Gupta <anmolg@nvidia.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Sandeep Subramanian <sandeep.subramanian.1@umontreal.ca>
Configuration menu - View commit details
-
Copy full SHA for 7041f09 - Browse repository at this point
Copy the full SHA 7041f09View commit details -
[TTS] Create script for processing TTS training audio (#5262)
* Create script for processing TTS training audio * Update VAD trimming logic * Remove unused import Signed-off-by: Ryan <rlangman@nvidia.com>
Configuration menu - View commit details
-
Copy full SHA for 9de694a - Browse repository at this point
Copy the full SHA 9de694aView commit details -
[TTS] remove useless logic for set_tokenizer. (#5430)
Signed-off-by: Xuesong Yang <1646669+XuesongYang@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for b75fc1a - Browse repository at this point
Copy the full SHA b75fc1aView commit details -
Fix setting up of
ReduceLROnPlateau
learning rate scheduler (#5444)* Fix tests Signed-off-by: PeganovAnton <peganoff2@mail.ru> * Add accidentally lost changes Signed-off-by: PeganovAnton <peganoff2@mail.ru> Signed-off-by: PeganovAnton <peganoff2@mail.ru>
Configuration menu - View commit details
-
Copy full SHA for 40e2fdf - Browse repository at this point
Copy the full SHA 40e2fdfView commit details -
Signed-off-by: Somshubra Majumdar <titu1994@gmail.com> Signed-off-by: Somshubra Majumdar <titu1994@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 841ed52 - Browse repository at this point
Copy the full SHA 841ed52View commit details -
Fix for getting tokenizer in character-based ASR models when using ta…
…rred dataset (#5442) Signed-off-by: Jonghwan Hyeon <hyeon0145@gmail.com> Signed-off-by: Jonghwan Hyeon <hyeon0145@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for db6c136 - Browse repository at this point
Copy the full SHA db6c136View commit details -
adding diar_infer_general.yaml Signed-off-by: Taejin Park <tango4j@gmail.com> Update codeql.yml Signed-off-by: Somshubra Majumdar <titu1994@gmail.com> Update codeql.yml Signed-off-by: Somshubra Majumdar <titu1994@gmail.com> fix msdd_model in general yaml file Signed-off-by: Taejin Park <tango4j@gmail.com> fixed errors in yaml file Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for a615aff - Browse repository at this point
Copy the full SHA a615affView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8f60d87 - Browse repository at this point
Copy the full SHA 8f60d87View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8f37ecb - Browse repository at this point
Copy the full SHA 8f37ecbView commit details
Commits on Nov 18, 2022
-
moved eval_der function and fixed tqdm options
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 1402c97 - Browse repository at this point
Copy the full SHA 1402c97View commit details -
Merge branch 'mulspk_asr_eval_script' of https://github.com/NVIDIA/NeMo…
… into mulspk_asr_eval_script
Configuration menu - View commit details
-
Copy full SHA for 5390636 - Browse repository at this point
Copy the full SHA 5390636View commit details -
Configuration menu - View commit details
-
Copy full SHA for f00250a - Browse repository at this point
Copy the full SHA f00250aView commit details -
[pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Configuration menu - View commit details
-
Copy full SHA for 92f4159 - Browse repository at this point
Copy the full SHA 92f4159View commit details -
Changed minor error in docstrings
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 1fa70e8 - Browse repository at this point
Copy the full SHA 1fa70e8View commit details -
Merge branch 'mulspk_asr_eval_script' of https://github.com/NVIDIA/NeMo…
… into mulspk_asr_eval_script
Configuration menu - View commit details
-
Copy full SHA for e2d519d - Browse repository at this point
Copy the full SHA e2d519dView commit details
Commits on Nov 19, 2022
-
removed score_labels and changed leave=True
Signed-off-by: Taejin Park <tango4j@gmail.com>
Configuration menu - View commit details
-
Copy full SHA for 037b61c - Browse repository at this point
Copy the full SHA 037b61cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2b838af - Browse repository at this point
Copy the full SHA 2b838afView commit details