Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ASR] Support CTC decoder online #821

Merged
merged 14 commits into from
Jan 24, 2022
Merged

[ASR] Support CTC decoder online #821

merged 14 commits into from
Jan 24, 2022

Conversation

Jackwaterveg
Copy link
Contributor

@Jackwaterveg Jackwaterveg commented Sep 10, 2021 •
edited
Loading

PR types

New features

PR changes

Others

Describe

  1. 增加了CTC的online解码的功能，目前支持batch size>=1的情况。
  2. 按照chunk的解码的解码结果已经和不用chunk的结果对齐。
  3. 内存溢出问题：使用top查看，程序运行的时候没有内存持续增长的情况，比较稳定。

@mergify mergify bot added the enhancement label Sep 10, 2021
zh794390558
zh794390558 reviewed Sep 10, 2021
View reviewed changes
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
deepspeech/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
deepspeech/modules/ctc.py Outdated Show resolved Hide resolved
zh794390558
zh794390558 reviewed Sep 13, 2021
View reviewed changes
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.cpp Outdated Show resolved Hide resolved
deepspeech/decoders/swig/ctc_beam_search_decoder.h Outdated Show resolved Hide resolved
deepspeech/decoders/swig_wrapper.py Outdated Show resolved Hide resolved
deepspeech/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
deepspeech/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
deepspeech/models/ds2_online/deepspeech2.py Outdated Show resolved Hide resolved
@mergify
Copy link

mergify bot commented Sep 24, 2021

This pull request is now in conflict :(

@mergify mergify bot added the conflicts label Sep 24, 2021
@mergify mergify bot added the S2T asr/st label Oct 28, 2021
@stale
Copy link

stale bot commented Dec 12, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the Stale label Dec 12, 2021
@zh794390558 zh794390558 added this to the r0.1.1 milestone Dec 28, 2021
@stale stale bot removed the Stale label Dec 28, 2021
@zh794390558 zh794390558 modified the milestones: r0.1.1, r0.2.0 Jan 11, 2022
@zh794390558 zh794390558 changed the title [Add feature] CTC online , only support batch_size =1 [asr] CTC online , only support batch_size =1 Jan 11, 2022
@Jackwaterveg Jackwaterveg changed the title [asr] CTC online , only support batch_size =1 [ASR] CTC decoder online Jan 19, 2022
@Jackwaterveg Jackwaterveg changed the title [ASR] CTC decoder online [ASR] Support CTC decoder online Jan 19, 2022
@mergify mergify bot removed the conflicts label Jan 19, 2022
zh794390558
zh794390558 reviewed Jan 19, 2022
View reviewed changes
paddlespeech/s2t/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
paddlespeech/s2t/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
paddlespeech/s2t/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
paddlespeech/s2t/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
paddlespeech/s2t/models/ds2_online/deepspeech2.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
@mergify mergify bot added the Example label Jan 20, 2022
zh794390558
zh794390558 reviewed Jan 20, 2022
View reviewed changes
examples/other/1xt2x/src_deepspeech2x/models/ds2/deepspeech2.py Show resolved Hide resolved
paddlespeech/s2t/exps/deepspeech2/model.py Outdated Show resolved Hide resolved
paddlespeech/s2t/models/ds2/deepspeech2.py Outdated Show resolved Hide resolved
paddlespeech/s2t/models/u2/u2.py Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Show resolved Hide resolved
paddlespeech/s2t/decoders/ctcdecoder/swig_wrapper.py Outdated Show resolved Hide resolved
zh794390558
zh794390558 reviewed Jan 21, 2022
View reviewed changes
paddlespeech/s2t/decoders/ctcdecoder/swig_wrapper.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
zh794390558
zh794390558 approved these changes Jan 24, 2022
View reviewed changes
Copy link
Collaborator

@zh794390558 zh794390558 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

zh794390558
zh794390558 requested changes Jan 24, 2022
View reviewed changes
Copy link
Collaborator

@zh794390558 zh794390558 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image

zh794390558
zh794390558 reviewed Jan 24, 2022
View reviewed changes
paddlespeech/s2t/decoders/ctcdecoder/swig_wrapper.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
paddlespeech/s2t/modules/ctc.py Outdated Show resolved Hide resolved
@Jackwaterveg Jackwaterveg force-pushed the ds2_online branch 2 times, most recently from 6c07247 to 1924153 Compare January 24, 2022 05:39
@zh794390558 zh794390558 merged commit d7222c0 into PaddlePaddle:develop Jan 24, 2022
Jackwaterveg pushed a commit to Jackwaterveg/DeepSpeech that referenced this pull request Jan 29, 2022
@hysunflower
1224_remove, test=document_fix (PaddlePaddle#821)
64be437
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@zh794390558 zh794390558 zh794390558 requested changes

Assignees

@Jackwaterveg Jackwaterveg

Labels
enhancement Example S2T asr/st
Projects
PaddleSpeech
Status: Done
Milestone
r0.2.0
Development

Successfully merging this pull request may close these issues.
2 participants
@Jackwaterveg @zh794390558