Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wakeword Project Phase 2 Deliverables #31

Open
1 of 11 tasks
secretsauceai opened this issue Feb 21, 2022 · 0 comments
Open
1 of 11 tasks

Wakeword Project Phase 2 Deliverables #31

secretsauceai opened this issue Feb 21, 2022 · 0 comments

Comments

@secretsauceai
Copy link
Owner

Phase two of the Wakeword Project

Each step usually consists of training several (at least 5) models (using the same and other collected data to remove bias) and evaluating their results to ensure that the models aren't randomly performing well.

  • Models (first tf1.13, then tflite) must pass minimum quality control: 5 wake up in a row, 2h random input (ie 1h TV and 1h conversation) without false wake up
    • tf 1.13
    • tflite (this test is on hold for improvements to the incremental training methods)
  • Models must pass production quality control: 1 week: wake up every time, ~2-3 false wake ups (future goal: 1 false wake up per week!)
    • tflite
      • this is the current blocker for production level tflite models
  • Use Wake Word Data Prep models to test TF lite compression optimization
    • Once tflite has passed both quality controls, it's time to compress further!
    • Benchmark performance (CPU% raspi4, loss of quality of model)
  • Precise Rust
    • Runner
    • MFCC in rust

Precise tflite

  • Create new branch of Precise reflecting the results on compression (include CLI for people to pick between levels of compression)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant