Skip to content

Commit

Permalink
Update README
Browse files Browse the repository at this point in the history
  • Loading branch information
bshall committed May 19, 2020
1 parent 4c74e83 commit c5bfee9
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 6 deletions.
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
# Vector-Quantized Contrastive Predictive Coding

To learn discrete representations of speech for the [ZeroSpeech challenges](https://zerospeech.com/), we propose vector-quantized contrastive predictive coding.
An encoder maps input speech into a discrete sequence of codes.
Next, an autoregressive model summarises the latent representation (up until time t) into a context vector.
Using this context, the model learns to discriminate future frames from negative examples sampled randomly from other utterances.
Finally, an RNN based vocoder is trained to generate audio from the discretized representation.
Train and evaluate the VQ-VAE model for our submission to the [ZeroSpeech 2020 challenge](https://zerospeech.com/).
Voice conversion samples can be found [here](https://bshall.github.io/VectorQuantizedCPC/).
Pretrained weights for the 2019 English and Indonesian datasets can be found [here](https://github.com/bshall/VectorQuantizedCPC/releases/tag/v0.1).
Leader-board for the ZeroSpeech 2020 challenge can be found [here](https://zerospeech.com/2020/results.html).

<p align="center">
<img width="784" height="340" alt="VQ-CPC model summary"
src="https://raw.githubusercontent.com/bshall/VectorQuantizedCPC/master/model.png">
<sup><strong>Fig 1:</strong> VQ-CPC model architecture.</sup>
</p>

## Requirements
Expand Down
2 changes: 1 addition & 1 deletion config/training/cpc.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ training:
n_utterances_per_speaker: 8
n_prediction_steps: 12
n_negatives: 17
n_epochs: 25000
n_epochs: 22000
scheduler:
warmup_epochs: 150
initial_lr: 1e-5
Expand Down

0 comments on commit c5bfee9

Please sign in to comment.