What's Changed
- Ensure all lines fed to marian are well formed by @XapaJIaMnu in #23
- Fix Stage modifiers not applying + tests by @XapaJIaMnu in #22
- Dump state file by write+move vs overwrite by @graemenail in #25
- Add initial logger support by @XapaJIaMnu in #24
- Clean .state files during end-to-end testing by @graemenail in #28
- Typo alignment improvements by @graemenail in #27
- Alignment passthrough by @jelmervdl in #26
- Fixes + num_field assertion by @XapaJIaMnu in #31
- Other small fixes by @XapaJIaMnu in #32
- Add a processing pool for the modifiers by @jelmervdl in #34
- Benchmark github action by @jelmervdl in #35
- Add merge and standalone noise modifiers by @XapaJIaMnu in #41
- Use line modification probability in typos by @eu9ene in #51
- Fix names of parameters for merge and noise by @eu9ene in #52
- Add more information to the log on the current stage by @gregtatum in #59
- Add support for ICU tokenizer by @eu9ene in #61
New Contributors
- @graemenail made their first contribution in #25
- @eu9ene made their first contribution in #51
- @gregtatum made their first contribution in #59
Full Changelog: v0.2...v0.3
Contributors
jelmervdl, gregtatum, and 3 other contributors