Use ICU tokenizer to improve some Asian languages support #40
Job | Run time |
---|---|
1m 14s | |
1m 9s | |
14s | |
1m 23s | |
19s | |
1m 9s | |
14s | |
1m 18s | |
9s | |
1m 25s | |
15s | |
11s | |
9m 0s |
Job | Run time |
---|---|
1m 14s | |
1m 9s | |
14s | |
1m 23s | |
19s | |
1m 9s | |
14s | |
1m 18s | |
9s | |
1m 25s | |
15s | |
11s | |
9m 0s |