Use ICU tokenizer to improve some Asian languages support #45
Job | Run time |
---|---|
14s | |
15s | |
1m 26s | |
10s | |
1m 25s | |
12s | |
10s | |
1m 28s | |
16s | |
1m 37s | |
1m 27s | |
1m 26s | |
10m 6s |
Job | Run time |
---|---|
14s | |
15s | |
1m 26s | |
10s | |
1m 25s | |
12s | |
10s | |
1m 28s | |
16s | |
1m 37s | |
1m 27s | |
1m 26s | |
10m 6s |