Skip to content

Commit

Permalink
disable mldnn in faster tokenizer
Browse files Browse the repository at this point in the history
  • Loading branch information
zhanglirong1999 committed Nov 7, 2023
1 parent ca80f18 commit b6c5856
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions test/tokenizer/test_faster_tokenizer_op.py
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,7 @@ def __init__(self, model_dir):

# fast_tokenizer op only support cpu.
config.disable_gpu()
config.disable_mkldnn()
config.set_cpu_math_library_num_threads(10)

config.switch_use_feed_fetch_ops(False)
Expand Down

0 comments on commit b6c5856

Please sign in to comment.