Preprocessor Error #194
Replies: 1 comment
-
It's an issue with the Farasapy package so it's better to hit them up for this issue |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
arabert_prep = ArabertPreprocessor("aubmindlab/bert-base-arabertv2")
For some reason it gives this error
File "C:\ProgramData\Anaconda3\envs\graduationproject\Lib\site-packages\arabert\preprocess.py", line 291, in init
self.farasa_segmenter = FarasaSegmenter(interactive=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ProgramData\Anaconda3\envs\graduationproject\Lib\site-packages\farasa__base.py", line 54, in init
self._initialize_task()
File "C:\ProgramData\Anaconda3\envs\graduationproject\Lib\site-packages\farasa__base.py", line 140, in _initialize_task
return self._run_task_interactive(bword)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\ProgramData\Anaconda3\envs\graduationproject\Lib\site-packages\farasa__base.py", line 215, in _run_task_interactive
output = self.__task_proc.stdout.readline().decode(encoding='utf-8').strip()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc7 in position 0: invalid continuation byte
Beta Was this translation helpful? Give feedback.
All reactions