Standardizing reading input files with utf-8 encoding using io.open for both python 2 and 3. #184

kaushikacharya · 2022-06-30T09:54:21Z

This enables reading text of languages written in non-ascii characters.

Reference: https://stackoverflow.com/a/22288895/282155

…nd 3. 2. Line stripped before checking its length. 3. Creating dir (if not exist) before writing decode output.

1. Standardizing reading input files with io.open for both python 2 a…

1aebdf9

…nd 3. 2. Line stripped before checking its length. 3. Creating dir (if not exist) before writing decode output.

kaushikacharya mentioned this pull request Jul 5, 2022

UnicodeDecodeError: 'ascii' codec can't decode byte 0xa0 in position 2400: ordinal not in range(128) #112

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Standardizing reading input files with utf-8 encoding using io.open for both python 2 and 3. #184

Standardizing reading input files with utf-8 encoding using io.open for both python 2 and 3. #184

kaushikacharya commented Jun 30, 2022

Standardizing reading input files with utf-8 encoding using io.open for both python 2 and 3. #184

Are you sure you want to change the base?

Standardizing reading input files with utf-8 encoding using io.open for both python 2 and 3. #184

Conversation

kaushikacharya commented Jun 30, 2022