BUG: REGR: read_csv with memory_map=True raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data #43647
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Contributor
michal-gh
commented
Sep 18, 2021
michal-gh
commented
- [x ] closes BUG: REGR: read_csv with memory_map=True raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data #43540
- [x ] tests added / passed
- Ensure all linting tests pass, see here for how to run them
- [x ] whatsnew entry
3 tasks
twoertwein
reviewed
Sep 18, 2021
twoertwein
added
IO CSV
jreback
changed the title
jreback
reviewed
Sep 20, 2021
doc/source/whatsnew/v1.3.4.rst
Outdated
| @@ -19,6 +19,7 @@ Fixed regressions | |||
| - Fixed performance regression in :meth:`MultiIndex.equals` (:issue:`43549`) | |||
| - Fixed regression in :meth:`Series.cat.reorder_categories` failing to update the categories on the ``Series`` (:issue:`43232`) | |||
| - Fixed regression in :meth:`Series.cat.categories` setter failing to update the categories on the ``Series`` (:issue:`43334`) | |||
| - Fixed regression in :meth:`pandas.read_csv` raising UnicodeDecodeError exception when memory_map=True (:issue:`43540`) | |||
There was a problem hiding this comment.
Suggested change
| - Fixed regression in :meth:`pandas.read_csv` raising UnicodeDecodeError exception when memory_map=True (:issue:`43540`) | |
| - Fixed regression in :meth:`pandas.read_csv` raising `UnicodeDecodeError` exception when `memory_map=True` (:issue:`43540`) |
There was a problem hiding this comment.
Fixed in last commit
This reverts commit c2e91f8.
|
I updated |
twoertwein
approved these changes
Sep 21, 2021
jreback
approved these changes
Sep 21, 2021
|
thanks @michal-gh very nice. always happy to take further updates to master. |
|
@meeseeksdev backport 1.3.x |
meeseeksmachine
pushed a commit
to meeseeksmachine/pandas
that referenced
this pull request
Sep 21, 2021
…e raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data
|
Something went wrong ... Please have a look at my logs. |
simonjayhawkins
pushed a commit
that referenced
this pull request
Sep 22, 2021
…ap=True raises UnicodeDecodeError: 'utf-8' codec can't decode byte 0xc4 in position 262143: unexpected end of data ) (#43691) Co-authored-by: michal-gh <michaltus@gmail.com> Co-authored-by: Thomas Li <47963215+lithomas1@users.noreply.github.com>
|
Thank you @twoertwein , @jreback for help with this PR |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.