Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UTF-16 support for JSON and option to skip BOMs #14

Merged
merged 4 commits into from
Oct 6, 2020
Merged

Conversation

neilpa
Copy link
Owner

@neilpa neilpa commented Sep 18, 2020

Adds support to detect and decode UTF-16 (BE or LE) JSON text. Also adds an option to skip BOMs at the start of a JSON document. These are treated as errors by default (with a better message) based on RFC 8259. Resolves #13

TODO

  • Tests for the data generated in 6f93deb for the new encoding combos
  • Tests for one and two byte JSON docs

@neilpa neilpa marked this pull request as ready for review October 6, 2020 23:11
@neilpa neilpa merged commit b2b9a85 into master Oct 6, 2020
@neilpa neilpa deleted the unicode-encodings branch October 6, 2020 23:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

UTF-8 with BOM and UTF-16 LE encoded files produce read error
1 participant