You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The new command parser added to Piper for the 0.16 Cog release mangles Unicode inputs. The mangling has two sources:
Use of Erlang binary and iolist conversion functions (:erlang.binary_to_list/1 and :erlang.iolist_to_binary/1) in the leex generated lexers and yecc generated parsers.
Omission of the unicode option in calls to re:run/3 and re:replace/3 also in the generated lexers and parsers.
This bug is likely present in the old parser as well.
The text was updated successfully, but these errors were encountered:
The fix pending in operable/piper#35 ensures Unicode passes thru the parsing pipeline unmangled. It does not add support for Unicode bundle or command names as doing so would require deeper changes to the parsers and test suite.
That said, making the parsing pipeline Unicode-safe is a necessary first step towards supporting Unicode bundle and command names.
The new command parser added to Piper for the 0.16 Cog release mangles Unicode inputs. The mangling has two sources:
:erlang.binary_to_list/1
and:erlang.iolist_to_binary/1
) in the leex generated lexers and yecc generated parsers.unicode
option in calls tore:run/3
andre:replace/3
also in the generated lexers and parsers.This bug is likely present in the old parser as well.
The text was updated successfully, but these errors were encountered: