Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bounds error tokenizing reasonable string #7

Closed
neelsmith opened this issue Feb 7, 2021 · 2 comments
Closed

Bounds error tokenizing reasonable string #7

neelsmith opened this issue Feb 7, 2021 · 2 comments
Labels
bug Something isn't working

Comments

@neelsmith
Copy link
Owner

This string throws

BoundsError: attempt to access SubString{String}

at index [0]

when tokenizing

"ὁ μὲν δή ὀβελὸς παρατίθεται πῥὸς ἀταίτησϊν ."

@neelsmith neelsmith added the bug Something isn't working label Feb 7, 2021
@neelsmith
Copy link
Owner Author

neelsmith commented Feb 7, 2021

Happens when final punctuation separated by ws from previous lexical token; when ws is gone, no problems.

This fails:

"ὁ μὲν δή ὀβελὸς παρατίθεται πῥὸς ἀταίτησϊν ."

but this works

"ὁ μὲν δή ὀβελὸς παρατίθεται πῥὸς ἀταίτησϊν."

@neelsmith
Copy link
Owner Author

fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant