Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feature: track token spans (start/end offsets) #6

Merged
merged 2 commits into from
Aug 9, 2023
Merged

feature: track token spans (start/end offsets) #6

merged 2 commits into from
Aug 9, 2023

Conversation

ryangjchandler
Copy link
Owner

Adds a new Span type that has a start and end offset. Represents the first and last byte position of the token in the original string / source text.

@ryangjchandler ryangjchandler added the enhancement New feature or request label Aug 9, 2023
@ryangjchandler ryangjchandler merged commit a2c10c9 into main Aug 9, 2023
@ryangjchandler ryangjchandler deleted the feature/token-spans branch August 9, 2023 23:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ryangjchandler