Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove dependency on datasets #51

Closed
rlouf opened this issue Oct 9, 2024 · 0 comments · Fixed by #52
Closed

Remove dependency on datasets #51

rlouf opened this issue Oct 9, 2024 · 0 comments · Fixed by #52
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed

Comments

@rlouf
Copy link
Member

rlouf commented Oct 9, 2024

The library currently includes datasets as a dependency, which is quite heavyweight and depends on pyarrow which is causing issues when building wheels #50. However, this dependency is only used in outlines_core.models.transformers, which in turn is only used for benchmarking and testing. We should move the code in outlines_core.models.transformers to the test and benchmark directories.

@rlouf rlouf added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Oct 9, 2024
@rlouf rlouf changed the title Remove dependency on transformers and huggingface_hub Remove dependency on datasets Oct 9, 2024
@rlouf rlouf closed this as completed in #52 Oct 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants