-
Notifications
You must be signed in to change notification settings - Fork 264
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: enable loading videos from s3 #580
feat: enable loading videos from s3 #580
Conversation
If we don't download s3 files, will it result in a significant logic change? How do other projects handle this? |
Add changes to the https://github.com/georgia-tech-db/eva/blob/master/CHANGELOG.md |
We can store the "path" to s3 files with prefix (e.g., s3://..., local://....), and have different GET executors. The optimizer will choose the correct executor. |
This PR adds support for loading video datasets from S3.
Sample Queries
LOAD VIDEO 's3://bucket/dummy.avi' INTO MyVideo;
LOAD VIDEO 's3://bucket/eva_videos/*.mp4 INTO MyVideos;
Design Decisions
s3_download_dir
inside the config and by default points to inside the.eva
folder.Testing