Passing scattered S3 objects into a ContainerTask #4100
-
I have a list of S3 objects that I need to pass into a ContainerTask, and ideally I'd like Flyte to handle the downloading rather than having the user code handle that. If all the S3 objects were in the same directory (same prefix), I could handle this with a simple FlyteDirectory. But these S3 objects are potentially scattered across different directories. Is there a construct like a List[FlyteFile] that would handle this use case? |
Beta Was this translation helpful? Give feedback.
Answered by
Future-Outlier
Dec 16, 2024
Replies: 1 comment
-
this is fixed, now to support FlyteDirectory as input output in flyte |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
Future-Outlier
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
this is fixed, now to support FlyteDirectory as input output in flyte