Running two or more python scripts in parallel. Does prefect provide BashOperator like in Airflow? #3365
Answered
by
joshmeek
Sinha-Ujjawal
asked this question in
Q&A
-
So, I have this requirement of running 15 python scripts (that reads data from AWS S3 and process it and stores it in Postgres), these scripts are already developed by other people. I don't have time to refactor them and create individual prefect tasks. Does prefect provide BashOperator like in Airflow? e.g.- something like this BashOperator(command="python task1.py") |
Beta Was this translation helpful? Give feedback.
Answered by
joshmeek
Sep 22, 2020
Replies: 1 comment 1 reply
-
Hi @Sinha-Ujjawal to perform something like this in Prefect look into using the ShellTask https://docs.prefect.io/api/latest/tasks/shell.html#shelltask |
Beta Was this translation helpful? Give feedback.
1 reply
Answer selected by
Sinha-Ujjawal
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi @Sinha-Ujjawal to perform something like this in Prefect look into using the ShellTask https://docs.prefect.io/api/latest/tasks/shell.html#shelltask