Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use step functions for jobs that are triggered manually #766

Open
coilysiren opened this issue Oct 17, 2024 · 1 comment
Open

Use step functions for jobs that are triggered manually #766

coilysiren opened this issue Oct 17, 2024 · 1 comment
Assignees
Labels
scope: operations Platform operations. Does not affect projects scope: service Service layer / component type: feature New feature or new functionality to existing feature

Comments

@coilysiren
Copy link
Contributor

Manually triggered jobs can benefit from AWS Step Functions in the same way the scheduled (#525) and event (#744) jobs can. That step functions add a tracking layer that is incredibly useful for debugging failures.

@coilysiren coilysiren self-assigned this Oct 17, 2024
@coilysiren
Copy link
Contributor Author

coilysiren commented Oct 17, 2024

TODO tech spec, options:

  1. exclusively using run-command as-is
  2. using run-command to create a step function dynamically
  3. creating a new manual_jobs config
  4. folding all the jobs into a shared jobs config
  5. a single step function that can dynamically run different commands based on inputs

@lorenyu lorenyu added this to the Background jobs milestone Oct 17, 2024
@lorenyu lorenyu added type: feature New feature or new functionality to existing feature scope: service Service layer / component scope: operations Platform operations. Does not affect projects labels Oct 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
scope: operations Platform operations. Does not affect projects scope: service Service layer / component type: feature New feature or new functionality to existing feature
Projects
None yet
Development

No branches or pull requests

2 participants