Skip to content
This repository has been archived by the owner on Dec 13, 2023. It is now read-only.

Add property for the timeout of sweeper polling for workflows #3633

Merged
merged 1 commit into from
Jun 8, 2023

Conversation

lsfe87
Copy link
Contributor

@lsfe87 lsfe87 commented Jun 1, 2023

Pull Request type

  • Bugfix
  • Feature
  • Refactoring (no functional changes, no api changes)
  • Build related changes (Please run ./gradlew generateLock saveLock to refresh dependencies)
  • WHOSUSING.md
  • Other (please describe):

NOTE: Please remember to run ./gradlew spotlessApply to fix any format violations.

Changes in this PR

Adds a new property to configure the timeout that the sweeper thread will poll for workflows to sweep.
It was hard coded as 2000 ms, which for certain environments can lead to an increase in the overall duration of a workflow execution, as seen with @marosmars.
This is especially relevant for environments with low amounts of workflows executing at a given time, coupled with moderate to high CPU count, and in workflows with several SUB_WORKFLOW tasks.

Issue #

Alternatives considered

Describe alternative implementation you have considered

@v1r3n v1r3n self-requested a review June 2, 2023 08:59
@v1r3n v1r3n merged commit 04b8747 into Netflix:main Jun 8, 2023
@lsfe87 lsfe87 deleted the sweeper_timeout_config branch June 19, 2023 14:24
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants