Skip to content
This repository has been archived by the owner on Feb 8, 2024. It is now read-only.

feat(overflow): add overflow_forced_keys envvar #54

Merged
merged 5 commits into from
Nov 27, 2023
Merged

Conversation

xvello
Copy link
Contributor

@xvello xvello commented Nov 21, 2023

  • Add the overflow_forced_keys config to mirror capture-py's EVENT_PARTITION_KEYS_TO_OVERRIDE, to force a key to overflow even if the burst threshold is not reached.
  • Add unit test for that feature

HashSet::contains has a fast-path for empty state, so I'm just using a HashSet::new() by default. There are several hashing algorithms to choose from, but that's not a big concern right now.

@xvello xvello requested review from a team and ellie November 21, 2023 11:25
@ellie
Copy link
Contributor

ellie commented Nov 21, 2023

one failing test

Copy link

@tomasfarias tomasfarias left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@xvello xvello merged commit 7056e80 into main Nov 27, 2023
4 checks passed
@xvello xvello deleted the xvello/forced_keys branch November 27, 2023 13:05
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants