Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve CI test runtime with pytest-xdist #270

Merged
merged 11 commits into from
Feb 7, 2025

Conversation

tylerhutcherson
Copy link
Collaborator

@tylerhutcherson tylerhutcherson commented Feb 5, 2025

pytest-xdist runs workers to tackle the test suite concurrently (using more cpus):
https://pytest-xdist.readthedocs.io/en/stable/distribution.html#running-tests-across-multiple-cpus

The addition of this tool AND some small updates to testcontainer usage (for Redis instances) helps us achieve a ~3-4x speed up locally.

@tylerhutcherson
Copy link
Collaborator Author

Some issue with the latest redis stack version???

abrookins
abrookins previously approved these changes Feb 6, 2025
Copy link
Collaborator

@abrookins abrookins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work! That's a big savings in local testing time that should also save time and money in CI over the long run.

abrookins
abrookins previously approved these changes Feb 6, 2025
Copy link
Collaborator

@abrookins abrookins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

abrookins
abrookins previously approved these changes Feb 6, 2025
@tylerhutcherson tylerhutcherson merged commit f6e3bad into main Feb 7, 2025
28 checks passed
@tylerhutcherson tylerhutcherson deleted the feat/RAAE-592-use-pytest-xdist branch February 7, 2025 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants