Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up #3586

Merged
merged 1 commit into from
Dec 20, 2023
Merged

Clean up #3586

merged 1 commit into from
Dec 20, 2023

Conversation

dbutenhof
Copy link
Member

This combines a few issues: first, I've wanted to filter based on the unpacked tarball size, but some tarballs are beyond the range of the SQL INTEGER type and cause SQL cast errors -- change the interpretation of the int filter and sort type to BigInteger. Also cleans up the logging around retried Sync transaction errors, only logging warnings when it can't determine that the error is a PostgreSQL serialization error. (I hope: this is hard to provoke in casual testing.) Finally, clean up the logging of cached unpacked size by avoiding two separate logs (without dataset name) on unpack, and adding a log of the final unpacked size when we compute it.

This combines a few issues: first, I've wanted to filter based on the unpacked
tarball size, but some tarballs are beyond the range of the SQL `INTEGER` type
and cause SQL cast errors -- change the interpretation of the `int` filter and
sort type to `BigInteger`. Also cleans up the logging around retried Sync
transaction errors, only logging warnings when it can't determine that the
error is a PostgreSQL serialization error. (I hope: this is hard to provoke in
casual testing.) Finally, clean up the logging of cached unpacked size by
avoiding two separate logs (without dataset name) on unpack, and adding a log
of the final unpacked size when we compute it.
@dbutenhof
Copy link
Member Author

Interesting ... presumably due to the new branch protection rules, main seems to be running only the Jenkins CI ...

@webbnh
Copy link
Member

webbnh commented Dec 14, 2023

Interesting ... presumably due to the new branch protection rules, main seems to be running only the Jenkins CI ...

I'm not sure what you mean? (Under "checks", I see four entries -- Jenkins and three CodeQL thingies -- what else do you expect it to do?)

FWIW, main has its own branch protection rule, which should leave it unaffected by the other changes that we made to the rules....

@dbutenhof
Copy link
Member Author

Interesting ... presumably due to the new branch protection rules, main seems to be running only the Jenkins CI ...

I'm not sure what you mean? (Under "checks", I see four entries -- Jenkins and three CodeQL thingies -- what else do you expect it to do?)

FWIW, main has its own branch protection rule, which should leave it unaffected by the other changes that we made to the rules....

Fascinating. That might be even weirder ... normally they all start around the same time, but only the Jenkins run appeared for quite a while. Maybe GitHub was just too backed up to show them? Never seen that before.

Copy link
Member

@webbnh webbnh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the two nits that I found are insubstantial, this is good to go.

lib/pbench/server/cache_manager.py Show resolved Hide resolved
lib/pbench/server/cache_manager.py Show resolved Hide resolved
@dbutenhof dbutenhof merged commit 1d37d24 into distributed-system-analysis:main Dec 20, 2023
4 checks passed
@dbutenhof dbutenhof deleted the bigint branch December 20, 2023 13:12
webbnh pushed a commit that referenced this pull request Jan 4, 2024
This combines a few issues: first, I've wanted to filter based on the unpacked
tarball size, but some tarballs are beyond the range of the SQL `INTEGER` type
and cause SQL cast errors -- change the interpretation of the `int` filter and
sort type to `BigInteger`. Also cleans up the logging around retried Sync
transaction errors, only logging warnings when it can't determine that the
error is a PostgreSQL serialization error. (I hope: this is hard to provoke in
casual testing.) Finally, clean up the logging of cached unpacked size by
avoiding two separate logs (without dataset name) on unpack, and adding a log
of the final unpacked size when we compute it.
@webbnh webbnh mentioned this pull request Jan 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants