Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Track partition sizes via CloudWatch #6564

Open
nadove-ucsc opened this issue Sep 12, 2024 · 1 comment
Open

Track partition sizes via CloudWatch #6564

nadove-ucsc opened this issue Sep 12, 2024 · 1 comment
Labels
+ [priority] High debt [type] A defect incurring continued engineering cost enh [type] New feature or request infra [subject] Project infrastructure like CI/CD, build and deployment scripts needs design [process] Solution to issue has yet to be devised orange [process] Done by the Azul team

Comments

@nadove-ucsc
Copy link
Contributor

#6531 will remove the IT assertions that validate partition sizes. To compensate for this loss of coverage, we should instead track partition sizes during reindexing using the log message emitted by the repository plugin:

azul/src/azul/plugins/repository/tdr.py

Line 205 in 6e66a5b

log.info('There are %i bundle(s) with prefix %r in source %r.',

@nadove-ucsc nadove-ucsc added the orange [process] Done by the Azul team label Sep 12, 2024
nadove-ucsc added a commit that referenced this issue Sep 12, 2024
@nadove-ucsc
Add FIXME (#6564)
3b94458
@hannes-ucsc
Copy link
Member

This needs a design.

@hannes-ucsc hannes-ucsc added infra [subject] Project infrastructure like CI/CD, build and deployment scripts enh [type] New feature or request debt [type] A defect incurring continued engineering cost + [priority] High needs design [process] Solution to issue has yet to be devised labels Sep 13, 2024
@hannes-ucsc hannes-ucsc removed their assignment Sep 13, 2024
nadove-ucsc added a commit that referenced this issue Sep 13, 2024
@nadove-ucsc
Add FIXME (#6564)
8c812c1
nadove-ucsc added a commit that referenced this issue Sep 13, 2024
@nadove-ucsc
Add FIXME (#6564)
675fcc7
nadove-ucsc added a commit that referenced this issue Sep 13, 2024
@nadove-ucsc
Add FIXME (#6564)
a8dae53
nadove-ucsc added a commit that referenced this issue Sep 13, 2024
@nadove-ucsc
Add FIXME (#6564)
7f8360f
nadove-ucsc added a commit that referenced this issue Sep 13, 2024
@nadove-ucsc
Add FIXME (#6564)
ecc64da
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
+ [priority] High debt [type] A defect incurring continued engineering cost enh [type] New feature or request infra [subject] Project infrastructure like CI/CD, build and deployment scripts needs design [process] Solution to issue has yet to be devised orange [process] Done by the Azul team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hannes-ucsc @nadove-ucsc