Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: disable eta for headers & bodies #4065

Merged
merged 2 commits into from
Aug 9, 2023
Merged

Conversation

rkrasiuk
Copy link
Member

@rkrasiuk rkrasiuk commented Aug 4, 2023

Motivation

Currently, ETA calculation is inconsistent and often ends up misleading the users.

Screenshot 2023-08-04 at 17 16 40

Solution

Remove ETA from logs pending improvements.

@rkrasiuk rkrasiuk added C-debt Refactor of code section that is hard to understand or maintain A-observability Related to tracing, metrics, logs and other observability tools labels Aug 4, 2023
@rkrasiuk rkrasiuk requested a review from mattsse August 4, 2023 14:25
@rkrasiuk rkrasiuk requested a review from onbjerg as a code owner August 4, 2023 14:25
Copy link
Collaborator

@mattsse mattsse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

agree, but would like to reenable after improvements,

for example there are cases where bodies is at 100% for a bit

pending @shekhirin

@rkrasiuk rkrasiuk requested a review from shekhirin August 4, 2023 14:33
@codecov
Copy link

codecov bot commented Aug 4, 2023

Codecov Report

Merging #4065 (eaa3f0c) into main (a371cb8) will decrease coverage by 0.06%.
Report is 44 commits behind head on main.
The diff coverage is 0.00%.

Impacted file tree graph

Files Changed Coverage Δ
bin/reth/src/node/events.rs 12.56% <0.00%> (-0.33%) ⬇️

... and 84 files with indirect coverage changes

Flag Coverage Δ
integration-tests 16.52% <0.00%> (+0.31%) ⬆️
unit-tests 64.03% <0.00%> (-0.13%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
reth binary 25.64% <0.00%> (+0.01%) ⬆️
blockchain tree 83.04% <ø> (ø)
pipeline 90.07% <ø> (-0.08%) ⬇️
storage (db) 74.56% <ø> (+0.26%) ⬆️
trie 94.70% <ø> (ø)
txpool 48.36% <ø> (+3.02%) ⬆️
networking 77.46% <ø> (-0.05%) ⬇️
rpc 57.47% <ø> (-0.77%) ⬇️
consensus 64.08% <ø> (+0.56%) ⬆️
revm 32.54% <ø> (-0.56%) ⬇️
payload builder 6.58% <ø> (ø)
primitives 87.99% <ø> (-0.08%) ⬇️

@shekhirin
Copy link
Collaborator

shekhirin commented Aug 4, 2023

I'd leave the ETA for execution stage, as it's the longest one and ETA can actually give a rough estimate on how long it'd take to finish. Agree that for stages with more uneven commits it doesn't work good.

@joshieDo
Copy link
Collaborator

joshieDo commented Aug 4, 2023

i think ETA is fine for stages that don't use the network (hashing, execution~~, etc)

@mattsse
Copy link
Collaborator

mattsse commented Aug 4, 2023

I'd leave the ETA for execution stage, as it's the longest one and ETA can actually give a rough estimate on how long it'd take to finish. Agree that for stages with more uneven commits it doesn't work good.

good point, this actually outweighs the issues we have with it I think.

suggest we keep it as is and push improvements instead?

@shekhirin
Copy link
Collaborator

I still strongly agree with disabling it for headers/bodies stages 😄

@rkrasiuk rkrasiuk changed the title chore: disable eta chore: disable eta for headers & bodies Aug 6, 2023
@rkrasiuk rkrasiuk requested a review from mattsse August 6, 2023 12:05
///
/// NOTE: Currently ETA is disabled for Headers and Bodies stages until we find better
/// heuristics for calculation.
fn fmt_for_stage(&self, stage: StageId) -> String {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we instead completely remove the eta field if it's known to be unknown (lol) all the time?

@rkrasiuk rkrasiuk added this pull request to the merge queue Aug 9, 2023
Merged via the queue into main with commit 6581961 Aug 9, 2023
24 checks passed
@rkrasiuk rkrasiuk deleted the rkrasiuk/disable-eta branch August 9, 2023 12:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-observability Related to tracing, metrics, logs and other observability tools C-debt Refactor of code section that is hard to understand or maintain
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants