Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Better progress logs for state ingestion #1666

Closed
bartekn opened this issue Aug 28, 2019 · 1 comment · Fixed by #3946
Closed

Better progress logs for state ingestion #1666

bartekn opened this issue Aug 28, 2019 · 1 comment · Fixed by #3946
Assignees
@bartekn
Labels
ingest New ingestion system

Comments

@bartekn
Copy link
Contributor

bartekn commented Aug 28, 2019 •
edited
Loading

Currently when ingesting state we print the number of entries processed every 100,000 entries. The problem with that is it's not linear because of the way history archives are designed. Would be great to have a linear progress indicator in the logs. See stellar/stellar-core#1868 for possible solution.
@bartekn bartekn added the ingest New ingestion system label Aug 28, 2019
@bartekn bartekn modified the milestone: Horizon 0.21.0 Aug 28, 2019
@bartekn
Copy link
Contributor Author

bartekn commented Sep 14, 2021

I think this is needed more than ever now when there are much more ledger entries. It's hard to estimate how much time it will take to ingest state.

@bartekn bartekn self-assigned this Sep 21, 2021
@bartekn bartekn mentioned this issue Sep 21, 2021
Merged
7 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@bartekn bartekn

Labels
ingest New ingestion system
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

ingest: Return progress in CheckpointChangeReader bartekn/go
1 participant
@bartekn