Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initiative: Integrate Flat storage with State sync #8899

Closed
4 tasks done
Longarithm opened this issue Apr 6, 2023 · 4 comments
Closed
4 tasks done

Initiative: Integrate Flat storage with State sync #8899

Longarithm opened this issue Apr 6, 2023 · 4 comments
Assignees
Labels
C-tracking-issue Category: a tracking issue Node Node team T-core Team: issues relevant to the core team T-node Team: issues relevant to the node experience team

Comments

@Longarithm
Copy link
Member

Longarithm commented Apr 6, 2023

Core team Q2'2023 initiative.

Part of #8545. We plan to use flat storage to construct state parts instead of reading nodes from these parts from disk.

Tasks

@Longarithm Longarithm added T-core Team: issues relevant to the core team T-node Team: issues relevant to the node experience team C-tracking-issue Category: a tracking issue labels Apr 6, 2023
@Longarithm
Copy link
Member Author

Longarithm commented Apr 28, 2023

Implemented PoC for integration which works: #8927.
Added other issue requiring special attention: #8984.

@Longarithm
Copy link
Member Author

While working, I came across several challenges related to Trie logic and testing. I managed to fix some of them to keep the project moving, and documented all known issues here: #8997.

@Longarithm
Copy link
Member Author

Longarithm commented Jun 1, 2023

The core team involvement mostly finishes here, as #8898 is merged. We'll still keep an eye on productionization, e.g. #9090 which aims to use snapshots as source of FlatState.
Node team expects that we can include this work in 1.36 :)

@Longarithm
Copy link
Member Author

With #9090 we'll be able to use new state sync dumping on live nodes. It gives us option to snapshot flat storage and use it to construct state parts while real flat storage is keeping in sync.

@gmilescu gmilescu added the Node Node team label Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-tracking-issue Category: a tracking issue Node Node team T-core Team: issues relevant to the core team T-node Team: issues relevant to the node experience team
Projects
None yet
Development

No branches or pull requests

2 participants