Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fork-network] Optimize amend-access-keys using in-memory tries. #10176

Merged
merged 1 commit into from
Nov 15, 2023

Conversation

robin-near
Copy link
Contributor

@robin-near robin-near commented Nov 15, 2023

@robin-near robin-near requested a review from a team as a code owner November 15, 2023 03:03
@robin-near robin-near marked this pull request as draft November 15, 2023 03:04
@@ -121,6 +121,8 @@ pub struct StoreConfig {

// TODO (#9989): To be phased out in favor of state_snapshot_config
pub state_snapshot_compaction_enabled: bool,

pub disable_rocksdb_compression: bool,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add a comment.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed the flag.

@@ -528,7 +528,12 @@ fn rocksdb_column_options(col: DBCol, store_config: &StoreConfig, temp: Temperat
opts
}

fn set_compression_options(opts: &mut Options) {
fn set_compression_options(opts: &mut Options, disable_compression: bool) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(unrelated to this line)
Please mention somewhere in fork-network comments, that you recommend disabling rocksdb compression and what kind of speed up can be expected.

Copy link
Contributor Author

@robin-near robin-near Nov 15, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, I tried without it and there's no real difference (~70min vs ~80min). Compression spins up more threads to do compression, using up more CPU, but there's enough CPU with 8 cores anyway.

@robin-near robin-near changed the title Fork optimization draft [fork-network] Optimize amend-access-keys using in-memory tries. Nov 15, 2023
@robin-near robin-near marked this pull request as ready for review November 15, 2023 22:13
@robin-near robin-near added this pull request to the merge queue Nov 15, 2023
Merged via the queue into near:master with commit dbfb0df Nov 15, 2023
15 of 16 checks passed
@robin-near robin-near deleted the fork2 branch November 15, 2023 22:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants