-
Notifications
You must be signed in to change notification settings - Fork 618
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[fork-network] Optimize amend-access-keys using in-memory tries. #10176
Conversation
core/store/src/config.rs
Outdated
@@ -121,6 +121,8 @@ pub struct StoreConfig { | |||
|
|||
// TODO (#9989): To be phased out in favor of state_snapshot_config | |||
pub state_snapshot_compaction_enabled: bool, | |||
|
|||
pub disable_rocksdb_compression: bool, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please add a comment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Removed the flag.
core/store/src/db/rocksdb.rs
Outdated
@@ -528,7 +528,12 @@ fn rocksdb_column_options(col: DBCol, store_config: &StoreConfig, temp: Temperat | |||
opts | |||
} | |||
|
|||
fn set_compression_options(opts: &mut Options) { | |||
fn set_compression_options(opts: &mut Options, disable_compression: bool) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(unrelated to this line)
Please mention somewhere in fork-network comments, that you recommend disabling rocksdb compression and what kind of speed up can be expected.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Actually, I tried without it and there's no real difference (~70min vs ~80min). Compression spins up more threads to do compression, using up more CPU, but there's enough CPU with 8 cores anyway.
https://near.zulipchat.com/#narrow/stream/297873-pagoda.2Fnode/topic/New.20betanet.20infra