-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fast storage optimization for queries and iterations #5
Commits on Jan 12, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 4dfa41e - Browse repository at this point
Copy the full SHA 4dfa41eView commit details
Commits on Feb 11, 2022
-
Configuration menu - View commit details
-
Copy full SHA for 3d65774 - Browse repository at this point
Copy the full SHA 3d65774View commit details -
Configuration menu - View commit details
-
Copy full SHA for e48528b - Browse repository at this point
Copy the full SHA e48528bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3144b6d - Browse repository at this point
Copy the full SHA 3144b6dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 163f49a - Browse repository at this point
Copy the full SHA 163f49aView commit details -
Configuration menu - View commit details
-
Copy full SHA for d1d7d92 - Browse repository at this point
Copy the full SHA d1d7d92View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0e76628 - Browse repository at this point
Copy the full SHA 0e76628View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4e53d7f - Browse repository at this point
Copy the full SHA 4e53d7fView commit details -
Configuration menu - View commit details
-
Copy full SHA for fb33de8 - Browse repository at this point
Copy the full SHA fb33de8View commit details -
Configuration menu - View commit details
-
Copy full SHA for cdbae73 - Browse repository at this point
Copy the full SHA cdbae73View commit details -
Configuration menu - View commit details
-
Copy full SHA for 30358a1 - Browse repository at this point
Copy the full SHA 30358a1View commit details -
remove fast nodes from disk on save and clear fast cache when version…
… is deleted, fix all tests but random and with index
Configuration menu - View commit details
-
Copy full SHA for fd3a948 - Browse repository at this point
Copy the full SHA fd3a948View commit details -
resolve an issue with randomized tests caused by the fast node cache …
…not being cleared when latest version is saved
Configuration menu - View commit details
-
Copy full SHA for c54050f - Browse repository at this point
Copy the full SHA c54050fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0195356 - Browse repository at this point
Copy the full SHA 0195356View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2dcbd32 - Browse repository at this point
Copy the full SHA 2dcbd32View commit details -
Configuration menu - View commit details
-
Copy full SHA for f0ff650 - Browse repository at this point
Copy the full SHA f0ff650View commit details -
Configuration menu - View commit details
-
Copy full SHA for 38f0be4 - Browse repository at this point
Copy the full SHA 38f0be4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 196c272 - Browse repository at this point
Copy the full SHA 196c272View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2583324 - Browse repository at this point
Copy the full SHA 2583324View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6903b24 - Browse repository at this point
Copy the full SHA 6903b24View commit details -
implement GetFast method to preserve Get with correct index return, c…
…onvert unit tests from Get to GetFast where applicable
Configuration menu - View commit details
-
Copy full SHA for 789efe8 - Browse repository at this point
Copy the full SHA 789efe8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 29775ca - Browse repository at this point
Copy the full SHA 29775caView commit details -
Configuration menu - View commit details
-
Copy full SHA for d9d9185 - Browse repository at this point
Copy the full SHA d9d9185View commit details -
Configuration menu - View commit details
-
Copy full SHA for e0afb9d - Browse repository at this point
Copy the full SHA e0afb9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for e2661d1 - Browse repository at this point
Copy the full SHA e2661d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for bf6b2ad - Browse repository at this point
Copy the full SHA bf6b2adView commit details -
Configuration menu - View commit details
-
Copy full SHA for f7c6b12 - Browse repository at this point
Copy the full SHA f7c6b12View commit details -
Configuration menu - View commit details
-
Copy full SHA for b6d937f - Browse repository at this point
Copy the full SHA b6d937fView commit details -
Configuration menu - View commit details
-
Copy full SHA for e1915a9 - Browse repository at this point
Copy the full SHA e1915a9View commit details -
Configuration menu - View commit details
-
Copy full SHA for d2a6187 - Browse repository at this point
Copy the full SHA d2a6187View commit details -
Configuration menu - View commit details
-
Copy full SHA for ece487f - Browse repository at this point
Copy the full SHA ece487fView commit details -
avoid redundant full tree search in GetFast of immutable tree when fa…
…st node is nil and tree is latest
Configuration menu - View commit details
-
Copy full SHA for 1fe01bc - Browse repository at this point
Copy the full SHA 1fe01bcView commit details -
Configuration menu - View commit details
-
Copy full SHA for f149348 - Browse repository at this point
Copy the full SHA f149348View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2088ac8 - Browse repository at this point
Copy the full SHA 2088ac8View commit details -
optimize GetFast, perform a refactor to ensure that fast nodes on dis…
…k are matched and better test
Configuration menu - View commit details
-
Copy full SHA for 5bed4af - Browse repository at this point
Copy the full SHA 5bed4afView commit details -
Configuration menu - View commit details
-
Copy full SHA for 544e4ab - Browse repository at this point
Copy the full SHA 544e4abView commit details -
* propagate errors from nodedb and avoid panicking * begin implementing fast node iteration * resolve rebase issue in random tests * fix iteration to deserialize fast node for extracting the correct value * finalzie iteration and let all unit tests pass * add benchmarks * merge GetVersioned and GetVersionedFast * remove fast node deletion from DeleteVersion and DeleteVersionRange and benchmark * fix and unit test iteration on mutable and immutable trees * implement tests for iterator and iterate, begin testing fast iterator * fix and unit test fast iterator
Configuration menu - View commit details
-
Copy full SHA for aa9f2b7 - Browse repository at this point
Copy the full SHA aa9f2b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 727b949 - Browse repository at this point
Copy the full SHA 727b949View commit details -
Configuration menu - View commit details
-
Copy full SHA for 84729ce - Browse repository at this point
Copy the full SHA 84729ceView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4997938 - Browse repository at this point
Copy the full SHA 4997938View commit details -
Configuration menu - View commit details
-
Copy full SHA for b4165d1 - Browse repository at this point
Copy the full SHA b4165d1View commit details -
* implement nodedb changes to set and get chain version from the database * implement and unit test upgrade to fast storage in mutable tree * refactor for auto upgrade to fast version in mutable tree contructor, load version and lazy load version * use proper functionality for getting latest version * remove unused error * fix comment * use fast version value in tests * spurious tab * fix style problems and remove redundant code in tests
Configuration menu - View commit details
-
Copy full SHA for 20a7fa6 - Browse repository at this point
Copy the full SHA 20a7fa6View commit details -
Configuration menu - View commit details
-
Copy full SHA for d28ccac - Browse repository at this point
Copy the full SHA d28ccacView commit details -
Configuration menu - View commit details
-
Copy full SHA for c2a89d4 - Browse repository at this point
Copy the full SHA c2a89d4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 682cb71 - Browse repository at this point
Copy the full SHA 682cb71View commit details -
Configuration menu - View commit details
-
Copy full SHA for a855368 - Browse repository at this point
Copy the full SHA a855368View commit details -
Configuration menu - View commit details
-
Copy full SHA for f025374 - Browse repository at this point
Copy the full SHA f025374View commit details -
Configuration menu - View commit details
-
Copy full SHA for 368a454 - Browse repository at this point
Copy the full SHA 368a454View commit details -
refactor fast upgrade to read from tree instead of traversing disk no…
…des and orphans, update unit tests
Configuration menu - View commit details
-
Copy full SHA for 6d24a60 - Browse repository at this point
Copy the full SHA 6d24a60View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5ea4c4f - Browse repository at this point
Copy the full SHA 5ea4c4fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 92dbfd1 - Browse repository at this point
Copy the full SHA 92dbfd1View commit details -
Configuration menu - View commit details
-
Copy full SHA for bd1c445 - Browse repository at this point
Copy the full SHA bd1c445View commit details -
Configuration menu - View commit details
-
Copy full SHA for a424853 - Browse repository at this point
Copy the full SHA a424853View commit details -
Configuration menu - View commit details
-
Copy full SHA for fa0c081 - Browse repository at this point
Copy the full SHA fa0c081View commit details -
Configuration menu - View commit details
-
Copy full SHA for d0cdc1c - Browse repository at this point
Copy the full SHA d0cdc1cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4944a59 - Browse repository at this point
Copy the full SHA 4944a59View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1319329 - Browse repository at this point
Copy the full SHA 1319329View commit details -
Configuration menu - View commit details
-
Copy full SHA for 40b97ee - Browse repository at this point
Copy the full SHA 40b97eeView commit details -
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for e9c85e0 - Browse repository at this point
Copy the full SHA e9c85e0View commit details -
add extra comment for domain in fast iterator
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for c85a17a - Browse repository at this point
Copy the full SHA c85a17aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 495ed3b - Browse repository at this point
Copy the full SHA 495ed3bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 20abc09 - Browse repository at this point
Copy the full SHA 20abc09View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4584387 - Browse repository at this point
Copy the full SHA 4584387View commit details -
Update testutils_test.go with a comment
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0edf216 - Browse repository at this point
Copy the full SHA 0edf216View commit details -
Update benchmarks/bench_test.go with a comment for runKnownQueriesFast
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 0c1ad3f - Browse repository at this point
Copy the full SHA 0c1ad3fView commit details -
Update benchmarks/bench_test.go with a comment for runQueriesFast
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 054cdbf - Browse repository at this point
Copy the full SHA 054cdbfView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0bd59dc - Browse repository at this point
Copy the full SHA 0bd59dcView commit details -
Update comment immutable_tree.go
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 2312d57 - Browse repository at this point
Copy the full SHA 2312d57View commit details -
Update comment for migration in mutable_tree.go
Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 4f6953a - Browse repository at this point
Copy the full SHA 4f6953aView commit details -
Configuration menu - View commit details
-
Copy full SHA for e309f7f - Browse repository at this point
Copy the full SHA e309f7fView commit details -
Fast Cache - Downgrade - reupgrade protection and other improvements (#…
…12) * add leaf hash to fast node and unit test * refactor get with index and get by index, fix migration in load version and lazy load version * use Get in GetVersioned of mutable tree * refactor non membership proof to use fast storage if available * bench non-membership proof * fix bench tests to work with the new changes * add downgrade-reupgrade protection and unit test * remove leaf hash from fast node * resolve multithreading bug related to iterators not being closed * clean up * use correct tree in bench tests * add cache to tree used to bench non membership proofs * add benc tests for GetWithIndex and GetByIndex * revert GetWithIndex and GetByIndex * remove unused import * unit test re-upgrade protection and fix small issues * remove redundant setStorageVersion method * fix bug with appending to live stage version to storage version and nit test * add comment for setFastStorageVersionToBatch * refactor and improve unit tests for reupgrade protection * rename ndb's isFastStorageEnabled to hasUpgradedToFastStorage and add comments * comment out new implementation for GetNonMembershipProof * update comments in nodedb to reflect the difference between hasUpgradedToFastStorage and shouldForceFastStorageUpdate * refactor nodedb tests * downgrade tendermint to 0.34.14 - osmosis's latest cosmos sdk does not support 0.35.0 * fix bug where fast storage was not enabled when version 0 was attempted to be loaded * implement unsaved fast iterator to be used in mutable tree (#16)
Configuration menu - View commit details
-
Copy full SHA for 2dbde70 - Browse repository at this point
Copy the full SHA 2dbde70View commit details -
Configuration menu - View commit details
-
Copy full SHA for c83f0c5 - Browse repository at this point
Copy the full SHA c83f0c5View commit details -
expose isUpgradeable method on mutable tree and unit test (#17)
* expose isUpgradeable method on mutable tree and unit test * go fmt
Configuration menu - View commit details
-
Copy full SHA for f0f815e - Browse repository at this point
Copy the full SHA f0f815eView commit details