Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

snapshot and batching removal, recovery transactions #31

Merged
merged 1 commit into from
Aug 25, 2017

Commits on Aug 23, 2017

  1. snapshot and batching removal, recovery transactions

    * Removes snapshotting and batching from the storage. These lead
      to rather high memory usage in some cases and they can be later
      reimplemented as an additional layer if necessary. Tuning
      LevelDB configuration seems to give enough performance.
    
    * Adds MarkRecovered method on the storage interface. This is used
      to signal that recovery has finished and that the processor/view
      can expect a lower message rate. Default storage uses this to
      disable LevelDB compaction via a transaction during recovery and
      re-enabling it afterwards.
    
    * Removes StoragePath option. StorageBuilder now takes a complete
      storage path. Two helpers functions were added for generating
      default storage paths for views and processors.
    SamiHiltunen committed Aug 23, 2017
    Configuration menu
    Copy the full SHA
    a089490 View commit details
    Browse the repository at this point in the history