-
Notifications
You must be signed in to change notification settings - Fork 1.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add a new Engine implementation for replicas with segment replication enabled. #3240
Commits on May 6, 2022
-
Change fastForwardProcessedSeqNo method in LocalCheckpointTracker to …
…persisted checkpoint. This change inverts fastForwardProcessedSeqNo to fastForwardPersistedSeqNo for use in Segment Replication. This is so that a Segrep Engine can match the logic of InternalEngine where the seqNo is incremented with each operation, but only persisted in the tracker on a flush. With Segment Replication we bump the processed number with each operation received index/delete/noOp, and invoke this method when we receive a new set of segments to bump the persisted seqNo. Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 8553d2f - Browse repository at this point
Copy the full SHA 8553d2fView commit details
Commits on May 9, 2022
-
Extract Translog specific engine methods into an abstract class.
This change extracts translog specific methods to an abstract engine class so that other engine implementations can reuse translog logic. Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 5c54323 - Browse repository at this point
Copy the full SHA 5c54323View commit details -
Add a separate Engine implementation for replicas with segment replic…
…ation enabled. This change adds a new engine intended to be used on replicas with segment replication enabled. This engine does not wire up an IndexWriter, but still writes all operations to a translog. The engine uses a new ReaderManager that refreshes from an externally provided SegmentInfos. Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for e77b616 - Browse repository at this point
Copy the full SHA e77b616View commit details -
Configuration menu - View commit details
-
Copy full SHA for 22e7dde - Browse repository at this point
Copy the full SHA 22e7ddeView commit details -
Fix :server:compileInternalClusterTestJava compilation.
Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for daacef4 - Browse repository at this point
Copy the full SHA daacef4View commit details -
Fix failing test naming convention check.
Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 3d3cf48 - Browse repository at this point
Copy the full SHA 3d3cf48View commit details
Commits on May 11, 2022
-
- Removed isReadOnlyReplica from overloaded constructor and added feature flag checks. - Updated log msg in NRTReplicationReaderManager - cleaned up store ref counting in NRTReplicationEngine. Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 8fddec8 - Browse repository at this point
Copy the full SHA 8fddec8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 576f61d - Browse repository at this point
Copy the full SHA 576f61dView commit details
Commits on May 12, 2022
-
Remove TranslogAwareEngine and build translog in NRTReplicationEngine.
Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for e0d9742 - Browse repository at this point
Copy the full SHA e0d9742View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41715d5 - Browse repository at this point
Copy the full SHA 41715d5View commit details -
Add missing translog methods to NRTEngine.
Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 4201475 - Browse repository at this point
Copy the full SHA 4201475View commit details -
Remove persistent seqNo check from fastForwardProcessedSeqNo.
Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 675dc11 - Browse repository at this point
Copy the full SHA 675dc11View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5ea0e7b - Browse repository at this point
Copy the full SHA 5ea0e7bView commit details -
Add test specific to translog trimming.
Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 5bccdd8 - Browse repository at this point
Copy the full SHA 5bccdd8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b380d2 - Browse repository at this point
Copy the full SHA 5b380d2View commit details
Commits on May 18, 2022
-
Add failEngine calls to translog methods in NRTReplicationEngine.
Roll xlog generation on replica when a new commit point is received. Signed-off-by: Marc Handalian <handalm@amazon.com>
Configuration menu - View commit details
-
Copy full SHA for 06b0d98 - Browse repository at this point
Copy the full SHA 06b0d98View commit details