Remote sequencer now handle cancelled/gone sequencers

[AhmedSoliman]

This also adds a little bit more stress to the tests to help them fail more often if there is an issue

// intentionally empty

---

Stack created with Sapling. Best reviewed with ReviewStack.

• [Bifrost] auto-drain the sequencer on exhausting offset limit #2690
• [Bifrost] Fix for tail-repair on previously trimmed logs #2689
• Fixes for trim interval and persisted lsn watcher #2683
• [Bifrost] Allow repair stores on unsealed log-server #2682
• Improve replicated-loglet restatectl commands #2681
• [Bifrost] Trim improvements #2680
• Fix treatment of not-found nodes and update provisioning semantics #2677
• -> Remote sequencer now handle cancelled/gone sequencers #2676
• Fix sequencer drain in challenging situations #2673

[github-actions]

Test Results

  7 files  ±0    7 suites  ±0   3m 25s ⏱️ -52s
 45 tests  - 2   44 ✅  - 2  1 💤 ±0  0 ❌ ±0 
174 runs   - 8  171 ✅  - 8  3 💤 ±0  0 ❌ ±0 

Results for commit fa53908. ± Comparison against base commit bb09c3d.

This pull request removes 2 tests.

dev.restate.sdktesting.tests.AwaitTimeout ‑ timeout(Client)
dev.restate.sdktesting.tests.RawHandler ‑ rawHandler(Client)

♻️ This comment has been updated with latest results.

[tillrohrmann]

Thanks for adding support for handling cancelled/gone sequencers @AhmedSoliman. The changes look good to me. I left two clarifying questions. +1 for merging.