Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Design "Expectation" Data Model #2

Closed
Tracked by #10
chelma opened this issue Nov 20, 2022 · 3 comments
Closed
Tracked by #10

Design "Expectation" Data Model #2

chelma opened this issue Nov 20, 2022 · 3 comments
Assignees

Comments

@chelma
Copy link
Member

chelma commented Nov 20, 2022

Task

Design a system to capture expectations about clusters and upgrades in a way that they can be used for all currently expected use-cases:

  • Executing upgrade expectations against an upgraded cluster
  • Optional for now, but preferred: Executing upgrade expectations "predictively" against a cluster without performing an upgrade
  • Consider how we will report these expectations to the user, but don't design/create a full reporting mechanism
  • Consider how we will down-select among a large library of expectations once we support many core engine and plugin versions/combinations (tags?), but don't design/create a full mechanism
  • Will probably include a concept of conditionality (when does it apply), what the expectation is (what should be true/false), and maybe some context information for humans
  • Up for design consideration - should the dataset used to test the expectations be inferrable/generate-able from the expectations themselves?

Acceptance Criteria

  • Create a GH issue with a design for data model, review w/ engineering team, get signoff
  • Design should be specific enough that a prototype can be created in a follow up task
@chelma
Copy link
Member Author

chelma commented Nov 29, 2022

@mikaylathompson Will split this into new task(s) as appropriate and add ECDs to them. Team will review asynchronously.

@mikaylathompson mikaylathompson changed the title Design/Prototype "Expectation" Data Model Design "Expectation" Data Model Nov 29, 2022
@mikaylathompson
Copy link
Collaborator

ECD: 1 week (12/6) to a review-ready design, up to one additional week (12/13) for a approved and complete design.

@mikaylathompson
Copy link
Collaborator

#24

lewijacn added a commit that referenced this issue May 8, 2023
MIGRATIONS-1014: Add optional VPC stack with unit tests and updated doc

Signed-off-by: Tanner Lewis <lewijacn@amazon.com>
gregschohn added a commit that referenced this issue Apr 30, 2024
… to allow for chaining.

In addition to chaining sequential stages together (which now, again, need to create all intermediates before the current work item), the class now emits which sequential stages are missing (outstanding) in the DCF's diagnostic supplier.
Sample output may look like this
[504336483] Caller-task completion for idx=3[…]<-[335107734] OnlineRadixSorterForIntegratedKeys.addFutureForWork[…]<-[215078753] Kickoff for slot #3[…]<-[1384454980] Work to finish for slot #2 is awaiting [slotsOutstanding:2][…]

Signed-off-by: Greg Schohn <greg.schohn@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants