Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Report subscription status #38

Merged
merged 3 commits into from
Jun 30, 2023
Merged

Report subscription status #38

merged 3 commits into from
Jun 30, 2023

Conversation

ryannedolan
Copy link
Collaborator

Added logic to the subscription reconciler to keep track of deployed resources and to periodically check on their readiness. Subscription readiness is now predicated on the readiness of all resources in the pipeline.

Testing

Subscription status now progresses through multiple states:

$ kubectl get subscriptions -w
NAME       STATUS      DB         SQL
products               RAWKAFKA   SELECT "quantity", "product_id" AS KEY FROM INVENTORY."products_on_hand"
products   Planned.    RAWKAFKA   SELECT "quantity", "product_id" AS KEY FROM INVENTORY."products_on_hand"
products   Deployed.   RAWKAFKA   SELECT "quantity", "product_id" AS KEY FROM INVENTORY."products_on_hand"
products   Ready.      RAWKAFKA   SELECT "quantity", "product_id" AS KEY FROM INVENTORY."products_on_hand"

While the pipeline is being deployed, the operator periodically checks on the status of all resources:

Checking status of pipeline for Subscription/products...
Resource default/KafkaTopic/products-kafka-topic considered ready by default.
KafkaTopic/products-kafka-topic is ready.
FlinkDeployment/products-flink-job is NOT ready.
Pipeline for Subscription/products is NOT ready.
...
FlinkDeployment/products-flink-job is ready.
Subscription/products is ready.

@ryannedolan ryannedolan requested review from ehoner and hshukla June 28, 2023 06:02
@ryannedolan ryannedolan enabled auto-merge (squash) June 29, 2023 23:01
@ryannedolan ryannedolan requested a review from hshukla June 29, 2023 23:01
@ryannedolan ryannedolan merged commit c064a16 into main Jun 30, 2023
@ryannedolan ryannedolan deleted the report-status branch June 30, 2023 16:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants