Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add jcloud executor availability parameters #5624

Merged
merged 3 commits into from
Feb 1, 2023
Merged

Conversation

subbuv26
Copy link
Contributor

Goals:

  • add documentation for jcloud executor availability

@github-actions github-actions bot added size/S area/docs This issue/PR affects the docs labels Jan 25, 2023

In case of any unlikely event that would cause the service disruption of executors, JCloud allows users to specify a tolerance level in terms of number of replicas.

The JCloud parameters minAvailable and maxUnavailable ensures the absense of some replicas of an executor to be with in the limits of toleration.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The JCloud parameters minAvailable and maxUnavailable ensures the absense of some replicas of an executor to be with in the limits of toleration.
The JCloud parameters `minAvailable` and `maxUnavailable` ensure that Executors will stay up even if a certain number of replicas go down.

Please spell-check in future :)

I did quite a significant rewrite. Is it still accurate?

Comment on lines 261 to 262
| minAvailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the minimum number of replicas available during the disruption |
| maxUnavailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the maximum number of replicas unavailable during the disruption |
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
| minAvailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the minimum number of replicas available during the disruption |
| maxUnavailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the maximum number of replicas unavailable during the disruption |
| `minAvailable` | N/A | Lower than number of [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | Minimum number of replicas available during disruption |
| `maxUnavailable` | N/A | Lower than numbers of [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | Maximum number of replicas unavailable during disruption |

jcloud:
minAvailable: 2
```
> In case of unlike disruption, it is ensured that at least 2 replicas would still be available. 3 replicas may be unavailable.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> In case of unlike disruption, it is ensured that at least 2 replicas would still be available. 3 replicas may be unavailable.
> In case of unlike disruption, ensure at least two replicas will still be available, while 3 may be down.
  • What does 'unlike' mean? unlikely?

jcloud:
maxUnavailable: 2
```
> In case of unlike disruption, it is ensured that at maximum 2 replicas would not be available. At least 3 replicas would still be available.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> In case of unlike disruption, it is ensured that at maximum 2 replicas would not be available. At least 3 replicas would still be available.
> In case of unlike disruption, ensure that if a maximum of 2 replicas are down, at least 3 replicas will still be available.

Again, unlike means...?

> In case of unlike disruption, it is ensured that at maximum 2 replicas would not be available. At least 3 replicas would still be available.




## Configure gateway
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Configure gateway
## Configure Gateway

@@ -250,6 +250,45 @@ Below are the defaults and requirements for the configurations:

After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code!

## Configure Availability Tolerance

In case of any unlikely event that would cause the service disruption of executors, JCloud allows users to specify a tolerance level in terms of number of replicas.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
In case of any unlikely event that would cause the service disruption of executors, JCloud allows users to specify a tolerance level in terms of number of replicas.
If service issues cause disruption of Executors, JCloud lets you specify a tolerance level for number of replicas that stay up or go down.

@alexcg1
Copy link
Member

alexcg1 commented Jan 27, 2023

@subbuv26 what's status on this?

@subbuv26
Copy link
Contributor Author

@subbuv26 what's status on this?

Sorry for the delay, addressed review comment, please review again. thanks.

@JoanFM JoanFM requested a review from alexcg1 January 31, 2023 07:32
jcloud:
minAvailable: 2
```
> In case of unlike disruption, ensure at least two replicas will still be available, while 3 may be down.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> In case of unlike disruption, ensure at least two replicas will still be available, while 3 may be down.
> In case of disruption, ensure at least two replicas will still be available, while three may be down.

jcloud:
maxUnavailable: 2
```
> In case of unlike disruption, ensure that if a maximum of 2 replicas are down, at least 3 replicas will still be available.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> In case of unlike disruption, ensure that if a maximum of 2 replicas are down, at least 3 replicas will still be available.
> In case of disruption, ensure that if a maximum of two replicas are down, at least three replicas will still be available.

@@ -250,8 +250,45 @@ Below are the defaults and requirements for the configurations:

After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code!

## Configure Availability Tolerance
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Configure Availability Tolerance
## Configure availability tolerance

@@ -250,8 +250,45 @@ Below are the defaults and requirements for the configurations:

After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code!
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code!
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same: the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you can deal with the code!

---
jtype: Flow
executors:
- uses: jinahub+docker://Sentencizer
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should this be jinaai://...?


```{code-block} yaml
---
emphasize-lines: 5-6
---
jtype: Flow
executors:
- uses: jinahub+docker://Sentencizer
- uses: jinaai+docker://Sentencizer
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this missing the username portion?
image

https://cloud.jina.ai/executor/c6focg47

@github-actions
Copy link

github-actions bot commented Feb 1, 2023

📝 Docs are deployed on https://jcloud_docs--jina-docs.netlify.app 🎉

@JoanFM JoanFM requested review from alexcg1 February 1, 2023 15:34
Copy link
Member

@alexcg1 alexcg1 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@JoanFM JoanFM changed the title doc: add jcloud executor availability parameters docs: add jcloud executor availability parameters Feb 1, 2023
@JoanFM JoanFM merged commit 06c84c6 into master Feb 1, 2023
@JoanFM JoanFM deleted the jcloud_docs branch February 1, 2023 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docs This issue/PR affects the docs size/S
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants