-
Notifications
You must be signed in to change notification settings - Fork 2.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: add jcloud executor availability parameters #5624
Conversation
docs/concepts/jcloud/yaml-spec.md
Outdated
|
||
In case of any unlikely event that would cause the service disruption of executors, JCloud allows users to specify a tolerance level in terms of number of replicas. | ||
|
||
The JCloud parameters minAvailable and maxUnavailable ensures the absense of some replicas of an executor to be with in the limits of toleration. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The JCloud parameters minAvailable and maxUnavailable ensures the absense of some replicas of an executor to be with in the limits of toleration. | |
The JCloud parameters `minAvailable` and `maxUnavailable` ensure that Executors will stay up even if a certain number of replicas go down. |
Please spell-check in future :)
I did quite a significant rewrite. Is it still accurate?
docs/concepts/jcloud/yaml-spec.md
Outdated
| minAvailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the minimum number of replicas available during the disruption | | ||
| maxUnavailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the maximum number of replicas unavailable during the disruption | |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
| minAvailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the minimum number of replicas available during the disruption | | |
| maxUnavailable | NA | lesser than [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | the maximum number of replicas unavailable during the disruption | | |
| `minAvailable` | N/A | Lower than number of [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | Minimum number of replicas available during disruption | | |
| `maxUnavailable` | N/A | Lower than numbers of [replicas](https://docs.jina.ai/concepts/flow/scale-out/#scale-out) | Maximum number of replicas unavailable during disruption | |
docs/concepts/jcloud/yaml-spec.md
Outdated
jcloud: | ||
minAvailable: 2 | ||
``` | ||
> In case of unlike disruption, it is ensured that at least 2 replicas would still be available. 3 replicas may be unavailable. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
> In case of unlike disruption, it is ensured that at least 2 replicas would still be available. 3 replicas may be unavailable. | |
> In case of unlike disruption, ensure at least two replicas will still be available, while 3 may be down. |
- What does 'unlike' mean? unlikely?
docs/concepts/jcloud/yaml-spec.md
Outdated
jcloud: | ||
maxUnavailable: 2 | ||
``` | ||
> In case of unlike disruption, it is ensured that at maximum 2 replicas would not be available. At least 3 replicas would still be available. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
> In case of unlike disruption, it is ensured that at maximum 2 replicas would not be available. At least 3 replicas would still be available. | |
> In case of unlike disruption, ensure that if a maximum of 2 replicas are down, at least 3 replicas will still be available. |
Again, unlike means...?
docs/concepts/jcloud/yaml-spec.md
Outdated
> In case of unlike disruption, it is ensured that at maximum 2 replicas would not be available. At least 3 replicas would still be available. | ||
|
||
|
||
|
||
|
||
## Configure gateway |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
## Configure gateway | |
## Configure Gateway |
docs/concepts/jcloud/yaml-spec.md
Outdated
@@ -250,6 +250,45 @@ Below are the defaults and requirements for the configurations: | |||
|
|||
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code! | |||
|
|||
## Configure Availability Tolerance | |||
|
|||
In case of any unlikely event that would cause the service disruption of executors, JCloud allows users to specify a tolerance level in terms of number of replicas. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In case of any unlikely event that would cause the service disruption of executors, JCloud allows users to specify a tolerance level in terms of number of replicas. | |
If service issues cause disruption of Executors, JCloud lets you specify a tolerance level for number of replicas that stay up or go down. |
@subbuv26 what's status on this? |
Sorry for the delay, addressed review comment, please review again. thanks. |
docs/concepts/jcloud/yaml-spec.md
Outdated
jcloud: | ||
minAvailable: 2 | ||
``` | ||
> In case of unlike disruption, ensure at least two replicas will still be available, while 3 may be down. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
> In case of unlike disruption, ensure at least two replicas will still be available, while 3 may be down. | |
> In case of disruption, ensure at least two replicas will still be available, while three may be down. |
docs/concepts/jcloud/yaml-spec.md
Outdated
jcloud: | ||
maxUnavailable: 2 | ||
``` | ||
> In case of unlike disruption, ensure that if a maximum of 2 replicas are down, at least 3 replicas will still be available. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
> In case of unlike disruption, ensure that if a maximum of 2 replicas are down, at least 3 replicas will still be available. | |
> In case of disruption, ensure that if a maximum of two replicas are down, at least three replicas will still be available. |
docs/concepts/jcloud/yaml-spec.md
Outdated
@@ -250,8 +250,45 @@ Below are the defaults and requirements for the configurations: | |||
|
|||
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code! | |||
|
|||
## Configure Availability Tolerance |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
## Configure Availability Tolerance | |
## Configure availability tolerance |
docs/concepts/jcloud/yaml-spec.md
Outdated
@@ -250,8 +250,45 @@ Below are the defaults and requirements for the configurations: | |||
|
|||
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same; the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you should only worry about the code! | |
After JCloud deployment using the autoscaling configuration, the Flow serving part is just the same: the only difference you may notice is it takes a few extra seconds to handle the initial requests since it needs to scale the deployments behind the scenes. Let JCloud handle the scaling from now on, and you can deal with the code! |
docs/concepts/jcloud/yaml-spec.md
Outdated
--- | ||
jtype: Flow | ||
executors: | ||
- uses: jinahub+docker://Sentencizer |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should this be jinaai://...
?
docs/concepts/jcloud/yaml-spec.md
Outdated
|
||
```{code-block} yaml | ||
--- | ||
emphasize-lines: 5-6 | ||
--- | ||
jtype: Flow | ||
executors: | ||
- uses: jinahub+docker://Sentencizer | ||
- uses: jinaai+docker://Sentencizer |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
📝 Docs are deployed on https://jcloud_docs--jina-docs.netlify.app 🎉 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 👍
Goals: