TiCDC: add information about Unified Sorter #4959
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
TomShawn
added
needs-cherry-pick-4.0
size/medium
TomShawn
reviewed
Nov 25, 2020
|
@TomShawn, @amyangfei, PTAL. |
1 similar comment
|
@TomShawn, @amyangfei, PTAL. |
TomShawn
reviewed
Dec 1, 2020
|
LGTM |
ti-srebot
added
status/LGT2
ti-srebot
approved these changes
Dec 1, 2020
TomShawn
added
status/DNM
and removed
status/PTAL
|
@TomShawn, @amyangfei, @ti-srebot, PTAL. |
TomShawn
reviewed
Dec 4, 2020
ticdc/troubleshoot-ticdc.md
Outdated
| > + 目前文件排序功能的处理能力有限。如果单表数据量过多导致文件排序失败，可以修改 TiCDC 任务配置过滤掉这张表，通过其他备份恢复工具例如 BR 恢复这张表之后再继续同步该表。 | ||
| > + TiCDC 从 4.0.9 版本起支持 Unified Sorter 排序引擎。 | ||
| > + TiCDC（4.0 发布版本）还不支持动态修改排序引擎。 | ||
| > + 目前 Unified Sorter 排序引擎为实验特性，在数据表较多 (>= 100) 时可能出现性能问题，影响同步速度，故不建议在生产环境中长期使用。开启 Unified Sorter 前请保证各 TiCDC 节点机器上有足够硬盘空间。如果积攒的数据总量有可能超过 1 TB，则不建议使用 TiCDC 进行同步。 |
There was a problem hiding this comment.
"不建议在生产环境中长期使用" 表示 "可以在生产环境中短期使用" 吗？
TomShawn
added
translation/done
9 tasks
|
@TomShawn, @amyangfei, @ti-srebot, PTAL. |
|
@TomShawn, @amyangfei, @ti-srebot, PTAL. |
1 similar comment
|
@TomShawn, @amyangfei, @ti-srebot, PTAL. |
TomShawn
reviewed
Dec 14, 2020
TomShawn
reviewed
Dec 14, 2020
Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com>
overvenus
reviewed
Dec 15, 2020
ticdc/troubleshoot-ticdc.md
Outdated
|
|
||
| {{< copyable "shell-regular" >}} | ||
|
|
||
| ```shell | ||
| cdc cli changefeed create --pd=http://10.0.10.25:2379 --start-ts=415238226621235200 --sink-uri="mysql://root:123456@127.0.0.1:3306/" --sort-engine="file" --sort-dir="/data/cdc/sort" | ||
| cdc cli changefeed create --pd=http://10.0.10.25:2379 --start-ts=415238226621235200 --sink-uri="mysql://root:123456@127.0.0.1:3306/" --sort-engine="unified" --sort-dir="/data/cdc/sort" |
There was a problem hiding this comment.
Why not cdc cli changefeed update? So we need to make sure using the right start ts when creating a new changefeed.
|
@amyangfei, @ti-srebot, PTAL. |
|
@amyangfei, PTAL. |
ti-srebot
pushed a commit
to ti-srebot/docs-cn
that referenced
this pull request
Dec 21, 2020
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
9 tasks
|
cherry pick to release-4.0 in PR #5138 |
TomShawn
added a commit
that referenced
this pull request
Dec 21, 2020
Signed-off-by: ti-srebot <ti-srebot@pingcap.com> Co-authored-by: Zixiong Liu <liuzixiong@pingcap.com> Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com>
9 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What is changed, added or deleted? (Required)
--sort-engineparameter of a TiCDC changefeed.Which TiDB version(s) do your changes apply to? (Required)
What is the related PR or file link(s)?
Do your changes match any of the following descriptions?