Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SortEngine uses too much memory on aarch64 with pagesize=64K #8974

Closed
hicqu opened this issue May 16, 2023 · 2 comments · Fixed by #8982
Closed

SortEngine uses too much memory on aarch64 with pagesize=64K #8974

hicqu opened this issue May 16, 2023 · 2 comments · Fixed by #8982
Labels
affects-5.4 affects-6.1 affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. report/customer Customers have encountered this bug. severity/critical severity/moderate type/bug The issue is confirmed as a bug.

Comments

@hicqu
Copy link
Contributor

hicqu commented May 16, 2023

What did you do?

  1. Create a changefeed and then pause it
  2. Run 20min sysbench insert, to prepare some events
  3. Resume the changefeed

What did you expect to see?

No response

What did you see instead?

图片

  • The root block is about 12GB, but TiCDC uses about 50GB exactly. I guess GC doesn't work fine.

=======================================

图片

  • The red circles indicate default TiCDC configuration;
  • The green circles indicate patched TiCDC configuration without pebble block-cache.

Seems disable pebble block-cache can resolve the problem, although I don't know why.

Versions of the cluster

TiCDC version (execute cdc version):

v6.5.2
@nongfushanquan
Copy link
Contributor

/severity critical

hicqu added a commit to ti-chi-bot/tiflow that referenced this issue May 24, 2023
hicqu added a commit to ti-chi-bot/tiflow that referenced this issue May 24, 2023
ti-chi-bot bot pushed a commit that referenced this issue May 24, 2023
hicqu added a commit to ti-chi-bot/tiflow that referenced this issue May 30, 2023
ref pingcap#8974

Signed-off-by: qupeng <qupeng@pingcap.com>
hicqu added a commit to ti-chi-bot/tiflow that referenced this issue May 30, 2023
ref pingcap#8974

Signed-off-by: qupeng <qupeng@pingcap.com>
@seiya-annie
Copy link

/report customer

@ti-chi-bot ti-chi-bot bot added report/customer Customers have encountered this bug. affects-5.4 affects-6.1 labels Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-5.4 affects-6.1 affects-6.5 affects-7.1 area/ticdc Issues or PRs related to TiCDC. report/customer Customers have encountered this bug. severity/critical severity/moderate type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants