Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docdb] Memory usage optimizations #10244

Closed
bmatican opened this issue Oct 8, 2021 · 0 comments
Closed

[docdb] Memory usage optimizations #10244

bmatican opened this issue Oct 8, 2021 · 0 comments
Assignees
Labels
area/docdb YugabyteDB core features kind/bug This issue is a bug priority/medium Medium priority issue roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list.

Comments

@bmatican
Copy link
Contributor

bmatican commented Oct 8, 2021

Jira Link: DB-1213
Currently, there are a couple of scenarios during which YB runs into various memory issues. These can manifest as

  • OOM -- when to cumulative amount of memory on a server goes too high
  • soft memory limit RPC rejections -- when an individual master/tserver runs into heap allocation issues with tcmalloc

Stage 1 (improved cheap defaults)

✅ Reduce master memstore memory usage (#10242)
✅ Fix network buffer percentage calculation (#10207)
✅ Make global log cache use a percentage of total (#3745)

Stage 2 (better management of tcmalloc internals)

✅ Periodically clear tcmalloc internals (#10243)
✅ Reduce master memory pressure due to tcmalloc free bytes (#11406)
✅ Reduce master memory pressure due to tcmalloc thread cache (#11398)

Stage 3 (OOM prevention)

✅ Make OOM prioritize PG backends (#8494)

Stage 4 (new memory management mechanics)

⬜️ Connect YSQL with the TS MemTracker framework (#10284)

@bmatican bmatican added the area/docdb YugabyteDB core features label Oct 8, 2021
@bmatican bmatican self-assigned this Oct 8, 2021
@bmatican bmatican changed the title [docdb] Master memory usage optimizations [docdb] Memory usage optimizations Nov 5, 2021
@bmatican bmatican added the roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list. label Feb 12, 2022
@yugabyte-ci yugabyte-ci added kind/bug This issue is a bug priority/medium Medium priority issue labels Jun 8, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/docdb YugabyteDB core features kind/bug This issue is a bug priority/medium Medium priority issue roadmap-tracking-issue This issue tracks a major roadmap item, and usually appears in the roadmap list.
Projects
None yet
Development

No branches or pull requests

2 participants