-
Notifications
You must be signed in to change notification settings - Fork 721
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enhance heartbeat processing capabilities #7897
Labels
type/development
The issue belongs to a development tasks
Comments
This was referenced Apr 3, 2024
ti-chi-bot bot
added a commit
that referenced
this issue
Apr 8, 2024
ref #7897 pkg/schedule: optimize the lock usage of the operator controller - use sync.Map for operators, which is friendly for check operators on the heartbeat hot path - reduce the lock hold time by splitting the locks. Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
added a commit
that referenced
this issue
Apr 9, 2024
ref #7897 pkg/ratelimit: Introduce an executor that can run with a limiter - async runner can run the task with the limiter, the task will parallel run. - sync runner used to keep the behavior like before Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
This was referenced Apr 10, 2024
ti-chi-bot bot
pushed a commit
that referenced
this issue
Apr 15, 2024
ref #7897 *: Optimize the heartbeat process with the concurrent runner - add a switch about the runner - move some tasks out, not block the heartbeat process Signed-off-by: nolouch <nolouch@gmail.com>
Merged
ti-chi-bot bot
added a commit
that referenced
this issue
Apr 24, 2024
ref #7897 Optimize heartbeat process - Split the statics updates on the subtree Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
nolouch
added a commit
to nolouch/pd
that referenced
this issue
Apr 29, 2024
) ref tikv#7897 Optimize heartbeat process - Split the statics updates on the subtree Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
added a commit
that referenced
this issue
Apr 30, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
added a commit
that referenced
this issue
May 7, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
pushed a commit
that referenced
this issue
May 10, 2024
ref #7897 Signed-off-by: nolouch <nolouch@gmail.com>
This was referenced May 10, 2024
ti-chi-bot bot
added a commit
that referenced
this issue
May 13, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
Merged
ti-chi-bot bot
added a commit
that referenced
this issue
May 17, 2024
…#8185) ref #7897, close #8136 Previously, removing overlapped regions in subtrees required finding overlaps for each subtree individually. This PR introduces a separate tree specifically for checking overlaps in the subtrees, thereby reducing lookup times and improving performance. Signed-off-by: JmPotato <ghzpotato@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com> Co-authored-by: Hu# <jinhao.hu@pingcap.com>
ti-chi-bot bot
pushed a commit
that referenced
this issue
May 18, 2024
ref #7897 core/region: fix the sub tree may not consist of root tree Signed-off-by: nolouch <nolouch@gmail.com>
ti-chi-bot bot
pushed a commit
that referenced
this issue
May 21, 2024
…che reset (#8201) ref #7897 #8132 introduced a count reference to ensure the consistency between the root tree and subtrees, however, the reference count was not handled correctly during the cache reset process, which may lead to incorrect reference counts in later heartbeat processing. Signed-off-by: JmPotato <ghzpotato@gmail.com>
ti-chi-bot bot
pushed a commit
that referenced
this issue
May 21, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot bot
pushed a commit
that referenced
this issue
May 21, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot bot
added a commit
that referenced
this issue
May 22, 2024
ref #7897 Optimize the efficiency of random regions selecting. Signed-off-by: JmPotato <ghzpotato@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
added a commit
that referenced
this issue
May 23, 2024
ref #7897 metrics: fix the duplicate avg metrics Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
okJiang
pushed a commit
to okJiang/pd
that referenced
this issue
May 23, 2024
ref tikv#7897 metrics: fix the duplicate avg metrics Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com> Signed-off-by: okJiang <819421878@qq.com>
okJiang
pushed a commit
to okJiang/pd
that referenced
this issue
May 23, 2024
ref tikv#7897 metrics: fix the duplicate avg metrics Signed-off-by: nolouch <nolouch@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com> Signed-off-by: okJiang <819421878@qq.com>
ti-chi-bot bot
added a commit
that referenced
this issue
May 28, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
added a commit
that referenced
this issue
May 28, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
This was referenced May 31, 2024
ti-chi-bot bot
added a commit
that referenced
this issue
Jun 13, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot
added a commit
that referenced
this issue
Jun 13, 2024
ref #7897 Signed-off-by: Ryan Leung <rleungx@gmail.com> Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Development Task
Sigle node processing capacity
Improve the diagnosis process and implement hierarchical processing for Heartbeat logic
Optimize Lock and Reduce lock holding time
Improve the memory alloc
Scalability
The text was updated successfully, but these errors were encountered: