Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Split into multi-service architecture #5766

Open
18 tasks done
rleungx opened this issue Dec 8, 2022 · 2 comments
Open
18 tasks done

Split into multi-service architecture #5766

rleungx opened this issue Dec 8, 2022 · 2 comments
Labels
report/customer Customers have encountered this bug. type/feature-request Categorizes issue or PR as related to a new feature.

Comments

@rleungx
Copy link
Member

rleungx commented Dec 8, 2022

Feature Request

Describe your feature request related problem

Currently, PD has more and more management services. As TiDB clusters are becoming larger and larger, it is increasingly important to ensure the quality of service on the PD. In most large cluster cases, the main bottleneck of PD is CPU resources, and it is difficult to effectively control and isolate the CPU resources of multiple services in the same golang program. Therefore, we need to split these services into individual ones and deploy them independently for management, which is better to control the use and isolation of resources. Also, the microservice architecture is also very suitable for the cloud environment.

Describe the feature you'd like

One of the most important services which PD provided is the TSO service. Deploy it through an independent binary will improve its QoS.

Task

PreWorks

Teachability, Documentation, Adoption, Migration Strategy

@rleungx rleungx added the type/feature-request Categorizes issue or PR as related to a new feature. label Dec 8, 2022
ti-chi-bot pushed a commit that referenced this issue Dec 8, 2022
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot pushed a commit that referenced this issue Dec 8, 2022
ref #5766

*: move all util relative package to utils

Signed-off-by: nolouch <nolouch@gmail.com>
ti-chi-bot added a commit that referenced this issue Dec 12, 2022
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
ti-chi-bot pushed a commit that referenced this issue Dec 13, 2022
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot added a commit that referenced this issue Dec 13, 2022
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
ti-chi-bot added a commit that referenced this issue Dec 13, 2022
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
ti-chi-bot pushed a commit that referenced this issue Dec 14, 2022
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot pushed a commit that referenced this issue Dec 14, 2022
ref #5766

Introduce the service registry:
- Provide a new way to initial external service
- Supports gRPC and HTTP API both

Signed-off-by: nolouch <nolouch@gmail.com>
@nolouch
Copy link
Contributor

nolouch commented Dec 19, 2022

PTAL @rleungx, The region Informer and storage interface maybe high priority, then the service can decoupling rely on the pd.Server.

@nolouch nolouch changed the title Split into microservice architecture Split into multi-service architecture Dec 20, 2022
@rleungx rleungx pinned this issue Jan 4, 2023
ti-chi-bot pushed a commit that referenced this issue Feb 27, 2023
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot added a commit that referenced this issue Mar 6, 2023
ref #5766

Implement the independent resource manager primary election.

Signed-off-by: JmPotato <ghzpotato@gmail.com>

Co-authored-by: Ti Chi Robot <ti-community-prow-bot@tidb.io>
ti-chi-bot bot pushed a commit that referenced this issue Jul 10, 2023
ref #5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>
rleungx added a commit to rleungx/pd that referenced this issue Aug 2, 2023
ref tikv#5766

Signed-off-by: Ryan Leung <rleungx@gmail.com>
ti-chi-bot bot pushed a commit that referenced this issue Aug 31, 2023
ref #5766

Add env `PD_SERVICE_MODE` to manage the service mode.

Signed-off-by: Ryan Leung <rleungx@gmail.com>

Co-authored-by: Ryan Leung <rleungx@gmail.com>
@rleungx rleungx unpinned this issue Oct 19, 2023
@seiya-annie
Copy link

/found customer

@ti-chi-bot ti-chi-bot bot added the report/customer Customers have encountered this bug. label Jun 4, 2024
ti-chi-bot bot added a commit that referenced this issue Aug 13, 2024
ref #5766, close #7995

Signed-off-by: husharp <ihusharp@gmail.com>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
report/customer Customers have encountered this bug. type/feature-request Categorizes issue or PR as related to a new feature.
Projects
None yet
Development

No branches or pull requests

3 participants