Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve management of gRPC channels #782

Merged
merged 8 commits into from
Nov 2, 2021
Merged

Improve management of gRPC channels #782

merged 8 commits into from
Nov 2, 2021

Conversation

JcolemanNR
Copy link
Contributor

@JcolemanNR JcolemanNR commented Nov 1, 2021

Description

Resolves #780

A recent certificate expiration event exposed a defect where unmanaged gRPC channels can cause an increase in TCP connection requests. This PR corrects the connection management issues and allows for proper backoff during failure events.

BEFORE FIX - TCP connection attempts for 50 agents during a certificate event:
image

WITH FIX - TCP connection attempts for 50 agents during a certificate event:
image

Author Checklist

Reviewer Checklist

  • Perform code review
  • Pull request was adequately tested (new/existing tests, performance tests)
  • Review Changelog

@JcolemanNR JcolemanNR added the bug Something isn't working label Nov 2, 2021
@vuqtran88 vuqtran88 self-requested a review November 2, 2021 18:44
Copy link
Contributor

@vuqtran88 vuqtran88 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Copy link
Contributor Author

@JcolemanNR JcolemanNR left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shipping it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Infinite Tracing gRPC channels continue failed connection attempts despite backoff logic
3 participants