Shared AWS SDK for Go v2 Retryer leading to increased QuotaExceededException API throttling errors

[ewbankkit]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or other comments that do not add relevant new information or questions, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

The AWS SDK for Go v2 SDK retryer uses a token bucket for retrying throttling errors.
The documentation for the aws.Config.Retryer field (a function that returns a Retryer interface implementation) recommends:

	// In general, the provider function should return a new instance of a
	// Retryer if you are attempting to provide a consistent Retryer
	// configuration across all clients. This will ensure that each client will
	// be provided a new instance of the Retryer implementation, and will avoid
	// issues such as sharing the same retry token bucket across services.

Currently this module configures aws.Config.Retryer to return a wrapper on top of a shared base implementation. This means that the token bucket is shared between ALL service clients.
With large Terraform configurations this can lead to an increased frequency of QuotaExceededException API throttling errors.

Relates hashicorp/terraform-provider-aws#34669.