Add control/data plane HPA

[sjberman]

Problem: I want the NGF control plane and nginx data plane to scale automatically based on resource consumption or other metrics.

Solution: Allow for configuring a HorizontalPodAutoscaler (HPA) through the helm chart and NginxProxy resource for both Deployments.

Testing: Verified that the HPA works for both Deployments.

Closes #3447

Checklist

Before creating a PR, run through this checklist and mark each as complete.

• I have read the CONTRIBUTING doc
• I have added tests that prove my fix is effective or that my feature works
• I have checked that all unit tests pass after adding my changes
• I have updated necessary documentation
• I have rebased my branch onto main
• I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes

If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

Add HorizontalPodAutoscaling support for both control plane and data plane deployments.

[codecov]

Codecov Report

❌ Patch coverage is 76.38889% with 34 lines in your changes missing coverage. Please review.
✅ Project coverage is 87.05%. Comparing base (2987d81) to head (3a2f6d8).
⚠️ Report is 1 commits behind head on main.

Files with missing lines	Patch %	Lines
internal/controller/provisioner/objects.go	79.77%	15 Missing and 3 partials ⚠️
internal/controller/provisioner/setter.go	0.00%	9 Missing ⚠️
internal/controller/provisioner/provisioner.go	53.33%	5 Missing and 2 partials ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3702      +/-   ##
==========================================
- Coverage   87.14%   87.05%   -0.09%     
==========================================
  Files         128      128              
  Lines       15779    15919     +140     
  Branches       62       62              
==========================================
+ Hits        13750    13858     +108     
- Misses       1869     1896      +27     
- Partials      160      165       +5     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[salonichf5]

lgtm 🚀

[salonichf5]

👏

[sarthyparty]

Do we need to clean up HPA if the autoscaling is removed from NginxProxy?

[sjberman]

Do we need to clean up HPA if the autoscaling is removed from NginxProxy?

Yeah we should. Gonna need to add logic for that.

[bjee19]

nice 🚀

[ciarams87]

One non-blocking question, otherwise looks great! 🎉