[FEATURE REQUEST] Upgrade Kubernetes to 1.21.x

[atsikham]

Is your feature request related to a problem? Please describe.
Upgrade K8s to 1.21.x to be able to perform future upgrades.

Describe the solution you'd like
Upgrade K8s to 1.21.x with dependencies: CNI plugins, dashboard, etc. Check release notes for that, deprecated things should be removed/updated.

Additional information
The Kubernetes project maintains release branches for the most recent three minor releases (1.22, 1.21, 1.20). Kubernetes 1.19 and newer receive approximately 1 year of patch support. Kubernetes 1.18 and older received approximately 9 months of patch support.

---

DoD checklist

• Changelog updated
• COMPONENTS.md updated / doesn't need to be updated
• Schema updated / doesn't need to be updated
• Feature has automated tests
• Automated tests passed (QA pipelines)
  • apply
  • upgrade
• Idempotency tested
• Documentation added / updated / doesn't need to be updated
• All conversations in PR resolved
• Solution meets requirements and is done according to design doc
• Usage compliant with license
• Backport tasks created / doesn't need to be backported

[przemyslavic]

✔️ apply x86_64, aarch64
✔️ apply HA cluster
✔️ promote to HA
✔️ single machine installation
✔️ upgrade from v1.0 x86_64
✔️ upgrade from v1.1 aarch64
✔️ upgrade from v1.0 single machine installation
✔️ upgrade from v1.0 HA installation