Color panel should be hidden when the block's color are disabled

[oandregal]

In working at #33280 and preparing #33295 I've realized the color panel doesn't work as expected.

If a theme passes the following data via theme.json:

{
  "version": 1,
  "settings": {
    "color": {
      "custom": false,
      "customGradient": false,
      "gradients": [],
      "link": false,
      "palette": []
  }
}

the result is that the color panel is hidden.

However, let's look at a block such as the paragraph. It supports text, background, and link colors but not gradients. I'd expect that disabling only the things it supports should hide the color panel (notice that there's no customGradient or gradients in the following theme.json):

{
  "version": 1,
  "settings": {
    "color": {
      "custom": false,
      "link": false,
      "palette": []
  }
}

What happens instead is that the color panel is shown empty: