No obvious way to delete an index pattern that matches 0 indices

[eherot]

Kibana version:
7.3.2
Elasticsearch version:
7.3.2
Describe the bug:
If an index pattern exists for an index or indices that have since been deleted, there is no way to delete the index pattern. The reason is that the only "delete" button for index patterns is on the index pattern details page, which will not load if there are no matching indices.
Steps to reproduce:

1. Load Management > Index patterns
2. Click on the index you wish to delete
3. Message pops up saying No indices match pattern "YOUR_INDEX_PATTERN"

Expected behavior:
Either the details page should load even without the indices present OR there should be a delete button on the listing page

Any additional context:
This seems to have come up before (#9224) but I think the page has been redesigned since then and this problem is more related to page design than any kind of underlying logic problem.

[elasticmachine]

Pinging @elastic/kibana-app-arch (Team:AppArch)

[azasypkin]

@elastic/kibana-app-arch I also see another manifestation of the this problem in 7.4 (see gif below, there are no matching indices for win* index pattern):

[peterpramb]

As a workaround (at least in 7.5+):
Management > Saved Objects -> Filter for Index Patterns, select the stale one(s), and Delete.

[mattkime]

This appears to be resolved as of 7.11.

I suspect there's also a variation on the problem where loading the index pattern attempts to refresh the field list but no indices exist. Slightly different causes.

Removing the field cache likely fixed this problem - #82223

[ppisljar]

@mattkime can you close this with a link to the relevant PR ?

[ppisljar]

ping @mattkime