Indexing generate a lot of requests on indexing all

[henning-gerhardt]

I don't know through which change (OS update Debian 9 -> Debian 11, Java 8 to Java 11, ElasticSearch 5.6.x to 7.10.x but I think the ElasticSearch is the trigger) the following issue is triggered:

if you run an indexing all process a lot more requests is send to the ElasticSearch service then before. Before I did make this update and had an indexing all running only 20 to 40 requests per second are send to the ElasticSearch service. After this update 1.600 requests per second are send to the ElasticSearch service! This is lot more then before and as we use an application proxy in front of the ElasticSearch service we had a lot more log entries than before. Big parts of the 1.600 requests per second are request to retrieve the current state of the indexed data. I don't know why this is necessary to retrieve this information so many times per second.

[matthias-ronge]

May be related to issue #4590 (fixed)?

[henning-gerhardt]

No, this is not related to #4590 as this is happening on indexing all data!