Reindexing takes nearly forever

[iwemuiser]

We have a database with 56.000 items, which takes a few days to index at the moment.
When we make a dump of our database, this takes about 10 minutes, and indexing that dump takes about 15 minutes.
I suspect that every time item is added to the solr core, the whole lot gets reindexed or something. Might that be true? Is it an idea to add documents per 1000? or 5000?

[iwemuiser]

I tried version 2.0.0-rc2. It looks a lot better and all connections and settings seem to work properly.
Still though, indexing takes a lot of time. I tried to index a 16.000 items version of our database and it took about 6 hours. Is this supposed to take this long?

[davidmcclure]

(Eh, I somehow managed to accidentally delete my previous comment while trying to fix a typo - sorry for the double email notification, @iwemuiser.)

Hm, that is indeed ridiculously slow. I just spun up a test site with a few thousand items, and it was indexing in just a few seconds - nothing like minutes or days! I wonder if there could be something in your Solr configuration that's choking things up.

Are you using the most current version of the template Solr core that ships with the plugin? If not, try swapping that in, and see if that speeds things up.

https://github.com/scholarslab/SolrSearch/tree/master/solr-core/omeka

Best,
David