Edit data interface slow with large amount of terms

[andreesg]

With a large amount of terms (5000 tested) the edit data interface (@@taxonomy-edit-data) takes a long time to load. (up to 30 seconds)

Details:

• The response from the server is fast (200ms)
• The time to completely load the DOM takes up to 30 seconds.

The rendering seems to be the bottleneck.
Any ideas on what is causing the problem or how to improve the rendering?

[vincentfretin]

We didn't test with such long taxonomies. Can you send me your taxonomy so we can test it and see what optimizations we can do? If you don't want it to be public, you can send it to vincent dot fretin at gmail dot com.

[vincentfretin]

@andreesg ?

[andreesg]

Thanks @vincentfretin !
I will send you an email still today with the 5k+ terms taxonomy.

Really curious to hear if it is possible to optimise the interface speed. Please let me know if you need my help.

[tomgross]

We have taxonomies with large amounts of items to and found the bottleneck the construction of the vocabulary. The translation is not cached. There are two positions where this is relevant:

• The taxonomy widget itself -> we cache this for one day which is probably not ok for everyone: https://github.com/collective/collective.taxonomy/compare/tomgross-memoize_voc
• The querywidget for collections and contentlisting tiles -> we use a customized version of the qsOptions-View from plone.app.content where we cache all the output.

[tomgross]

from Products.Five import BrowserView
from plone.app.querystring.interfaces import IQuerystringRegistryReader
from plone.memoize import ram
from plone.registry.interfaces import IRegistry
from time import time
from zope.component import getUtility
import json


ONE_DAY = 60 * 60 * 24


class PatchedQueryStringIndexOptions(BrowserView):

    @ram.cache(lambda *args: time() // ONE_DAY)
    def get_config(self):
        registry = getUtility(IRegistry)
        config = IQuerystringRegistryReader(registry)()
        return json.dumps(config)

    def __call__(self):
        self.request.response.setHeader(
            'Content-Type', 'application/json; charset=utf-8'
        )
        return self.get_config()