Include an option to immediately submit OpenAI requests instead of scheduling them

[S0ulf3re]

Describe the feature you'd like to request

For requests sent to OpenAI's servers, the nextcloud assistant waits until cron is ran. This is understandable for larger scale servers. But isn't as useful on smaller servers where nowhere near as many requests will be made. The nextcloud assistant should have an administration option to immediately send a request instead of waiting around for cron to run.

Describe the solution you'd like

There should be an option in the assistant settings to make it so that requests to OpenAI are immediately sent to their servers instead. As opposed to scheduling them.

Describe alternatives you've considered

There is technically the ChatGPT extension that can be used from the smart picker. But often, I forget it's there, and I like having a button that I can click on to process editing.

[zydisney]

Agree! The significant delay of response is really a bad experience. Immediately reply in the pop-up window would be more efficient.

[theCalcaholic]

I don't think, this should be tied to external APIs - a better job scheduler that allows for immediate execution if there are no jobs in queue would make this feature much more useful.

[dhx]

This Issue might be relevant again for users after migrating to the upcoming Nextcloud 30 release considering the migration to task processing: #114
Running the OC\TaskProcessing\SynchronousBackgroundJob background job worker is recommended in the admin manual to avoid having to wait for the next cronjob run:
https://docs.nextcloud.com/server/latest/admin_manual/ai/app_assistant.html#improve-ai-processing-throughput