Bottleneck on RPC thread

[ederenn]

Description

Golem Version: 0.21.0

Golem-Messages version (leave empty if unsure): 3.11.0

Electron version (if used): 0.2.3

OS [e.g. Windows 10 Pro]:Any

Branch (if launched from source): -

Mainnet/Testnet: mainnet

Priority label is set to the lowest by default. To setup higher priority please change the label
P0 label is set for Severity-Critical/Effort-easy
P1 label is set for Severity-Critical/Effort-hard
P2 label is set for Severity-Low/ Effort-easy
P3 label is set for Severity-Low/Effort-hard

Description of the issue:

During computations some of a longer tasks 40-60 subtasks Golem seems to have problems fetching informations from all RPCs.

Actual result:

Informations in interface are not refreshing, Golem is not displaying subtasks information, duration time is stuck, it seems also like number of nodes is dropping. In logs repeats information:

2019-10-14 14:43:39 INFO     golem.task.tasksession              Received offer to compute. task_id='b4337cf6-ee7e-11e9-96ed-5ad86f3605c2', node='611f591f..29d15fad'
2019-10-14 14:43:39 WARNING  golem.rpc.session                   RPC: Cannot publish 'evt.comp.task.status', session is not yet established
2019-10-14 14:43:39 INFO     golem.task.taskrequestorstats       Received work offers: 49
2019-10-14 14:43:39 INFO     golem.task.taskserver               provider 611f591f516c46ddd1e2c647adc91c048981abca175a9ad67057c0c8e77ecd76e95a688331241bd81c5807f7ecff415796daafa58d6db54d3a5f0c3b29d15fad is not allowed for this task at this moment (either waiting for results or previously failed)
2019-10-14 14:43:39 WARNING  golem.rpc.session                   RPC: Cannot publish 'evt.comp.task.prov_rejected', session is not yet established

Screenshots:

Steps To Reproduce

Short description of steps to reproduce the behavior:
e.g.

1. Launch the Golem
2. Start a task at least with 40 subtasks. In This case, DiscBoyBlender, resolution and samples from file, frames 40-64, 50 subtasks , 2h for a task, 20 min for subtask, bid 0.1
3. Open console for electron - toggle developer tools in Golem view menu, watch for errors.
4. In interface when checking details of subtasks there will be displayed Fetching subtasks information
5. Check logs for RPC: Cannot publish 'evt.comp.task.prov_rejected', session is not yet established

Logs and any additional context

from electron console window:

main.bundle.js:1 SAGA > HANDLER Fetch net.peers.connected failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch pay.balance failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch pay.balance failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.task.rendering.task_fragments failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks.stats failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks.unsupport failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch net.peers.known failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch pay.balance failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.task.subtasks failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch pay.balance failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks failed! wamp.error.canceled {} callee disconnected from in-flight request
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.task.rendering.task_fragments failed! wamp.error.no_such_procedure {} no callee registered for procedure <comp.task.rendering.task_fragments>
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks.stats failed! wamp.error.no_such_procedure {} no callee registered for procedure <comp.tasks.stats>
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch comp.tasks.unsupport failed! wamp.error.no_such_procedure {} no callee registered for procedure <comp.tasks.unsupport>
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch net.peers.known failed! wamp.error.no_such_procedure {} no callee registered for procedure <net.peers.known>
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1 SAGA > HANDLER Fetch pay.balance failed! wamp.error.no_such_procedure {} no callee registered for procedure <pay.balance>
m @ main.bundle.js:1
(anonymous) @ main.bundle.js:95
o @ main.bundle.js:27
(anonymous) @ main.bundle.js:27
c @ main.bundle.js:57
_tickCallback @ internal/process/next_tick.js:61
main.bundle.js:1

Proposed Solution?

(Optional: What could be a solution for that issue)