You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When importing data into DART from files instead of streaming, decommutation can become many minutes out of order when spread across processes. This isn't inherently wrong, but can cause reduction to think that data is ready to be reduced when it is not all available yet. This change will modify:
Make reduction have a 2 minute holdoff to ensure all data is available
Change decom to a work queue design to ensure that packets do not get multiple minutes out of processing order
Improve decommutation speed using transactions
Don't try to switch to bad configs multiple times
The text was updated successfully, but these errors were encountered:
ghost
pushed a commit
that referenced
this issue
Nov 22, 2019
When importing data into DART from files instead of streaming, decommutation can become many minutes out of order when spread across processes. This isn't inherently wrong, but can cause reduction to think that data is ready to be reduced when it is not all available yet. This change will modify:
The text was updated successfully, but these errors were encountered: