You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PR #191 added support to store multiple entities in notification messages---btw, kudos to @ohylli. But we still need to think about how to handle:
Partial errors. What to do if we encounter an error for some of the entities in the batch? e.g. what if 2 out of 20 entities fail validation? should we reject the whole batch (probably not a good idea!) or try saving the 18 that passed validation? What would the HTTP response look like in this case? How do we accumulate errors?
Message size. What to do with large batches---e.g. 100s of entities? Ideally we should process them in constant space to avoid eating up all available RAM. This applies both to the received HTTP message and the DB call we issue.
For now this is just a reminder that at some point in time we'll have to consider the points above. Also, we should probably split (1) and (2) in two separate PRs.
Initial thoughts about a possible way to implement
Leverage monoids/monads/monoidal functors as suggested on stackoverflow
Use stream processing techniques to process a batch of batches of configurable size.
The text was updated successfully, but these errors were encountered:
PR #191 added support to store multiple entities in notification messages---btw, kudos to @ohylli. But we still need to think about how to handle:
For now this is just a reminder that at some point in time we'll have to consider the points above. Also, we should probably split (1) and (2) in two separate PRs.
Initial thoughts about a possible way to implement
The text was updated successfully, but these errors were encountered: