Bulk Transfers: Implement bulk-fulfil handler

[elnyry-sam-k]

Goal:

As a Hub Operator
I want to implement the /bulkTransfers end-point
so that I can support the bulk Transfers use-case (based on the API Definition).

This specific story is for implementing the newly proposed bulk-fulfil handler

Tasks:

• Implement bulk-fulfil handler
  • move ml-api Object Store code to common library to be accessed by bulk-api, ml-api and cl-api [@ggrg, @mdebarros]
    • fix issue with unit tests [@mdebarros]
  • import/implement the library into central-ledger [@ggrg] 5548cab, 2455a0a, 4269d48
  • bulk-fulfil handler [@ggrg]
    • prepare postman PUT requests for complete and erroneous bulk [@ggrg]
    • add bulk-api related code [@ggrg]
      • define BulkTransfersIDPutResponse in swagger.yaml [@ggrg]
      • implement BulkTransfersByIDPut operation [@ggrg] 940eb56, 5f79bf1, 176d653
        • add kafka producer config
        • store to MLOS and produce to kafka
    • implement BulkFulfilHandler code [@ggrg]
      • init BulkFulfilHandler using BulkPrepareHandler implementation
      • Update Enums if needed
      • Duplicate analysis
        • Handle Resend (GET callback / ignore)
        • Handle Modified Request (callback notification to payerFsp)
        • Handle invalid fulfilment to abort individual transfers
        • Allow only first request from payeee per bulkTransfer UUID
      • Bulk transfer validations
        • validateFspiopSourceMatchesPayee
        • validateFspiopDestinationMatchesPayer ?
      • Handle validation errors
        • Store invalid bulk transfer fulfil request to database
        • Produce callback notification to payeeFsp
        • Abort individual transfers or entire bulk
      • Store PROCESSING bulk to database
      • Transform and stream individual transfer results to topic-transfer-fulfil
    • Configure topic-bulk-fulfil consumer
    • Utilize the bulkTransfer message hash, generated and passed by ml-api-adapter
    • Verify golden path for BulkFulfilHandler and all db writes
    • Sequence diagrams and markdown files updated if issues identified during implementation
      • Add notes for differencies not applied to SDs
    • Unit tests corrections
    • JSDoc notes

6a54300, 21e8518

Acceptance Criteria:

• bulk-fulfil handler is implemented and has automated tests

Pull Requests:

• Feature/746-748-747 Implement Bulk Transfer Fulfil central-ledger#290
• Feature/746 748 747 implement bulk transfer fulfil central-ledger#296
• Feature/746-748-747 Implement Bulk Transfer Fulfil ml-api-adapter#118
• feature/Implement Bulk Transfer Fulfil object-store-lib#1
• Filter out extensionLists when extension element is an empty array object-store-lib#2

Follow-up:

• TBD

Dependencies:

• Bulk Transfers: Review initial DB design, Draft values for actions, types in messages for bulk #744
• Bulk Transfers: Implement bulk-prepare handler #745
• Resolution regarding whether bulk related code needs a new repo or if existing central-ledger repo is to be used
• Resolution regarding release strategy (use snapshots, separate branch till implementation on all handlers related to bulk is complete)

Accountability:

• Owner:
• QA/Review: DA