Milestone 3 Proposal

Problem Statement :

As we delved deeper into the functionality of the apache-mft architecture , we quickly understood that it can be extended to a multitude of other file sharing services. As of now , apache-mft supports only SCP communication , we would like to expand its support to cloud storage services.

Implementation :

Step 1 :

• In depth understanding of the APIs and underlying technology behind different cloud storage platforms.
• Setting up MFT on the local machine and understand its implementation and its working.

Step 2 :

• Choosing the cloud platform with a good support for streaming input-output data.
• Create a custom python API client that can expose the MFT server, for further implementation extension.

Step 3 :

• Create a working version of the file transfer using the current configuration of the secret service.
• Thoroughly test our implementation.
• Deploy our working setup on kubernetes.

Step 4 :

• If time permits, we would like to replace the current configuration of the secret service to work with the custos api.

Technologies to be Utilized :

• python
• java
• google drive api

Thread for discussion :

• https://github.com/airavata-courses/SquirtleSquad/wiki/Milestone-3-Proposal