Skip to content
This repository has been archived by the owner on Jun 23, 2022. It is now read-only.

feat(bulk-load): meta server start bulk load #454

Merged
merged 10 commits into from
May 9, 2020

Conversation

hycdong
Copy link
Contributor

@hycdong hycdong commented May 6, 2020

This pull request is about meta server received client request and started bulk load.

Client sends start_bulk_load_request to meta server, meta server will try to start bulk load:

  • check if parameters are valid, see more in function check_bulk_load_request_params
  • create app bulk load directory on remote storage and set app bulk_load_status as downloading, in function create_app_bulk_load_dir
  • create partition bulk load directory on remote storage and set partition bulk_load_status as downloading, in function create_partition_bulk_load_dir
  • initialize some varieties useful during bulk load process

All steps above finished, meta server will return ERR_OK to client, and start to do bulk load asynchronously, which will be implemented in further pull request.

Bulk load design document can be found in official website: bulk_load_design

@hycdong hycdong changed the title feat(bulk-load): start bulk load feat(bulk-load): meta server start bulk load May 6, 2020
@hycdong hycdong marked this pull request as ready for review May 6, 2020 03:46
acelyc111
acelyc111 previously approved these changes May 8, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants