Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

support shared storage for reusable mode #3354

Merged
merged 23 commits into from
Feb 25, 2021

Conversation

J-shang
Copy link
Contributor

@J-shang J-shang commented Jan 29, 2021

[storage]

  • nfs
  • azure file
  • azure blob

[training service]

  • local
  • remote
  • pai
  • aml

[others]

  • test
  • example
  • doc

@J-shang J-shang marked this pull request as draft January 29, 2021 06:13
@J-shang J-shang mentioned this pull request Jan 29, 2021
94 tasks
@J-shang J-shang marked this pull request as ready for review February 3, 2021 01:33
sudo rpm -Uvh https://packages.microsoft.com/config/rhel/$(echo $version | cut -c1)/packages-microsoft-prod.rpm
sudo yum install -y blobfuse fuse
else
echo "Not support distributor."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I feel uncomfortable about this...

@@ -0,0 +1,50 @@
**How to Use Shared Storage**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please explicitly list supported distros and state that it requires root privilege.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add a note below.

#!/bin/bash
if [ -n "$(command -v apt-get)" ]
then
sudo apt-get update
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If user's os already installed NFS, these bash script does not need to be executed.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a if [ -n "$(command -v nfsstat)" ] judgment

storageAccountKey: ${replace_to_your_storageAccountKey}
# If you did not set storageAccountKey, you need use `az login` with Azure CLI at first and set resourceGroupName.
# resourceGroupName: ${replace_to_your_resourceGroupName}
containerName: ${replace_to_your_containerName}
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does containerName mean? Is it a contain id?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The name of the container in blob service in your storage account, like nni.
image


.. code-block:: yaml

sharedStorage:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add doc for these new added configuration in ExperimentConfig.rst?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add them

@J-shang J-shang merged commit 1338c51 into microsoft:master Feb 25, 2021
@J-shang J-shang deleted the shared-storage branch April 12, 2021 09:30
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants