Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[New] Object Storage Migration guides #7108

Merged
merged 7 commits into from
Sep 30, 2024

Conversation

jddocs
Copy link
Collaborator

@jddocs jddocs commented Sep 23, 2024

Three new guides for migrating third-party object storage data to Linode Object Storage:

  • Migrate From Azure Blob Storage to Linode Object Storage
  • Migrate From AWS S3 to Linode Object Storage
  • Migrate From Google Cloud Storage to Linode Object Storage

@jddocs
Copy link
Collaborator Author

jddocs commented Sep 23, 2024

Initial commit with Azure guide. Other two guides not included yet & dictionary not updated.

Copy link

netlify bot commented Sep 23, 2024

Deploy Preview for nostalgic-ptolemy-b01ab8 ready!

Name Link
🔨 Latest commit 6eef6e1
🔍 Latest deploy log https://app.netlify.com/sites/nostalgic-ptolemy-b01ab8/deploys/66faf95f47ac940007ec4c0e
😎 Deploy Preview https://deploy-preview-7108--nostalgic-ptolemy-b01ab8.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@jddocs jddocs added Ready and removed Do Not Merge labels Sep 30, 2024

- The **public IPv4 address** of your virtual machine.

- As a security best practice, **use a firewall to only allow inbound port 5572**. This is the default port used by rclone and enables secure access to the WebUI since it is served over HTTP.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems like serving it over HTTP is insecure, not secure like this line says--a later step in this guide tells the user to log in with a username and password, but this would be sent in cleartext with HTTP. Are there options to serve it over HTTPS and use an SSL cert instead?

Maybe the rclone docs have some kind of tutorial for setting up an HTTPS gateway with NGINX/Apache to do that. It would be outside the scope of this guide to do anything other than to link to it, I think. If there isn't any official docs on that, it seems like we should at least mention to the reader that they should consider setting up an HTTPS gateway to the webUI

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added a line to address this and will link to resources at a later date


## Verify the Migration

You can compare the number of objects in both your source and target buckets along with the total size of the buckets to verify full completion of the copy job.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm wondering if there's some kind of checksum/hash comparison that could be done that also verifies the contents of the buckets. There might not be, but it was just a thought that came to me

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will check on this with my SME for a future edit

@jddocs jddocs merged commit 1e8f088 into linode:develop Sep 30, 2024
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants