Skip to content
This repository has been archived by the owner on Mar 12, 2023. It is now read-only.

migrate DHSS archives to data.jonblatho.com #59

Closed
6 tasks done
jonblatho opened this issue Oct 13, 2021 · 0 comments
Closed
6 tasks done

migrate DHSS archives to data.jonblatho.com #59

jonblatho opened this issue Oct 13, 2021 · 0 comments
Assignees
Labels
Milestone

Comments

@jonblatho
Copy link
Owner

jonblatho commented Oct 13, 2021

hugo deploy makes the usage of a single bucket for both the Hugo-generated site and additional data untenable given its propensity to delete all files then upload new ones (currently spared by the --maxDeletes option). The best workaround for this, to avoid accidental deletions due to bugs or human error, is to move static data that doesn't need to be in Git into a separate S3 bucket.

  • Copy DHSS archives to a new data.jonblatho.com S3 bucket
  • Rename the object keys from mo-dhss-data/YYYY-MM-DD.zip format to public/covid-19/dhss-archives/YYYY-MM-DD.zip.
  • Set up DNS records for data.jonblatho.com to point to the S3 bucket.
  • Update automation scripts to upload to and reference the data.jonblatho.com bucket.
  • Remove the --maxDeletes argument from hugo deploy in automations.
  • Update source URLs in the daily data files to reflect the new bucket.
@jonblatho jonblatho added enhancement New feature or request data labels Oct 13, 2021
@jonblatho jonblatho added this to the 6.17.1 milestone Oct 13, 2021
@jonblatho jonblatho self-assigned this Oct 13, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

No branches or pull requests

1 participant