Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add optional sha256 to example manifest #446

Merged
merged 13 commits into from
Oct 14, 2021

Conversation

jpn--
Copy link
Member

@jpn-- jpn-- commented Jul 1, 2021

This change allows an optional sha256 checksum to be added in the examples manifest. If the file to be downloaded already exists locally in the correct place and matches the checksum, we no longer re-download the file, just use the copy we already have. This can prevent upcoming benchmarking tool #439 from pounding relentlessly on activitysim_resources repo, by caching the large file downloads. (Added bonus, if we do need to download we can validate the checksum after the download and make sure the file is what was expected.)

jpn-- added 2 commits July 1, 2021 15:25
this can prevent upcoming benchmarking tool from pounding relentlessly on activitysim_resources repo, by caching the large file downloads
@bstabler
Copy link
Contributor

bstabler commented Jul 23, 2021

this is a nice improvement. @jpn-- can we add checksums to each example posted in activitysim_resources?

@bstabler
Copy link
Contributor

@jpn-- please PR to develop when ready

bstabler and others added 4 commits August 25, 2021 21:53
this can prevent upcoming benchmarking tool from pounding relentlessly on activitysim_resources repo, by caching the large file downloads
…ysim into checksum-downloads

# Please enter a commit message to explain why this merge is necessary,
# especially if it merges an updated upstream into a topic branch.
#
# Lines starting with '#' will be ignored, and an empty message aborts
# the commit.
@coveralls
Copy link

coveralls commented Sep 1, 2021

Coverage Status

Coverage decreased (-0.09%) to 57.894% when pulling 79228a4 on jpn--:checksum-downloads into 3c22d9e on ActivitySim:develop.

@jpn-- jpn-- changed the base branch from master to develop September 7, 2021 17:55
@jpn-- jpn-- requested a review from bstabler September 10, 2021 17:09
@jpn--
Copy link
Member Author

jpn-- commented Sep 10, 2021

This PR is now ready to merge into develop.

@bstabler
Copy link
Contributor

Looks good. @jpn-- can you update the docs, probably the development and/or example rst pages, with some notes about the checksums and how to update them? Thanks.

@bstabler
Copy link
Contributor

bstabler commented Oct 7, 2021

@jpn-- to update documentation

Copy link
Contributor

@bstabler bstabler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see comments in issue

@jpn--
Copy link
Member Author

jpn-- commented Oct 14, 2021

@bstabler I've added some docs on checksums. If you agree they are sufficient this is ready to merge.

@bstabler bstabler merged commit 4df6aa9 into ActivitySim:develop Oct 14, 2021
@bstabler
Copy link
Contributor

looks good, thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants