Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Size of repo may make lead to incomplete git clone #7

Closed
Minyall opened this issue Jan 16, 2023 · 2 comments
Closed

Size of repo may make lead to incomplete git clone #7

Minyall opened this issue Jan 16, 2023 · 2 comments

Comments

@Minyall
Copy link
Contributor

Minyall commented Jan 16, 2023

I've been trying to make a local clone of the repo but I have been recieving an error stating that 'the remote end hung up unexpectedly' which I believe is related to the repo size. It is commonly reported by others trying to clone large repos. It may be fixable by the user first adjusting their buffer size using git config --global http.postBuffer 1048576000 however I'm yet to be succesful in cloning the repo even on high speed institutional internet after making these adjustments. Given the book begins with users cloning the repo, this may be a bit of a hurdle. Perhaps the largest files could be offloaded elsewhere to reduce size, and then add a helper function in the dcss pip package to download?

EDIT
Ok I realised that I needed to install git-lfs in order for the pretrained models to be handled properly by git clone. I didn't have this in my git installation. Now that it's installed it seems to be cloning ok, though taking a while. It may still be more accessible for students to not have the pretrained models by default for a quicker stand up process, but still make them available as an optional extra.

@mclevey
Copy link
Contributor

mclevey commented Jan 17, 2023

Thanks, @Minyall! We've also realized it is due to LFS. I'm working on an alternative solution, and my students and I are doing a few other things to reduce the size of the repo. Should have something in place very soon.

@pbrowne88
Copy link
Member

All LFS files in the repo have been removed; repository should download without issue -- even for those without git-lfs installed. The issue of providing the pre-trained models using a different venue remains unsolved; I've opened #13 accordingly.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants