-
-
Notifications
You must be signed in to change notification settings - Fork 991
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DeviantArt 404s on every picture #436
Comments
I am seeing this as well. |
It started a day or 2 ago. It does get an image successfully rarely. |
It seems to only affect when downloading an entire album, not individual posts. |
I'm having this problem while downloading full accounts. |
The URLs for original file downloads got changed on DeviantArt's end and are currently all pointing to a 404 page. I would expect that this gets fixed on their side in the next couple of days, but who knows. As a not very useful "workaround", turning off the original file downloads makes things work again, but only being able to download preview images doesn't really help, I suppose. In the meantime, I've been working on a rewrite of what is basically the whole |
Most important things for me is |
Everything in --write-metadata is super important for me.. espicially the tags. |
Can confirm that this issue is still present trying to rip whole galleries, but inputting individual pics into the command line results in a successful rip. |
Tried out the deviantart-rewrite to test it out, @mikf. I am still occasionally getting 404's in some galleries, and a few sta.sh links as well. It's nowhere near as bad as before, but it happens once in a blue moon. |
Just wanted to confirm that I'm having the same problem |
... except for sta.sh content. Instead of using the old '/api/v1/oauth2/deviation/download' endpoint, which started delivering URLs to 404 pages a while ago, it is also possible to get a download URL from the relatively new '/_napi/da-browse/shared_api/deviation/extended_fetch' endpoint used by DeviantArt's Eclipse interface. The current strategy is therefore: - Iterate over deviations using the OAuth2 API - Fetch original download URLs with the new NAPI/Shared API
I've found a way to get things to work again. Everything should work as it did before, except sta.sh content. And fetching a download URL might be a bit slower than before. See 27b5b24 for details. @sledgehammer93 thank you for testing, but I think using the new interface might after all be more trouble than it's worth. A lot of "non-mainstream" things like sta.sh and groups are currently not supported (and might never be), and logging in also doesn't work anymore (captcha), so I'd rather leave everything as is for as long as possible. |
A lot of the content I download if from sta.sh. Is there a way to tell what I missed so I can download it myself or something? That would be missing out on thousands of files for me considering I'm downloading ~21,000 accounts with an average of 150 images per account. I see sta.sh stuff in the logs all the time. |
I haven't even gotten through the letter "a" (for account names) yet and there's already 18,146 sta.sh links in the log. |
Downloading from sta.sh should now also work again: 94eb7c6 |
How can I add this to the Windows exec version of gallery-dl? Should I wait for a new version? I appreciate your help on this. |
Thanks for fixing that :D |
You can't. So either wait for a new release version, or, if you have Python installed, you can use pip to install gallery-dl directly from the repo, like this:
|
Well, here is the new version including a Windows executable: Let's hope the DeviantArt devs don't spend more of their time "fixing" old APIs and instead finish their new Eclipse design. |
See:
The text was updated successfully, but these errors were encountered: