Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[twitter][error] 404 Not Found () #3999

Closed
ReEnMikki opened this issue May 3, 2023 · 7 comments
Closed

[twitter][error] 404 Not Found () #3999

ReEnMikki opened this issue May 3, 2023 · 7 comments

Comments

@ReEnMikki
Copy link

I know this is a duplicate issue, but none of the solutions in previous issue posts worked. I already am using the latest version of gallery-dl, not an outdated version (I am working in Colab Notebook). I tried to apply your patch. I also did login. The only difference it made is that, at first, it showed the 404 Not Found error very quickly after around 150 images. But after I applied the above methods, it got to around 1500 images then showed this error. The error suspends the scraping process and stops the cell, of course. It did not successfully scrape all images from the Twitter user. Please help

gallery-dl v1.25.4-dev

@mikf
Copy link
Owner

mikf commented May 3, 2023

tried to apply your patch

Do not use the patch from #3942 (comment). It does not work and only makes things worse.
Just use the code from master and be logged in to make searches work.

@ReEnMikki
Copy link
Author

tried to apply your patch

Do not use the patch from #3942 (comment). It does not work and only makes things worse. Just use the code from master and be logged in to make searches work.

Whoops, thanksfully I only did it in a Colab runtime session. Btw, sorry but wdym by master's code ?

@rautamiekka
Copy link
Contributor

The master branch, the default when you go to the repo: https://github.com/mikf/gallery-dl

@ReEnMikki
Copy link
Author

The master branch, the default when you go to the repo: https://github.com/mikf/gallery-dl

Yes, I did use the default branch and logged in, but it still displayed this error [twitter][error] 403 Forbidden (Forbidden.) after few downloaded images, even though there are many more.

By the way, in my Twitter account, I enabled this in Settings Display media that may contain sensitive content ☑️ but I still got this error [twitter][warning] "Age-restricted adult content. This content might not be appropriate for people under 18 years old. To view this media, you’ll need to log in to Twitter. Learn more"

image
image
image

@ReEnMikki
Copy link
Author

ReEnMikki commented May 3, 2023

Even when I try to run the cell again and again, it barely downloads few more images, then it quickly reaches a point where it literally doesn't even download anymore, straight up instantly showing that 403 Forbidden error.

It looks like this problem is happening on both Colab and my local machine. In both places, I also get that nonsense NSFW warning error after logging in... Still, I really appreciate if anyone can help me with this problem.

@mikf
Copy link
Owner

mikf commented May 4, 2023

Login with username and password seems to not work for you for some reason. Login with a real browser instead, get the auth_token cookie from it, and pass that to gallery-dl. (See Cookies)

You can try passing --write-pages when running the user+pass login process and investigate the contents and errors in the last login-related file this generated, if you want to know what went wrong.

@Jack7D1
Copy link

Jack7D1 commented May 8, 2023

Login with username and password seems to not work for you for some reason. Login with a real browser instead, get the auth_token cookie from it, and pass that to gallery-dl. (See Cookies)

You can try passing --write-pages when running the user+pass login process and investigate the contents and errors in the last login-related file this generated, if you want to know what went wrong.

I was experiencing this issue, your comment here made me realize that my cookies extractor wasn't outputting the auth token. Used a different one and it works now. Thanks for the sanity check!

@mikf mikf closed this as completed May 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants