Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changes in Pixiv behaviour #6581

Closed
anonymous721 opened this issue Dec 1, 2024 · 1 comment
Closed

Changes in Pixiv behaviour #6581

anonymous721 opened this issue Dec 1, 2024 · 1 comment

Comments

@anonymous721
Copy link

I generally run gallery-dl through a python script that I feed a list of Pixiv artist IDs, and pipe stdout and stderr to a log file. In the past, this log file has contained no indication when an ID pointed to a deleted account. Today I noticed that dead accounts now give Unable to collect artwork IDs using AJAX API (TypeError: 'NoneType' object is not subscriptable) in the log. Unfortunately, since it doesn't actually state the artist that had the error, I need to check whoever came before or after in the log (since successful downloads or skips include the artist ID in the file path), and compare against my list of artists to scrape.
Is it possible for the error to be adjusted to include the relevant artist ID?

At the same time I also noticed the appearance of 'limit_sanity_level' warning which I had not seen before. I do have the PHPSESSID cookie set. The images also appear to be successfully accessed; all those I see in-browser are downloaded by gdl, and when I checked one example (https://www.pixiv.net/en/artworks/95481877) against the artist's Twitter, I noticed that there were no additional images there not visible on Pixiv either, so it doesn't seem to be a case where my Pixiv account as a whole can't see them. But I can also see that image while logged out, so I'm really not sure what this warning is telling me.

I'm not sure if these behaviours are due to a change on Pixiv's end, or in gallery-dl's. These changes did come on the next run after I updated gallery-dl.

@mikf
Copy link
Owner

mikf commented Dec 1, 2024

Is it possible for the error to be adjusted to include the relevant artist ID?

Sure
edit: 9909075

At the same time I also noticed the appearance of 'limit_sanity_level' warning which I had not seen before

All limit_sanity_level_360.png works (#4327) emit this log message. Not to indicate an error, but to notify that some extra HTTP requests were necessary and something potentially failed during those.

I'm not sure if these behaviours are due to a change on Pixiv's end, or in gallery-dl's

This is due to gallery-dl changes to support otherwise missing limit_sanity_level_360.png works (#4327).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants