Nijie 429 Too Many Pull Requests

[multidrago11]

When I run a command for Nijie.Info on an account, it will run for a while before returning

[nijie][error] HttpError: '429 Too Many Pull Requests' for 'https://nijie.info/view.php?id=xxxxxx'

At this point, it will no longer download any more files. It does this consistently at the same point irregardless of how much time has passed and it only makes it through approx 2 pages before returning the error.

Is there a way to circumvent this error? I believe setting it to download specific pages each time might help but I do not know how to do this myself.

[taskhawk]

Try using the extractor.nijie.sleep configuration option (see https://gdl-org.github.io/docs/configuration.html), or the --sleep option from the command line to wait a bit before each download. A value of 2.0 seconds seems to work fine for me.

[mikf]

sleep-request might be better here, since gallery-dl does 1-2 HTTP requests per post even if not downloading anything. There's already a 1-2 second default sleep-request for nijie, but apparently that's not enough.

[multidrago11]

It took a bit to get it to work because I'm not very good at editing these files but a sleep-request of 6 seems to work perfectly fine. A bit slow but I really can't complain. Unsure if a shorter sleep request would also work but I'm patient enough to not be bothered with the wait.

While I have you here, what do I put to let gallery-dl download each nijie post into a separate individual folder?

[mikf]

Something like this, for example:

{
    "filename": "{num}.{extension}",
    "directory": ["{category}", "{user_id}", "{image_id}"],
    "sleep-request": 6
}

You can see default settings with -E <URL> and available field names with -K <URL>.

[multidrago11]

Alright, thanks for all the help!