Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

e-hentai IndexError #360

Closed
emptythevoid opened this issue Jul 29, 2019 · 4 comments
Closed

e-hentai IndexError #360

emptythevoid opened this issue Jul 29, 2019 · 4 comments

Comments

@emptythevoid
Copy link

This was working just fine last night, so I left it running. This morning, all attempts at performing a download are resulting in an IndexError. This seems to only happen on this particular machine, though. I tried it on a laptop and it worked fine. I'm not certain what happened overnight that broke it. Here's the verbose output below (should be non-h in content)

gallery-dl --verbose https://e-hentai.org/g/1454123/e4dafd8b04/
[gallery-dl][debug] Version 1.9.0
[gallery-dl][debug] Python 3.6.8 - Linux-4.15.0-55-generic-x86_64-with-Ubuntu-18.04-bionic
[gallery-dl][debug] requests 2.22.0 - urllib3 1.25.3
[gallery-dl][debug] Starting DownloadJob for 'https://e-hentai.org/g/1454123/e4dafd8b04/'
[gallery-dl][debug] Updating urllib3 ciphers
[exhentai][debug] Using ExhentaiGalleryExtractor for 'https://e-hentai.org/g/1454123/e4dafd8b04/'
[exhentai][info] no username given; using e-hentai.org
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): e-hentai.org:443
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /g/1454123/e4dafd8b04/ HTTP/1.1" 200 4806
[urllib3.connectionpool][debug] https://e-hentai.org:443 "GET /s/1615ef3fc9/1454123-1/1454123-1 HTTP/1.1" 200 1492
[exhentai][error] An unexpected error occurred: IndexError - list index out of range. Please run gallery-dl again with the --verbose flag, copy its output and report this issue on https://github.com/mikf/gallery-dl/issues .
[exhentai][debug]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/dist-packages/gallery_dl/job.py", line 47, in run
for msg in self.extractor:
File "/usr/local/lib/python3.6/dist-packages/gallery_dl/extractor/exhentai.py", line 165, in items
(self.image_from_page(ipage),), self.images_from_api())
File "/usr/local/lib/python3.6/dist-packages/gallery_dl/extractor/exhentai.py", line 219, in image_from_page
data = self._parse_image_info(url)
File "/usr/local/lib/python3.6/dist-packages/gallery_dl/extractor/exhentai.py", line 310, in _parse_image_info
"width": text.parse_int(parts[2]),
IndexError: list index out of range

mikf added a commit that referenced this issue Jul 29, 2019
- warn on MPV-enabled galleries
- catch parsing errors for gallery pages and image info
- write page content to debug output
@emptythevoid
Copy link
Author

Er, I think they limited my access based on IP. So my fault.

@mikf
Copy link
Owner

mikf commented Jul 29, 2019

Well, ok ... I just added some more error checks with debug output included in 81b35ed and wanted to ask you to run it with that, but that's not necessary if you've already figured it out.

You could increase the values for wait-min/-max and sleep to try to prevent this from happening in the future, I guess. It's worth a try.

@emptythevoid
Copy link
Author

Thanks. Sorry for the trouble. I would have discovered the fault sooner, but I didn't realize I had to click through to an image to see the "you've blown past your limit" message.

@emptythevoid
Copy link
Author

I'll go ahead and close this. Thanks again

mikf added a commit that referenced this issue Jul 31, 2019
- check image limit before opening the first gallery or image page
- prevent any further exhentai extractors from running after the image
  limit has been reached
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants