Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

process_exception 未起作用 #6

Open
shuaiqileilei opened this issue Apr 6, 2023 · 1 comment
Open

process_exception 未起作用 #6

shuaiqileilei opened this issue Apr 6, 2023 · 1 comment

Comments

@shuaiqileilei
Copy link

下载中间键的process_response()函数,代码异常或者主动抛出的IgnoreRequest ,在后续的中间键的process_exception()并不能捕获到

@ConlinH
Copy link
Owner

ConlinH commented May 4, 2023

scrapy在下载中间键的process_response中的异常,也是不会走process_exception的吧, process_response中的异常要自己处理,要么IgnoreRequest 要么retry

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants