Best way to scale scraping

[Cvoluj]

I saw there are some ways to scale: new_context and multithreading. So I'm curious what will be the best.

[kaliiiiiiiiii]

Uh combination of both, I suppose.
With new_context, python can reach its limits at some point
=> new_context + multiprocessing

[Cvoluj]

Thanks a lot, for answer and great library