This repository has been archived by the owner on Jun 10, 2024. It is now read-only.
v0.3.5
- New parameter: auto_recrawl - auto restart task every
age
. - New parameter: js_viewport_width/js_viewport_height to set viewport size for phantomjs engine.
- New command line option to set different message queue backends with URI scheme.
- New task level storage mechanism:
self.save
- New redis taskdb
- New redis message queue.
- New high level message queue interface kombu.
- Fix bugs related to mongodb (keyword missing if not set).
- Fix phantomjs not work in all mode.
- Fix a potential deadlock in processor send_message.
- Default log level of scheduler is changed to INFO