mirror of
https://github.com/scrapy/scrapy.git
synced 2025-02-27 03:44:11 +00:00
dont discard slot when empty, just save in another dict in order to recycle if needed again
changed default user agent to Scrapy/0.15 (+http://scrapy.org) and removed no longer needed BOT_VERSION setting
This is Scrapy, an opensource screen scraping framework written in Python. For more info visit the project home page at http://scrapy.org
Description
Languages
Python
99.8%
HTML
0.1%