BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 14:03:41 +00:00
Code Releases Wiki Activity

catch downloader process_queue exceptions

Browse Source
This commit is contained in:
Daniel Grana 2009-06-22 14:24:04 -03:00
parent e6bf2821ef
commit b488e3b4a9
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
scrapy/core/downloader/manager.py
View File

@ -93,6 +93,12 @@ class Downloader(object):
return deferred return deferred
def process_queue(self, spider): def process_queue(self, spider):
try:
self._process_queue(spider)
except:
log.exc('Downloader process queue bug')
def _process_queue(self, spider):
""" Effective download requests from site queue """ Effective download requests from site queue
""" """
domain = spider.domain_name domain = spider.domain_name