BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-21 07:52:49 +00:00
Code Releases Wiki Activity

fix a bug with rescheduling a domain when no free slot are in worker

Browse Source 
(a domain was passed instead of a list, and that raises the one-letter
domains bug), also reschedule with priority=0)

--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%4048
This commit is contained in:
olveyra 2008-07-08 18:03:20 +00:00
parent 863d94adec
commit fc4e0eaa2a
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
scrapy/trunk/scrapy/contrib/pbcluster/master/manager.py
View File

@ -80,7 +80,7 @@ class Node:
def _run_callback(status):
if status['callresponse'][0] == 1:
#slots are complete. Reschedule in master. This is a security issue because could happen that the slots were completed since last status update by another cluster (thinking at future with full-distributed worker-master clusters)
self.master.schedule(pending['domain'], pending['settings'], pending['priority'])
self.master.schedule([pending['domain']], pending['settings'], PRIORITY_NOW)
log.msg("Domain %s rescheduled: no proc space in node." % pending['domain'], log.WARNING)
self._set_status(status)