Mikhail Korobov
af16fa326f
Merge pull request #533 from chekunkov/make_dupefilter_easily_subclassable
...
Make dupefilter easily subclassable
2014-01-15 03:56:45 -08:00
Paul Tremberth
88c8a523a7
Add warning in docs on performance when using EXSLT regexp functions
2014-01-15 12:52:10 +01:00
Alexander Chekunkov
5411695905
removed request_fingerprint method from BaseDupeFilter, removed unnecessary docstring
2014-01-15 13:44:46 +02:00
Paul Tremberth
a3eba68aca
Drop EXSLT strings and math extensions
2014-01-15 12:28:25 +01:00
Alexander Chekunkov
c2421a4b3f
Added request_fingerprint method to dupefilter classes so they could be easily subclassed without need to override entire request_seen method.
2014-01-15 13:02:05 +02:00
alexanderlukanin13
25759bdf5c
Removed deploy test (as deploy command is deprecated and moved to scrapyd)
2014-01-15 13:09:36 +06:00
alexanderlukanin13
ab6496647c
Added "six>=1.5.2" to requirements
2014-01-15 13:05:00 +06:00
Pablo Hoffman
ea2f897b81
Merge pull request #502 from scrapy/doc-fixes
...
DOWNLOAD_DELAY docs clarification
2014-01-14 21:07:42 -08:00
Hobson Lane
a3db95985b
another import name correction by pablo
2014-01-14 21:04:15 -08:00
Pablo Hoffman
3d308d7732
Merge pull request #517 from hoprocker/patch-1
...
Clarify return value from extract_links
2014-01-14 21:01:32 -08:00
Pablo Hoffman
622ffd84d0
Merge pull request #523 from dangra/warn-xpathitemloader-subclass
...
warn on XPathItemLoader subclassing
2014-01-14 20:58:07 -08:00
Pablo Hoffman
b377d4c28c
Merge pull request #531 from kmike/fix-memdebug
...
Fix logging of stats collected by MemoryDebugger extension.
2014-01-14 20:42:19 -08:00
Mikhail Korobov
26538b01b5
Fix logging of stats collected by MemoryDebugger extension.
...
Stats are printed on spider_closed event;
engine_stopped signal is called after spider_closed signal,
so stats for MemoryDebugger extension were not printed to user.
2014-01-15 04:05:09 +06:00
Daniel Graña
553c70a9dc
Merge pull request #530 from kmike/memusage-osx
...
Fix MemoryUsage extension for OS X
2014-01-14 13:56:02 -08:00
Mikhail Korobov
a83c6f545c
Fix MemoryUsage extension for OS X. Fix GH-529.
2014-01-15 03:24:48 +06:00
Paul Tremberth
2cc26e6f56
Fix typo error
2014-01-14 13:09:18 +01:00
Paul Tremberth
29fc9f3466
Update selectors documentation and tests
2014-01-14 12:56:37 +01:00
Paul Tremberth
5df56a9758
Applying suggestions from previous comments
2014-01-14 12:49:17 +01:00
Paul Tremberth
d46534cc54
Register EXSLT namespaces by default ( resolves #470 )
2014-01-14 12:49:17 +01:00
Pablo Hoffman
62a7b6fe73
Merge pull request #527 from ferdyrod/master
...
Torrent url in the "Scrapy at a glance" doc was removed
2014-01-13 07:06:32 -08:00
Ferdy Rodriguez
807dd25324
fixed error on tor's name
2014-01-13 00:03:58 -06:00
Ferdy Rodriguez
8b9348cfaf
Changed TOR Info as previous was removed from www.mininova.org
2014-01-12 23:46:04 -06:00
alexanderlukanin13
4862a7d7fe
RobotsTxtMiddlewareTest
2014-01-11 17:29:44 +06:00
alexanderlukanin13
a54e31cebc
RegexLinkExtractorTestCase
2014-01-11 15:12:54 +06:00
alexanderlukanin13
968141cd42
test_command_deploy, test_contrib_linkextractors
2014-01-11 14:30:27 +06:00
Daniel Graña
31dd3dc4a1
allow deprecation of subclasses of already deprecated classes
2014-01-10 18:10:08 -02:00
Daniel Graña
116f01f2d2
allow overriding old and new class paths
2014-01-10 18:10:08 -02:00
Daniel Graña
6313b7ff4c
allow deprecation of a class with custom metaclass
2014-01-10 18:10:08 -02:00
Daniel Graña
1e37b64ecd
split subclassing tests and default to warning only once per deprecated class
2014-01-10 18:10:08 -02:00
Daniel Graña
a97b4aa633
only warn on direct subclasses of the deprecated class
2014-01-10 18:10:08 -02:00
Daniel Graña
8c81d6c6a9
revert warning filter on deprecated class instantiation
2014-01-10 18:10:08 -02:00
Daniel Graña
23c37dee36
support showing subclassing deprecation warning only once
2014-01-10 18:09:47 -02:00
Hobson Lane
6ba0857a5c
documentation code example correction corrections per pablohoffman
2014-01-10 10:37:27 -08:00
Daniel Graña
72ff7a48e3
warn on XPathItemLoader subclassing
2014-01-10 13:57:04 -02:00
Daniel Graña
9028a06de7
Merge pull request #520 from redapple/startupinfo
...
Promote startup info on settings and middleware to INFO level
2014-01-09 10:58:04 -08:00
Paul Tremberth
9f90c11246
Promote startup info on settings and middleware to INFO level
2014-01-09 19:37:06 +01:00
malcolm m
962e5ef702
Clarify return value from extract_links
2014-01-05 14:42:48 -08:00
Daniel Graña
21a8a9456c
Merge pull request #514 from dangra/mitmproxy-in-pip15
...
Mitmproxy in pip15
2014-01-03 15:31:30 -08:00
Daniel Graña
02c80ca75b
rename tests requirements to forward looking for /tests/
2014-01-03 21:02:25 -02:00
Daniel Graña
face0bf4b4
Force PIL installation to comply with mitmproxy requirements. closes #513
2014-01-03 19:21:55 -02:00
Daniel Graña
958d0dbf39
move tests requirements to a single place
2014-01-03 18:55:54 -02:00
Pablo Hoffman
dadaedce3e
Merge pull request #512 from yprez/patch-1
...
Item Pipeline docs - remove unused import from code sample
2014-01-03 06:49:55 -08:00
Yuri Prezument
060891c01c
Remove unused import from code sample
...
Item pipeline docs - removed unused import from code sample
2014-01-03 15:44:17 +02:00
Mikhail Korobov
292d21ca86
spelling: instanciated -> instantiated
2014-01-01 11:52:07 +06:00
Mikhail Korobov
d7fbccdff7
Merge pull request #510 from dangra/kmike-reanme-base-spider
...
Rename BaseSpider to Spider. Fixes #495 , fixes #501 .
2013-12-31 21:47:26 -08:00
Pablo Hoffman
e2f091801c
Merge pull request #507 from dangra/fromresponse_override_url
...
[MRG] support overriding url in FormRequest.from_response
2013-12-31 12:01:13 -08:00
Daniel Graña
b41ad38fab
warn when the deprecated class is instanciated
2013-12-31 16:40:00 -02:00
Daniel Graña
8c4e1db5fe
Hold the deprecated class reference in the metaclass
2013-12-31 16:02:03 -02:00
Daniel Graña
f6a0ac8325
support overriding url in FormRequest.from_response
2013-12-30 16:58:11 -02:00
Mikhail Korobov
5af45689e4
allow caller to customize clsdict
2013-12-31 00:17:42 +06:00
