Mikhail Korobov
b03fe04999
Rename AjaxCrawlableMiddleware to AjaxCrawlMiddleware
2014-01-16 23:09:37 +06:00
Pablo Hoffman
ed6fd4933f
Merge pull request #524 from hobsonlane/master
...
documentation code example corrections per pablohoffman
2014-01-16 06:44:51 -08:00
Pablo Hoffman
71ada5476e
Merge pull request #472 from redapple/exslt
...
Register EXSLT namespaces by default (resolves #470 )
2014-01-16 06:32:05 -08:00
Daniel Graña
b9bb9bed6b
Merge pull request #343 from kmike/ajax-crawlable
...
[MRG] AjaxCrawlableMiddleware
2014-01-16 05:07:39 -08:00
Daniel Graña
e2a5310f92
Merge pull request #537 from dangra/warn-xpathselector-subclass
...
warn XPathSelector deprecation on subclassing and direct instance
2014-01-16 04:14:27 -08:00
Daniel Graña
5a175ad287
Merge pull request #519 from dangra/warn-once
...
Warn BaseSpider deprecation only once
2014-01-16 04:07:21 -08:00
Daniel Graña
b3be6e210d
warn XPathSelector deprecation on subclassing and direct instance
2014-01-16 09:53:59 -02:00
Daniel Graña
3e42646ce1
do not test multiple instantation warnings
2014-01-16 09:49:51 -02:00
Hobson Lane
85a80d0752
remove "for brevity's sake" line and correct "Torrent item"
...
Torrent item -> TorrentItem class
2014-01-15 17:29:23 -08:00
Mikhail Korobov
03dab0117d
Merge pull request #536 from manfre/patch-1
...
Fix comment typo
2014-01-15 16:39:33 -08:00
Michael Manfre
4a2a45b495
Fix comment typo
2014-01-15 12:35:34 -05:00
Paul Tremberth
827c0cf51f
Rename "regexp" prefix to "re"
2014-01-15 15:00:25 +01:00
Mikhail Korobov
c92f52ce2c
Merge pull request #525 from alexanderlukanin13/urllib_test_coverage
...
Improved test coverage
2014-01-15 04:05:37 -08:00
Mikhail Korobov
af16fa326f
Merge pull request #533 from chekunkov/make_dupefilter_easily_subclassable
...
Make dupefilter easily subclassable
2014-01-15 03:56:45 -08:00
Paul Tremberth
88c8a523a7
Add warning in docs on performance when using EXSLT regexp functions
2014-01-15 12:52:10 +01:00
Alexander Chekunkov
5411695905
removed request_fingerprint method from BaseDupeFilter, removed unnecessary docstring
2014-01-15 13:44:46 +02:00
Paul Tremberth
a3eba68aca
Drop EXSLT strings and math extensions
2014-01-15 12:28:25 +01:00
Alexander Chekunkov
c2421a4b3f
Added request_fingerprint method to dupefilter classes so they could be easily subclassed without need to override entire request_seen method.
2014-01-15 13:02:05 +02:00
alexanderlukanin13
25759bdf5c
Removed deploy test (as deploy command is deprecated and moved to scrapyd)
2014-01-15 13:09:36 +06:00
alexanderlukanin13
ab6496647c
Added "six>=1.5.2" to requirements
2014-01-15 13:05:00 +06:00
Pablo Hoffman
ea2f897b81
Merge pull request #502 from scrapy/doc-fixes
...
DOWNLOAD_DELAY docs clarification
2014-01-14 21:07:42 -08:00
Hobson Lane
a3db95985b
another import name correction by pablo
2014-01-14 21:04:15 -08:00
Pablo Hoffman
3d308d7732
Merge pull request #517 from hoprocker/patch-1
...
Clarify return value from extract_links
2014-01-14 21:01:32 -08:00
Pablo Hoffman
622ffd84d0
Merge pull request #523 from dangra/warn-xpathitemloader-subclass
...
warn on XPathItemLoader subclassing
2014-01-14 20:58:07 -08:00
Pablo Hoffman
b377d4c28c
Merge pull request #531 from kmike/fix-memdebug
...
Fix logging of stats collected by MemoryDebugger extension.
2014-01-14 20:42:19 -08:00
Mikhail Korobov
26538b01b5
Fix logging of stats collected by MemoryDebugger extension.
...
Stats are printed on spider_closed event;
engine_stopped signal is called after spider_closed signal,
so stats for MemoryDebugger extension were not printed to user.
2014-01-15 04:05:09 +06:00
Daniel Graña
553c70a9dc
Merge pull request #530 from kmike/memusage-osx
...
Fix MemoryUsage extension for OS X
2014-01-14 13:56:02 -08:00
Mikhail Korobov
a83c6f545c
Fix MemoryUsage extension for OS X. Fix GH-529.
2014-01-15 03:24:48 +06:00
Paul Tremberth
2cc26e6f56
Fix typo error
2014-01-14 13:09:18 +01:00
Paul Tremberth
29fc9f3466
Update selectors documentation and tests
2014-01-14 12:56:37 +01:00
Paul Tremberth
5df56a9758
Applying suggestions from previous comments
2014-01-14 12:49:17 +01:00
Paul Tremberth
d46534cc54
Register EXSLT namespaces by default ( resolves #470 )
2014-01-14 12:49:17 +01:00
Pablo Hoffman
62a7b6fe73
Merge pull request #527 from ferdyrod/master
...
Torrent url in the "Scrapy at a glance" doc was removed
2014-01-13 07:06:32 -08:00
Ferdy Rodriguez
807dd25324
fixed error on tor's name
2014-01-13 00:03:58 -06:00
Ferdy Rodriguez
8b9348cfaf
Changed TOR Info as previous was removed from www.mininova.org
2014-01-12 23:46:04 -06:00
alexanderlukanin13
4862a7d7fe
RobotsTxtMiddlewareTest
2014-01-11 17:29:44 +06:00
alexanderlukanin13
a54e31cebc
RegexLinkExtractorTestCase
2014-01-11 15:12:54 +06:00
alexanderlukanin13
968141cd42
test_command_deploy, test_contrib_linkextractors
2014-01-11 14:30:27 +06:00
Daniel Graña
31dd3dc4a1
allow deprecation of subclasses of already deprecated classes
2014-01-10 18:10:08 -02:00
Daniel Graña
116f01f2d2
allow overriding old and new class paths
2014-01-10 18:10:08 -02:00
Daniel Graña
6313b7ff4c
allow deprecation of a class with custom metaclass
2014-01-10 18:10:08 -02:00
Daniel Graña
1e37b64ecd
split subclassing tests and default to warning only once per deprecated class
2014-01-10 18:10:08 -02:00
Daniel Graña
a97b4aa633
only warn on direct subclasses of the deprecated class
2014-01-10 18:10:08 -02:00
Daniel Graña
8c81d6c6a9
revert warning filter on deprecated class instantiation
2014-01-10 18:10:08 -02:00
Daniel Graña
23c37dee36
support showing subclassing deprecation warning only once
2014-01-10 18:09:47 -02:00
Hobson Lane
6ba0857a5c
documentation code example correction corrections per pablohoffman
2014-01-10 10:37:27 -08:00
Daniel Graña
72ff7a48e3
warn on XPathItemLoader subclassing
2014-01-10 13:57:04 -02:00
Daniel Graña
9028a06de7
Merge pull request #520 from redapple/startupinfo
...
Promote startup info on settings and middleware to INFO level
2014-01-09 10:58:04 -08:00
Paul Tremberth
9f90c11246
Promote startup info on settings and middleware to INFO level
2014-01-09 19:37:06 +01:00
malcolm m
962e5ef702
Clarify return value from extract_links
2014-01-05 14:42:48 -08:00
