stray-leone
7f30a671c3
modify the version of scrapy ubuntu package
...
latest version is 0.22.
with scrapy-0.18, tutorial project provides error
relative issue : https://github.com/scrapy/scrapy/issues/511
2014-01-20 10:24:34 -02:00
Daniel Graña
431f2d109f
fix 0.22.0 release date
2014-01-17 17:54:01 -02:00
Mikhail Korobov
dfd13f9941
fix typos in news.rst and remove (not released yet) header
2014-01-18 01:50:19 +06:00
Paul Tremberth
001cf39ff4
Add testcase to check is default Selector doesnt return smart strings
2014-01-17 20:34:59 +01:00
Paul Tremberth
5eb336215c
Make lxml smart strings functionality customizable
2014-01-17 20:34:59 +01:00
Paul Tremberth
1f184ed7bf
Disable smart strings in lxml XPath evaluations
2014-01-17 20:33:32 +01:00
Daniel Graña
d8164bd5f4
bump version to 0.23
2014-01-17 15:57:10 -02:00
Daniel Graña
d1f1b074e1
Merge 0.22.0 release notes
2014-01-17 15:55:46 -02:00
Daniel Graña
3c1e22618b
Merge pull request #541 from kmike/fs-as-default-cache
...
[MRG] Make Filesystem storage backend default again.
2014-01-17 09:10:26 -08:00
Mikhail Korobov
7b7a1d8dfd
Make Filesystem storage backend default again. See GH-500.
2014-01-17 04:32:08 +06:00
Daniel Graña
f0851e41ec
Merge pull request #478 from redapple/offsitetests
...
Add tests for OffsiteMiddleware() + use re.escape() in domains regexp
2014-01-16 14:02:26 -08:00
Daniel Graña
151f9478c1
Merge pull request #538 from kmike/ajaxcrawlable-rename
...
[MRG] Rename AjaxCrawlableMiddleware to AjaxCrawlMiddleware
2014-01-16 10:33:46 -08:00
Mikhail Korobov
b03fe04999
Rename AjaxCrawlableMiddleware to AjaxCrawlMiddleware
2014-01-16 23:09:37 +06:00
Pablo Hoffman
ed6fd4933f
Merge pull request #524 from hobsonlane/master
...
documentation code example corrections per pablohoffman
2014-01-16 06:44:51 -08:00
Pablo Hoffman
71ada5476e
Merge pull request #472 from redapple/exslt
...
Register EXSLT namespaces by default (resolves #470 )
2014-01-16 06:32:05 -08:00
Daniel Graña
b9bb9bed6b
Merge pull request #343 from kmike/ajax-crawlable
...
[MRG] AjaxCrawlableMiddleware
2014-01-16 05:07:39 -08:00
Daniel Graña
e2a5310f92
Merge pull request #537 from dangra/warn-xpathselector-subclass
...
warn XPathSelector deprecation on subclassing and direct instance
2014-01-16 04:14:27 -08:00
Daniel Graña
5a175ad287
Merge pull request #519 from dangra/warn-once
...
Warn BaseSpider deprecation only once
2014-01-16 04:07:21 -08:00
Daniel Graña
b3be6e210d
warn XPathSelector deprecation on subclassing and direct instance
2014-01-16 09:53:59 -02:00
Daniel Graña
3e42646ce1
do not test multiple instantation warnings
2014-01-16 09:49:51 -02:00
Hobson Lane
85a80d0752
remove "for brevity's sake" line and correct "Torrent item"
...
Torrent item -> TorrentItem class
2014-01-15 17:29:23 -08:00
Mikhail Korobov
03dab0117d
Merge pull request #536 from manfre/patch-1
...
Fix comment typo
2014-01-15 16:39:33 -08:00
Michael Manfre
4a2a45b495
Fix comment typo
2014-01-15 12:35:34 -05:00
Paul Tremberth
827c0cf51f
Rename "regexp" prefix to "re"
2014-01-15 15:00:25 +01:00
Mikhail Korobov
c92f52ce2c
Merge pull request #525 from alexanderlukanin13/urllib_test_coverage
...
Improved test coverage
2014-01-15 04:05:37 -08:00
Mikhail Korobov
af16fa326f
Merge pull request #533 from chekunkov/make_dupefilter_easily_subclassable
...
Make dupefilter easily subclassable
2014-01-15 03:56:45 -08:00
Paul Tremberth
88c8a523a7
Add warning in docs on performance when using EXSLT regexp functions
2014-01-15 12:52:10 +01:00
Alexander Chekunkov
5411695905
removed request_fingerprint method from BaseDupeFilter, removed unnecessary docstring
2014-01-15 13:44:46 +02:00
Paul Tremberth
a3eba68aca
Drop EXSLT strings and math extensions
2014-01-15 12:28:25 +01:00
Alexander Chekunkov
c2421a4b3f
Added request_fingerprint method to dupefilter classes so they could be easily subclassed without need to override entire request_seen method.
2014-01-15 13:02:05 +02:00
alexanderlukanin13
25759bdf5c
Removed deploy test (as deploy command is deprecated and moved to scrapyd)
2014-01-15 13:09:36 +06:00
alexanderlukanin13
ab6496647c
Added "six>=1.5.2" to requirements
2014-01-15 13:05:00 +06:00
Pablo Hoffman
ea2f897b81
Merge pull request #502 from scrapy/doc-fixes
...
DOWNLOAD_DELAY docs clarification
2014-01-14 21:07:42 -08:00
Hobson Lane
a3db95985b
another import name correction by pablo
2014-01-14 21:04:15 -08:00
Pablo Hoffman
3d308d7732
Merge pull request #517 from hoprocker/patch-1
...
Clarify return value from extract_links
2014-01-14 21:01:32 -08:00
Pablo Hoffman
622ffd84d0
Merge pull request #523 from dangra/warn-xpathitemloader-subclass
...
warn on XPathItemLoader subclassing
2014-01-14 20:58:07 -08:00
Pablo Hoffman
b377d4c28c
Merge pull request #531 from kmike/fix-memdebug
...
Fix logging of stats collected by MemoryDebugger extension.
2014-01-14 20:42:19 -08:00
Mikhail Korobov
26538b01b5
Fix logging of stats collected by MemoryDebugger extension.
...
Stats are printed on spider_closed event;
engine_stopped signal is called after spider_closed signal,
so stats for MemoryDebugger extension were not printed to user.
2014-01-15 04:05:09 +06:00
Daniel Graña
553c70a9dc
Merge pull request #530 from kmike/memusage-osx
...
Fix MemoryUsage extension for OS X
2014-01-14 13:56:02 -08:00
Mikhail Korobov
a83c6f545c
Fix MemoryUsage extension for OS X. Fix GH-529.
2014-01-15 03:24:48 +06:00
Paul Tremberth
2cc26e6f56
Fix typo error
2014-01-14 13:09:18 +01:00
Paul Tremberth
29fc9f3466
Update selectors documentation and tests
2014-01-14 12:56:37 +01:00
Paul Tremberth
5df56a9758
Applying suggestions from previous comments
2014-01-14 12:49:17 +01:00
Paul Tremberth
d46534cc54
Register EXSLT namespaces by default ( resolves #470 )
2014-01-14 12:49:17 +01:00
Pablo Hoffman
62a7b6fe73
Merge pull request #527 from ferdyrod/master
...
Torrent url in the "Scrapy at a glance" doc was removed
2014-01-13 07:06:32 -08:00
Ferdy Rodriguez
807dd25324
fixed error on tor's name
2014-01-13 00:03:58 -06:00
Ferdy Rodriguez
8b9348cfaf
Changed TOR Info as previous was removed from www.mininova.org
2014-01-12 23:46:04 -06:00
alexanderlukanin13
4862a7d7fe
RobotsTxtMiddlewareTest
2014-01-11 17:29:44 +06:00
alexanderlukanin13
a54e31cebc
RegexLinkExtractorTestCase
2014-01-11 15:12:54 +06:00
alexanderlukanin13
968141cd42
test_command_deploy, test_contrib_linkextractors
2014-01-11 14:30:27 +06:00
