Dan
|
1ca31244b0
|
Fixed ordering of super argument call.
|
2013-07-16 14:50:10 -04:00 |
|
Dan
|
e12b689c4f
|
Updated documentation of spider arguments to include required super call.
|
2013-07-16 14:26:53 -04:00 |
|
Daniel Graña
|
891fa980d2
|
Merge pull request #341 from kmike/test-running
Improved tox test running & fixed django tests
|
2013-07-16 11:16:43 -07:00 |
|
Daniel Graña
|
66aa1331fc
|
Twisted pre 10.2 (lucid) can not setup the required ftp server for tests
|
2013-07-16 00:49:35 -03:00 |
|
Daniel Graña
|
26c7ec7d9f
|
Merge pull request #329 from kalessin/ftphandler
added ftp handler
|
2013-07-15 16:39:46 -07:00 |
|
Daniel Graña
|
f8c105d5c5
|
Merge branch 'gh-347'. thanks @chrisboo
|
2013-07-15 12:28:24 -03:00 |
|
Daniel Graña
|
9ff82d6695
|
use lxml parser with recover option to parse invalid sitemaps. closes #347
thanks chrissboo for reporting the issue and proposing a fix.
|
2013-07-15 12:26:16 -03:00 |
|
Mikhail Korobov
|
1a1c93fafe
|
tiny FormRequest doc fix
|
2013-07-15 15:47:34 +06:00 |
|
Daniel Graña
|
aa7b529975
|
do not log Starting/Stopping factory messages
|
2013-07-10 12:35:15 -03:00 |
|
Mikhail Korobov
|
3fe2a32683
|
handle GET parameters for AJAX crawlable URLs:
|
2013-07-09 01:58:50 +06:00 |
|
Mikhail Korobov
|
8c555fd467
|
Enable Travis CI for pull requests and feature branches. Fix GH-340.
|
2013-07-09 01:50:52 +06:00 |
|
Mikhail Korobov
|
0d9f7843ba
|
allow passing arguments to runtests script via tox
|
2013-07-09 00:41:13 +06:00 |
|
Mikhail Korobov
|
f29e5d0ca1
|
reuse runtests.sh and runtests.bat scripts in tox.ini
|
2013-07-09 00:38:00 +06:00 |
|
Mikhail Korobov
|
3a6dff3090
|
make tox test running more consistent with bin/runtests.sh script
|
2013-07-09 00:30:39 +06:00 |
|
Mikhail Korobov
|
2105ec58eb
|
add django to test requirements and fix test_djangoitem for modern django versions
|
2013-07-09 00:28:39 +06:00 |
|
Mikhail Korobov
|
b98e80cbb8
|
use tox deps instead of "manual" pip install; add lucid and precise environments to tox.ini
|
2013-07-09 00:26:59 +06:00 |
|
Mikhail Korobov
|
35fbec2e63
|
allow passing arguments to tox
e.g. "tox -- scrapy.tests.test_contrib_loader" runs test_contrib_loader for Python 2.6 and 2.7
|
2013-07-08 22:51:03 +06:00 |
|
Daniel Graña
|
6db259c075
|
Merge pull request #338 from kmike/patch-3
DownloaderMiddleware docs fix
|
2013-07-08 07:12:42 -07:00 |
|
Mikhail Korobov
|
ac2fadf3ab
|
DownloaderMiddleware.process_response docs fix
"returns an exception" -> "raises an exception"
|
2013-07-08 19:41:58 +06:00 |
|
Pablo Hoffman
|
9a13a0fe74
|
Merge pull request #337 from kmike/patch-2
improve docs for DownloaderMiddleware.process_response
|
2013-07-08 06:21:49 -07:00 |
|
Mikhail Korobov
|
39e5da5f66
|
improve docs for DownloaderMiddleware.process_response
|
2013-07-08 19:17:29 +06:00 |
|
Pablo Hoffman
|
163592ee40
|
Merge pull request #334 from nramirezuy/feedexport-remove_multispider
feedexport removed multispider support
|
2013-07-03 14:26:49 -07:00 |
|
nramirezuy
|
1fc2bc3489
|
feedexport removed multispider support
|
2013-07-03 18:24:18 -03:00 |
|
Pablo Hoffman
|
42da57c448
|
Merge pull request #333 from nramirezuy/mediapipe-remove_multispider
pipeline media removed multispider support
|
2013-07-03 14:20:41 -07:00 |
|
Pablo Hoffman
|
6533115bbb
|
Merge pull request #332 from nramirezuy/offsite-remove_multispider
offsite multispider support removed
|
2013-07-03 14:20:06 -07:00 |
|
nramirezuy
|
2abb9d08cb
|
pipeline media removed multispider support
|
2013-07-03 18:08:15 -03:00 |
|
nramirezuy
|
07969a9f3b
|
offsite multispider support removed
|
2013-07-03 17:55:20 -03:00 |
|
Daniel Graña
|
06b9702984
|
increase delay in test to avoid small time differences
|
2013-06-27 17:10:27 -03:00 |
|
Martin Olveyra
|
1af47165b4
|
added ftp handler
|
2013-06-27 16:52:59 -02:00 |
|
Pablo Hoffman
|
0f4b70f582
|
remove no deprecated request_scheduled signal
It will be replaced by more accurate scheduler signals (proposal will
come soon)
|
2013-06-27 11:23:24 -03:00 |
|
Pablo Hoffman
|
a2ddfab43b
|
Merge pull request #328 from nramirezuy/signals-request_scheduled
removed request_received and added request_scheduled
|
2013-06-27 07:21:48 -07:00 |
|
nramirezuy
|
bef8ade956
|
removed request_received and added request_scheduled
|
2013-06-26 16:45:46 -03:00 |
|
Pablo Hoffman
|
819b2776dd
|
Merge pull request #326 from berendiwema/master
Include example of how to stop the reactor from script
|
2013-06-25 13:30:07 -07:00 |
|
nramirezuy
|
83b2774354
|
remove wrong default httpcache
|
2013-06-25 17:01:29 -03:00 |
|
Daniel Graña
|
e06836ff48
|
fix import of deprecated http handler for S3 handler
|
2013-06-25 14:34:43 -03:00 |
|
Daniel Graña
|
22da89b748
|
callLater must happens before timeout callback is added to avoid AttributeError
|
2013-06-25 12:45:48 -03:00 |
|
Berend Iwema
|
aec314db09
|
added a bit more documentation on how to close the reactor when running scrapy from a script
|
2013-06-25 16:08:22 +02:00 |
|
Pablo Hoffman
|
bbde1d0e0b
|
Merge pull request #275 from stav/doc
doc: Response.replace() cannot take meta argument
|
2013-06-24 11:09:28 -07:00 |
|
Daniel Graña
|
7af94be3a9
|
fix helpers used to sign S3 requests with boto connections
|
2013-06-20 10:56:48 -03:00 |
|
Daniel Graña
|
7a4c012db4
|
show a meaningful skip message for image tests
|
2013-06-20 10:51:59 -03:00 |
|
Daniel Graña
|
de57e27d81
|
do not skip image tests and set a fixed pyOpenSSL version
|
2013-06-20 10:44:20 -03:00 |
|
Daniel Graña
|
26809d2254
|
fix download_timeout for servers that returns response headers but hangs sending its body
|
2013-06-20 10:15:23 -03:00 |
|
Daniel Graña
|
133091af3a
|
rename http11 handler methods and split latency and timeout check
|
2013-06-19 16:23:51 -03:00 |
|
Daniel Graña
|
1e1b161671
|
Merge pull request #321 from barraponto/document_crawlspider_parse_start_urls
Document CrawlSpider.parse_start_urls method
|
2013-06-10 06:20:16 -07:00 |
|
Capi Etheriel
|
50fa46d183
|
Document CrawlSpider.parse_start_urls method
|
2013-06-09 04:03:20 -03:00 |
|
Pablo Hoffman
|
5a097cc192
|
log optional features available on startup
|
2013-06-04 19:25:26 -03:00 |
|
Daniel Graña
|
8ea041528f
|
Merge pull request #318 from scrapy/http11
Add HTTP 1.1 download handler
|
2013-06-04 14:34:54 -07:00 |
|
Daniel Graña
|
e7acc2171d
|
show deprecation warning for HttpDownloadHandler
|
2013-06-04 17:28:43 -03:00 |
|
Daniel Graña
|
cf10474b8b
|
improve twisted version tests and enable HTTP11 handler by default if supported
|
2013-06-04 16:59:35 -03:00 |
|
Daniel Graña
|
bb806fa0f8
|
restore http10 as default handler and skip tests if http1.1 is not supported
|
2013-06-04 16:36:21 -03:00 |
|