Mikhail Korobov
7dcd7f3ca7
DOC make local docs use the same theme as readthedocs.org
...
sphinx_rtd_theme is builtin in recent Sphinx versions.
2015-04-15 03:43:30 +05:00
Nicolás Alejandro Ramírez Quiros
c2c8098562
Merge pull request #1155 from kmike/remove-deprecated
...
remove deprecated code from FeedExporter
2015-04-14 14:09:10 -03:00
Mikhail Korobov
5436ba117b
remove deprecated code from FeedExporter
2015-04-14 20:19:28 +05:00
Pablo Hoffman
71c0aface7
Merge pull request #1148 from Curita/verify-spidermanager-interface
...
Verify SPIDER_MANAGER_CLASS interface while loading it in CrawlerRunner
2015-04-13 14:25:32 -03:00
Daniel Graña
e85679fa6b
Merge pull request #1147 from Curita/pass-crawlers-to-runner-crawl-calls
...
Allow passing Crawler instances directly to CrawlerRunner.crawl()
2015-04-13 14:23:15 -03:00
Julia Medina
5af557e610
Merge pull request #1152 from jdemaeyer/fix/tests-settings-api
...
Fix deprecated settings API in tests
2015-04-12 23:56:40 -03:00
Daniel Graña
f71175a449
More replaces of references to old sel shortcut
2015-04-12 21:56:23 -03:00
Daniel Graña
f9208dbcc4
Merge pull request #1154 from dianakhuang/patch-2
...
Remove references to the `sel` object in shell.rst
2015-04-12 21:55:35 -03:00
Diana Huang
91a60d9f3d
Remove references to the sel object in shell.rst
...
The current documentation has references to the deprecated `sel` when interacting with the shell. I've removed them and replaced uses of `sel.xpath` with `response.xpath` instead.
2015-04-12 13:44:32 -04:00
Jakob de Maeyer
cf9d848f0f
Fixed deprecated settings API in cmdline test
2015-04-12 14:18:47 +02:00
Mikhail Korobov
6f000b8cd4
Merge pull request #952 from Digenis/unicode_xpath_exception
...
[MRG+1] encode unicode selector exception
2015-04-11 00:38:42 +05:00
Nikolaos-Digenis Karagiannis
bf301b7328
encode invalid xpath with unicode_escape under PY2
...
The exception quotes an xpath string
which may be unicode.
2015-04-10 22:23:40 +03:00
Julia Medina
24a07fd892
Verify SPIDER_MANAGER_CLASS interface in CrawlerRunner
2015-04-10 13:43:33 -03:00
Julia Medina
3dabde6706
Update docs for CrawlerRunner.crawl() new usage
2015-04-10 12:09:07 -03:00
Julia Medina
86b0951327
Delete crawler_deferreds doc in CrawlerRunner
...
This attribute is now an internal one since it's main use-case was
covered by CrawlerRunner.stop().
2015-04-10 12:06:27 -03:00
Julia Medina
bc70584344
Support crawlers as first positional arg in CrawlerRunner.crawl()
2015-04-10 11:52:57 -03:00
Julia Medina
f8ca5d1092
Merge pull request #1134 from nyov/remove-contrib
...
[MRG+1] dissolve contrib_exp
2015-04-10 10:33:43 -03:00
Julia Medina
543d02bc64
Avoid name clashing in deploy.py, fixes #1143
2015-04-09 21:36:24 -03:00
Pablo Hoffman
39fd2e62ef
fix typo in deploy.rst
2015-04-09 18:01:11 -03:00
Pablo Hoffman
1a12922b77
improve scrapy deploy documentation
2015-04-09 17:39:01 -03:00
Pablo Hoffman
9ea309c354
rename deployment.rst -> deploy.rst (consist with others like debug.rst)
2015-04-09 16:56:35 -03:00
Pablo Hoffman
d8184a7239
Merge pull request #1124 from rdowinton/deployment-doc
...
Added deployment section covering scrapyd-deploy and shub
2015-04-09 16:53:25 -03:00
nyov
6d48c19acd
dissolve scrapy.contrib_exp
2015-04-07 21:20:48 +00:00
Pablo Hoffman
4b11501eb5
Merge pull request #963 from tpeng/fix-xmliter-lxml
...
[MRG+1] support namespace prefix in xmliter_lxml
2015-04-07 18:13:01 -03:00
Daniel Graña
9706119336
Merge pull request #1128 from Curita/move-spider-settings-population-to-crawler
...
[MRG+1] Move spider settings population from CrawlerRunner to Crawler.__init__
2015-04-04 18:08:05 -03:00
Julia Medina
fcf97001a5
Merge pull request #1121 from nyov/nyov/py3-urllib
...
[MRG+1] more python3 compatibility changes for urllib
2015-04-02 22:33:43 -03:00
Julia Medina
6f9265b44b
Move spider settings population to Crawler.__init__
2015-04-01 23:29:10 -03:00
Julia Medina
66aef0488a
Merge pull request #1127 from nyov/docs-fix
...
documentation build warning fixes
2015-04-01 17:02:28 -03:00
nyov
dc88be75e2
more python3 compatibility changes for urllib
2015-04-01 19:50:56 +00:00
nyov
92b574309e
documentation build warning fixes
2015-04-01 19:46:21 +00:00
Daniel Graña
27591b55fc
Merge pull request #1123 from sibiryakov/reactor-threadpool-size
...
[MRG+1] Reactor threadpool max size setting
2015-04-01 15:08:03 -03:00
Alexander Sibiryakov
b794cdaf4b
Broad crawls notes.
2015-04-01 12:07:03 +02:00
Alexander Sibiryakov
e7b274edf3
Reformat to 80 characters per line.
2015-04-01 11:49:55 +02:00
Alexander Sibiryakov
94fceb4c15
Fixing underscore size.
2015-04-01 11:25:10 +02:00
Alexander Sibiryakov
5916df64cd
Removing unnecessary import.
2015-04-01 11:24:12 +02:00
Daniel Graña
ec4251afd7
Merge pull request #1089 from drack3800/master
...
[MRG+1] Add test for webclient with POST method and no body given
2015-03-31 17:30:08 -03:00
Richard Dowinton
2d142d6401
Added deployment section covering scrapyd-deploy and shub
2015-03-31 12:17:31 +01:00
Alexander Sibiryakov
5864d291d4
Setting documentation.
2015-03-31 11:10:56 +02:00
Alexander Sibiryakov
c1cd019f56
Setting maximum thread pool size in reactor.
2015-03-31 10:56:31 +02:00
Elias Dorneles
0c74821805
Merge pull request #1112 from eliasdorneles/minor-grammar-fixes
...
Some minor grammar fixes
2015-03-27 21:23:55 -03:00
Elias Dorneles
18c5bc75c2
some more minor grammar fixes
2015-03-27 21:00:21 -03:00
Elias Dorneles
7135c4e694
some minor grammar fixes
2015-03-27 17:56:56 -03:00
Nicolás Alejandro Ramírez Quiros
a3702e749f
Merge pull request #1073 from eliasdorneles/add-more-settings-to-template
...
[MRG+1] Adding more settings to project template
2015-03-27 15:37:26 -03:00
Pablo Hoffman
bb4c922d85
Merge pull request #1081 from scrapy/dict-items
...
Allow spiders to return dicts.
2015-03-27 15:19:27 -03:00
Daniel Graña
55a23d102f
Merge pull request #1086 from Curita/response-urljoin
...
Add Response.urljoin() helper
2015-03-27 15:17:54 -03:00
Julia Medina
f4e241a018
Merge pull request #1106 from eliasdorneles/overview-page-improvements
...
[MRG+1] some improvements to overview page
2015-03-27 15:16:33 -03:00
nyov
84edc2ebc7
Add Response.urljoin() testcase
...
and add evaluation of base-url for HtmlResponse.
2015-03-27 05:59:01 +00:00
Mikhail Korobov
39085ae18f
Merge pull request #1098 from nyov/nyov/userconfig
...
[+1 MRG]look in ~/.config/scrapy.cfg for user config
2015-03-27 02:11:35 +05:00
nyov
1134a9cab0
config: look in ~/.config/scrapy.cfg as well
2015-03-26 20:36:14 +00:00
Mikhail Korobov
1ce0425542
Merge pull request #1108 from pbronez/master
...
Converted sel.xpath() calls to response.xpath() in Extracting the data. Fixes GH-1107.
2015-03-27 00:52:17 +05:00
