1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 04:23:45 +00:00

1017 Commits

Author SHA1 Message Date
nyov
7ae37d61f9 remove scrapy deploy command
(closes #1027, #1095, #1102)
2015-04-20 20:35:06 -03:00
Daniel Graña
16a1a938c1 Add 0.24.6 release notes 2015-04-20 01:40:21 -03:00
Mikhail Korobov
1794a893f4 Merge pull request #1172 from bagratte/docs
minor corrections in documentation.
2015-04-19 21:41:29 +05:00
bagratte
1312bcd007 minor corrections in documentation. 2015-04-19 18:58:15 +04:00
bagratte
beea9267a1 minor corrections in documentation. 2015-04-18 19:48:25 +04:00
rajathkumarmp
02629b5f7b Added link to ipython in doc. 2015-04-18 13:00:34 +05:30
Pablo Hoffman
757309efea Merge pull request #1169 from bagratte/docs
add some minor stylistic and grammar corrections to tutorial.rst.
2015-04-17 19:52:11 -03:00
José Ricardo
dffc4549d7 Fix small typo in the docs 2015-04-17 23:37:12 +05:00
bagratte
8d339da4e5 add some minor stylistic and grammar corrections to tutorial.rst. 2015-04-17 20:55:02 +04:00
Pablo Hoffman
fb85bd4b10 Merge pull request #1132 from sibiryakov/dns-options2
[MRG+1] Dns cache size and timeout options
2015-04-15 14:08:19 -03:00
Mikhail Korobov
cb5280ab0d DOC tweak deployment docs 2015-04-15 19:25:22 +05:00
Nicolás Alejandro Ramírez Quiros
e054b3c45f Merge pull request #1160 from scrapy/docs-theme
Change local docs theme
2015-04-15 10:34:19 -03:00
Mikhail Korobov
a11bd3e89d DOC update docs readme file - sphinx >= 1.3 is now required. 2015-04-15 11:50:57 +05:00
Mikhail Korobov
dd84f4bd9a DOC remove css file which isno longer needed 2015-04-15 03:44:49 +05:00
Mikhail Korobov
7dcd7f3ca7 DOC make local docs use the same theme as readthedocs.org
sphinx_rtd_theme is builtin in recent Sphinx versions.
2015-04-15 03:43:30 +05:00
Mikhail Korobov
7644813286 allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects 2015-04-14 23:26:05 +05:00
Daniel Graña
e85679fa6b Merge pull request #1147 from Curita/pass-crawlers-to-runner-crawl-calls
Allow passing Crawler instances directly to CrawlerRunner.crawl()
2015-04-13 14:23:15 -03:00
Daniel Graña
f71175a449 More replaces of references to old sel shortcut 2015-04-12 21:56:23 -03:00
Diana Huang
91a60d9f3d Remove references to the sel object in shell.rst
The current documentation has references to the deprecated `sel` when interacting with the shell. I've removed them and replaced uses of `sel.xpath` with `response.xpath` instead.
2015-04-12 13:44:32 -04:00
Julia Medina
3dabde6706 Update docs for CrawlerRunner.crawl() new usage 2015-04-10 12:09:07 -03:00
Julia Medina
86b0951327 Delete crawler_deferreds doc in CrawlerRunner
This attribute is now an internal one since it's main use-case was
covered by CrawlerRunner.stop().
2015-04-10 12:06:27 -03:00
Pablo Hoffman
39fd2e62ef fix typo in deploy.rst 2015-04-09 18:01:11 -03:00
Pablo Hoffman
1a12922b77 improve scrapy deploy documentation 2015-04-09 17:39:01 -03:00
Pablo Hoffman
9ea309c354 rename deployment.rst -> deploy.rst (consist with others like debug.rst) 2015-04-09 16:56:35 -03:00
Pablo Hoffman
d8184a7239 Merge pull request #1124 from rdowinton/deployment-doc
Added deployment section covering scrapyd-deploy and shub
2015-04-09 16:53:25 -03:00
Alexander Sibiryakov
85aa3c7596 Dns cache size and timeout options 2015-04-02 18:30:59 +02:00
nyov
92b574309e documentation build warning fixes 2015-04-01 19:46:21 +00:00
Daniel Graña
27591b55fc Merge pull request #1123 from sibiryakov/reactor-threadpool-size
[MRG+1] Reactor threadpool max size setting
2015-04-01 15:08:03 -03:00
Alexander Sibiryakov
b794cdaf4b Broad crawls notes. 2015-04-01 12:07:03 +02:00
Alexander Sibiryakov
e7b274edf3 Reformat to 80 characters per line. 2015-04-01 11:49:55 +02:00
Alexander Sibiryakov
94fceb4c15 Fixing underscore size. 2015-04-01 11:25:10 +02:00
Richard Dowinton
2d142d6401 Added deployment section covering scrapyd-deploy and shub 2015-03-31 12:17:31 +01:00
Alexander Sibiryakov
5864d291d4 Setting documentation. 2015-03-31 11:10:56 +02:00
Elias Dorneles
18c5bc75c2 some more minor grammar fixes 2015-03-27 21:00:21 -03:00
Elias Dorneles
7135c4e694 some minor grammar fixes 2015-03-27 17:56:56 -03:00
Pablo Hoffman
bb4c922d85 Merge pull request #1081 from scrapy/dict-items
Allow spiders to return dicts.
2015-03-27 15:19:27 -03:00
Daniel Graña
55a23d102f Merge pull request #1086 from Curita/response-urljoin
Add Response.urljoin() helper
2015-03-27 15:17:54 -03:00
Julia Medina
f4e241a018 Merge pull request #1106 from eliasdorneles/overview-page-improvements
[MRG+1] some improvements to overview page
2015-03-27 15:16:33 -03:00
Mikhail Korobov
39085ae18f Merge pull request #1098 from nyov/nyov/userconfig
[+1 MRG]look in ~/.config/scrapy.cfg for user config
2015-03-27 02:11:35 +05:00
nyov
1134a9cab0 config: look in ~/.config/scrapy.cfg as well 2015-03-26 20:36:14 +00:00
Peter Bronez
475766c73a Converted sel.xpath() calls to response.xpath() in Extracting the data 2015-03-26 15:34:30 -04:00
Elias Dorneles
4dcecc98f9 moved example data to a better place 2015-03-26 15:45:17 -03:00
Elias Dorneles
7402e27230 fix community link 2015-03-26 15:35:31 -03:00
Elias Dorneles
729861c864 fixing indentation 2015-03-26 15:31:42 -03:00
Elias Dorneles
13d0ecde77 addressing more review comments, to avoid ambiguity on desired reading flow 2015-03-26 15:26:16 -03:00
Elias Dorneles
76e3bf1250 addressing comments from the review plus further editing 2015-03-26 14:26:20 -03:00
Elias Dorneles
8f4a268f37 added bit about async requests, improved phrasing 2015-03-26 12:14:56 -03:00
Elias Dorneles
32423d4a33 some improvements to overview page 2015-03-25 19:27:52 -03:00
Ramiro Morales
933dbc6be6 Oops 2015-03-25 18:33:17 -03:00
Ramiro Morales
ca2575001e Add missing callback arg in jobs topic example. 2015-03-25 18:32:20 -03:00