Julia Medina
c1634e4914
Add CrawlerProcess to "Running multiple spiders[...]" doc section
2015-04-29 23:09:20 -03:00
Julia Medina
d6a06a769f
Add CrawlerProcess to "Run Scrapy from a script" doc section
2015-04-29 23:09:20 -03:00
Julia Medina
3a71504d35
Extend CrawlerProcess documentation
2015-04-29 23:09:20 -03:00
Julia Medina
a2ce78db63
Use autoclass for CrawlerRunner in docs/topics/api.rst
2015-04-29 23:09:20 -03:00
Julia Medina
b827097c91
Rename scrapy/statscol.py to scrapy/statscollectors.py
2015-04-29 21:36:40 -03:00
Julia Medina
54a4ce069c
Rename scrapy/dupefilter.py to scrapy/dupefilters.py
2015-04-29 21:27:19 -03:00
Julia Medina
645cdcbf9e
Rename scrapy/loader/processor.py to scrapy/loader/processors.py
2015-04-29 21:27:19 -03:00
Julia Medina
9a3e3ba505
Move scrapy/contrib remaining top-level files to scrapy/extensions
2015-04-29 21:27:19 -03:00
Julia Medina
fc346cba4d
Move scrapy/contrib/spiders to scrapy/spiders
2015-04-29 21:27:19 -03:00
Julia Medina
180272c092
Move scrapy/contrib/spidermiddleware to scrapy/spidermiddlewares
2015-04-29 21:26:35 -03:00
Julia Medina
8021df18d4
Move scrapy/contrib/pipeline to scrapy/pipelines
2015-04-29 21:26:35 -03:00
Julia Medina
b47228ada8
Move scrapy/contrib/loader to scrapy/loader
2015-04-29 21:24:30 -03:00
Julia Medina
cf064b1437
Move scrapy/contrib/linkextractors to scrapy/linkextractors
2015-04-29 21:24:30 -03:00
Julia Medina
7804b3d778
Move scrapy/contrib/exporter to scrapy/exporters
2015-04-29 21:24:30 -03:00
Julia Medina
d7c444fefb
Move scrapy/contrib/downloadermiddleware to scrapy/downloadermiddlewares
2015-04-29 21:24:30 -03:00
Wieland Hoffmann
de6501ed1b
Remove a duplicate word
2015-04-29 22:31:48 +02:00
Pablo Hoffman
3d2b74a6ff
Merge pull request #1188 from eliasdorneles/favoring_web_scraping_over_screen_scraping
...
[MRG+1] Favoring web scraping over screen scraping in the descriptions
2015-04-29 16:49:43 -03:00
Elias Dorneles
3d3633f3d2
favoring web scraping over screen scraping in the descriptions
2015-04-25 11:20:20 -03:00
Julia Medina
7a92dae4c8
Change Scrapy log output through docs
2015-04-22 17:27:24 -03:00
Julia Medina
69a3d58110
Basic example on manually configuring log handlers
2015-04-22 17:24:41 -03:00
Julia Medina
bd0b639b21
Fix logging usage across docs
2015-04-22 17:24:41 -03:00
Julia Medina
4811d16f1d
Update logger attr and log method in the Spiders topic on docs
2015-04-22 17:24:41 -03:00
Julia Medina
d47a7edc65
Update Logging topic on docs
2015-04-22 17:24:40 -03:00
Julia Medina
ccdd8bfbcc
Parametrize log formatting strings
2015-04-22 17:24:40 -03:00
Pablo Hoffman
0a5bbbaed3
Merge pull request #1159 from scrapy/feed-export-fields
...
[MRG+1] FEED_EXPORT_FIELDS option
2015-04-21 15:54:24 -03:00
Daniel Graña
e034947b54
Merge pull request #1166 from scrapy/spider-loader
...
[MRG+1] rename SpiderManager to SpiderLoader
2015-04-21 15:42:17 -03:00
Pablo Hoffman
06e1ca9ef2
Merge pull request #1177 from Curita/remove-djangoitem
...
Remove djangoitem
2015-04-21 15:35:47 -03:00
Pablo Hoffman
e4122cdd79
Merge pull request #1150 from eliasdorneles/docs-files-pipeline
...
Documenting Files Pipeline together with Images Pipeline
2015-04-21 15:28:47 -03:00
nyov
7ae37d61f9
remove scrapy deploy command
...
(closes #1027 , #1095 , #1102 )
2015-04-20 20:35:06 -03:00
Mikhail Korobov
1794a893f4
Merge pull request #1172 from bagratte/docs
...
minor corrections in documentation.
2015-04-19 21:41:29 +05:00
Julia Medina
ffc60910aa
Remove djangoitem since we moved it to scrapy/scrapy-djangoitem
2015-04-19 13:09:25 -03:00
bagratte
1312bcd007
minor corrections in documentation.
2015-04-19 18:58:15 +04:00
bagratte
beea9267a1
minor corrections in documentation.
2015-04-18 19:48:25 +04:00
José Ricardo
dffc4549d7
Fix small typo in the docs
2015-04-17 23:37:12 +05:00
Mikhail Korobov
403e7c7c70
rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader
2015-04-16 20:07:53 +05:00
Elias Dorneles
a1f3b3c7f0
images.rst -> media-pipeline.rst
2015-04-15 14:26:08 -03:00
Elias Dorneles
fd1c688ad6
addressing issues from review at #1150
2015-04-15 14:21:48 -03:00
Pablo Hoffman
fb85bd4b10
Merge pull request #1132 from sibiryakov/dns-options2
...
[MRG+1] Dns cache size and timeout options
2015-04-15 14:08:19 -03:00
Mikhail Korobov
cb5280ab0d
DOC tweak deployment docs
2015-04-15 19:25:22 +05:00
Mikhail Korobov
1534e8540b
FEED_EXPORT_FIELDS option
2015-04-15 02:48:26 +05:00
Mikhail Korobov
7644813286
allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects
2015-04-14 23:26:05 +05:00
Daniel Graña
e85679fa6b
Merge pull request #1147 from Curita/pass-crawlers-to-runner-crawl-calls
...
Allow passing Crawler instances directly to CrawlerRunner.crawl()
2015-04-13 14:23:15 -03:00
Daniel Graña
f71175a449
More replaces of references to old sel shortcut
2015-04-12 21:56:23 -03:00
Diana Huang
91a60d9f3d
Remove references to the sel object in shell.rst
...
The current documentation has references to the deprecated `sel` when interacting with the shell. I've removed them and replaced uses of `sel.xpath` with `response.xpath` instead.
2015-04-12 13:44:32 -04:00
Elias Dorneles
dce48b8654
documenting Files Pipeline together with Images Pipeline
2015-04-11 13:57:55 -03:00
Julia Medina
3dabde6706
Update docs for CrawlerRunner.crawl() new usage
2015-04-10 12:09:07 -03:00
Julia Medina
86b0951327
Delete crawler_deferreds doc in CrawlerRunner
...
This attribute is now an internal one since it's main use-case was
covered by CrawlerRunner.stop().
2015-04-10 12:06:27 -03:00
Pablo Hoffman
39fd2e62ef
fix typo in deploy.rst
2015-04-09 18:01:11 -03:00
Pablo Hoffman
1a12922b77
improve scrapy deploy documentation
2015-04-09 17:39:01 -03:00
Pablo Hoffman
9ea309c354
rename deployment.rst -> deploy.rst (consist with others like debug.rst)
2015-04-09 16:56:35 -03:00
