1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-26 13:04:01 +00:00

4617 Commits

Author SHA1 Message Date
Pablo Hoffman
4c4eb4f77d Merge pull request #1180 from eliasdorneles/tutorial-improvements
Some improvements for Scrapy tutorial
2015-04-21 15:49:39 -03:00
Daniel Graña
e034947b54 Merge pull request #1166 from scrapy/spider-loader
[MRG+1] rename SpiderManager to SpiderLoader
2015-04-21 15:42:17 -03:00
Pablo Hoffman
06e1ca9ef2 Merge pull request #1177 from Curita/remove-djangoitem
Remove djangoitem
2015-04-21 15:35:47 -03:00
Pablo Hoffman
e4122cdd79 Merge pull request #1150 from eliasdorneles/docs-files-pipeline
Documenting Files Pipeline together with Images Pipeline
2015-04-21 15:28:47 -03:00
Elias Dorneles
d63567531d change data extraction in crawl example to be consistent with tutorial, removed statement implying mandatory usage of Item 2015-04-21 11:30:48 -03:00
Elias Dorneles
f7da69d116 fixing example CSS expr 2015-04-21 11:19:10 -03:00
Elias Dorneles
ff007afb9d expanded crawling primer with examples, and applied other suggestions from the review 2015-04-21 10:57:44 -03:00
Mikhail Korobov
c8ccb7c5b9 Merge pull request #722 from Digenis/loader-iteration
[MRG +1]ItemLoader.load_item: iterate over copy of fields
2015-04-21 12:34:59 +05:00
Elias Dorneles
595146e158 some improvements for Scrapy tutorial 2015-04-20 21:10:07 -03:00
Julia Medina
0bf1ec160d Merge branch 'nyov/remove-deploy' from pull request #1102 2015-04-20 20:36:33 -03:00
nyov
7ae37d61f9 remove scrapy deploy command
(closes #1027, #1095, #1102)
2015-04-20 20:35:06 -03:00
Julia Medina
6da091f162 Remove djangoitem topic from index 2015-04-20 20:19:28 -03:00
Nikolaos-Digenis Karagiannis
d39722f6a3 ItemLoader.load_item: iterate over copy of fields 2015-04-20 11:05:56 +03:00
Nikolaos-Digenis Karagiannis
017fb25bee loader test with processors that use item's values 2015-04-20 11:04:31 +03:00
Daniel Graña
16a1a938c1 Add 0.24.6 release notes 2015-04-20 01:40:21 -03:00
Mikhail Korobov
1794a893f4 Merge pull request #1172 from bagratte/docs
minor corrections in documentation.
2015-04-19 21:41:29 +05:00
Julia Medina
ffc60910aa Remove djangoitem since we moved it to scrapy/scrapy-djangoitem 2015-04-19 13:09:25 -03:00
bagratte
1312bcd007 minor corrections in documentation. 2015-04-19 18:58:15 +04:00
bagratte
beea9267a1 minor corrections in documentation. 2015-04-18 19:48:25 +04:00
Mikhail Korobov
bb4c8c33cc Merge pull request #1171 from rajathkumarmp/edit-doc
Added link to ipython in Tutorial.
2015-04-18 14:13:10 +05:00
rajathkumarmp
02629b5f7b Added link to ipython in doc. 2015-04-18 13:00:34 +05:30
Pablo Hoffman
757309efea Merge pull request #1169 from bagratte/docs
add some minor stylistic and grammar corrections to tutorial.rst.
2015-04-17 19:52:11 -03:00
José Ricardo
dffc4549d7 Fix small typo in the docs 2015-04-17 23:37:12 +05:00
bagratte
8d339da4e5 add some minor stylistic and grammar corrections to tutorial.rst. 2015-04-17 20:55:02 +04:00
Mikhail Korobov
ad587ea792 rename CrawlerRunner.spiders to CrawlerRunner.spider_loader 2015-04-17 01:54:26 +05:00
Mikhail Korobov
fee5565709 don't expose deprecated crawler.spiders attribute in telnet console 2015-04-17 01:25:48 +05:00
Mikhail Korobov
403e7c7c70 rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader 2015-04-16 20:07:53 +05:00
Elias Dorneles
a1f3b3c7f0 images.rst -> media-pipeline.rst 2015-04-15 14:26:08 -03:00
Elias Dorneles
fd1c688ad6 addressing issues from review at #1150 2015-04-15 14:21:48 -03:00
Pablo Hoffman
fb85bd4b10 Merge pull request #1132 from sibiryakov/dns-options2
[MRG+1] Dns cache size and timeout options
2015-04-15 14:08:19 -03:00
Pablo Hoffman
20c8d712de Merge pull request #1164 from scrapy/deploy-docs-2
deployment docs tweaks
2015-04-15 13:57:51 -03:00
Mikhail Korobov
cb5280ab0d DOC tweak deployment docs 2015-04-15 19:25:22 +05:00
Nicolás Alejandro Ramírez Quiros
e054b3c45f Merge pull request #1160 from scrapy/docs-theme
Change local docs theme
2015-04-15 10:34:19 -03:00
Mikhail Korobov
a11bd3e89d DOC update docs readme file - sphinx >= 1.3 is now required. 2015-04-15 11:50:57 +05:00
Julia Medina
526aa07f44 Merge pull request #1156 from kmike/crawlers-accept-dicts
allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects
2015-04-15 02:15:32 -03:00
Daniel Graña
c013baa602 Merge pull request #1161 from scrapy/telnet-disable
disable scrapy.telnet if twisted.conch is not available
2015-04-15 00:32:42 -03:00
Daniel Graña
e3aaeb7f06 Merge pull request #1162 from kmike/ajaxcrawl-py3
fix Python 3 syntax errors in ajaxcrawl.py
2015-04-15 00:32:03 -03:00
Mikhail Korobov
0b76487629 PY3 fix Python 3 syntax errors in ajaxcrawl.py
Tests for _has_ajaxcrawlable_meta passin Python 3.
2015-04-15 04:16:26 +05:00
Mikhail Korobov
378b6efc0e PY3 disable scrapy.telnet if twisted.conch is not available 2015-04-15 04:06:36 +05:00
Mikhail Korobov
f40587c661 Merge pull request #1131 from torymur/master
Fix #1130
2015-04-15 03:52:07 +05:00
Mikhail Korobov
dd84f4bd9a DOC remove css file which isno longer needed 2015-04-15 03:44:49 +05:00
Mikhail Korobov
7dcd7f3ca7 DOC make local docs use the same theme as readthedocs.org
sphinx_rtd_theme is builtin in recent Sphinx versions.
2015-04-15 03:43:30 +05:00
Mikhail Korobov
7644813286 allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects 2015-04-14 23:26:05 +05:00
Nicolás Alejandro Ramírez Quiros
c2c8098562 Merge pull request #1155 from kmike/remove-deprecated
remove deprecated code from FeedExporter
2015-04-14 14:09:10 -03:00
Mikhail Korobov
5436ba117b remove deprecated code from FeedExporter 2015-04-14 20:19:28 +05:00
Pablo Hoffman
71c0aface7 Merge pull request #1148 from Curita/verify-spidermanager-interface
Verify SPIDER_MANAGER_CLASS interface while loading it in CrawlerRunner
2015-04-13 14:25:32 -03:00
Daniel Graña
e85679fa6b Merge pull request #1147 from Curita/pass-crawlers-to-runner-crawl-calls
Allow passing Crawler instances directly to CrawlerRunner.crawl()
2015-04-13 14:23:15 -03:00
Julia Medina
5af557e610 Merge pull request #1152 from jdemaeyer/fix/tests-settings-api
Fix deprecated settings API in tests
2015-04-12 23:56:40 -03:00
Daniel Graña
f71175a449 More replaces of references to old sel shortcut 2015-04-12 21:56:23 -03:00
Daniel Graña
f9208dbcc4 Merge pull request #1154 from dianakhuang/patch-2
Remove references to the `sel` object in shell.rst
2015-04-12 21:55:35 -03:00