Nikolaos-Digenis Karagiannis
017fb25bee
loader test with processors that use item's values
2015-04-20 11:04:31 +03:00
Daniel Graña
16a1a938c1
Add 0.24.6 release notes
2015-04-20 01:40:21 -03:00
Mikhail Korobov
1794a893f4
Merge pull request #1172 from bagratte/docs
...
minor corrections in documentation.
2015-04-19 21:41:29 +05:00
Julia Medina
ffc60910aa
Remove djangoitem since we moved it to scrapy/scrapy-djangoitem
2015-04-19 13:09:25 -03:00
bagratte
1312bcd007
minor corrections in documentation.
2015-04-19 18:58:15 +04:00
bagratte
beea9267a1
minor corrections in documentation.
2015-04-18 19:48:25 +04:00
Mikhail Korobov
bb4c8c33cc
Merge pull request #1171 from rajathkumarmp/edit-doc
...
Added link to ipython in Tutorial.
2015-04-18 14:13:10 +05:00
rajathkumarmp
02629b5f7b
Added link to ipython in doc.
2015-04-18 13:00:34 +05:30
Pablo Hoffman
757309efea
Merge pull request #1169 from bagratte/docs
...
add some minor stylistic and grammar corrections to tutorial.rst.
2015-04-17 19:52:11 -03:00
José Ricardo
dffc4549d7
Fix small typo in the docs
2015-04-17 23:37:12 +05:00
bagratte
8d339da4e5
add some minor stylistic and grammar corrections to tutorial.rst.
2015-04-17 20:55:02 +04:00
Mikhail Korobov
ad587ea792
rename CrawlerRunner.spiders to CrawlerRunner.spider_loader
2015-04-17 01:54:26 +05:00
Mikhail Korobov
fee5565709
don't expose deprecated crawler.spiders attribute in telnet console
2015-04-17 01:25:48 +05:00
Mikhail Korobov
271f7f54d5
TST install service_identity package in tests to prevent warnings
...
Also, Twisted version is bumped for Python 3.x tests, just in case.
service_identity is not added to Scrapy requirements because Scrapy
supports older Twisted / PyOpenSSL versions which don't use it.
2015-04-16 22:54:51 +05:00
Mikhail Korobov
403e7c7c70
rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader
2015-04-16 20:07:53 +05:00
Elias Dorneles
a1f3b3c7f0
images.rst -> media-pipeline.rst
2015-04-15 14:26:08 -03:00
Elias Dorneles
fd1c688ad6
addressing issues from review at #1150
2015-04-15 14:21:48 -03:00
Pablo Hoffman
fb85bd4b10
Merge pull request #1132 from sibiryakov/dns-options2
...
[MRG+1] Dns cache size and timeout options
2015-04-15 14:08:19 -03:00
Pablo Hoffman
20c8d712de
Merge pull request #1164 from scrapy/deploy-docs-2
...
deployment docs tweaks
2015-04-15 13:57:51 -03:00
Mikhail Korobov
cb5280ab0d
DOC tweak deployment docs
2015-04-15 19:25:22 +05:00
Nicolás Alejandro Ramírez Quiros
e054b3c45f
Merge pull request #1160 from scrapy/docs-theme
...
Change local docs theme
2015-04-15 10:34:19 -03:00
Mikhail Korobov
a11bd3e89d
DOC update docs readme file - sphinx >= 1.3 is now required.
2015-04-15 11:50:57 +05:00
Julia Medina
526aa07f44
Merge pull request #1156 from kmike/crawlers-accept-dicts
...
allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects
2015-04-15 02:15:32 -03:00
Daniel Graña
c013baa602
Merge pull request #1161 from scrapy/telnet-disable
...
disable scrapy.telnet if twisted.conch is not available
2015-04-15 00:32:42 -03:00
Daniel Graña
e3aaeb7f06
Merge pull request #1162 from kmike/ajaxcrawl-py3
...
fix Python 3 syntax errors in ajaxcrawl.py
2015-04-15 00:32:03 -03:00
Mikhail Korobov
0b76487629
PY3 fix Python 3 syntax errors in ajaxcrawl.py
...
Tests for _has_ajaxcrawlable_meta passin Python 3.
2015-04-15 04:16:26 +05:00
Mikhail Korobov
378b6efc0e
PY3 disable scrapy.telnet if twisted.conch is not available
2015-04-15 04:06:36 +05:00
Mikhail Korobov
f40587c661
Merge pull request #1131 from torymur/master
...
Fix #1130
2015-04-15 03:52:07 +05:00
Mikhail Korobov
dd84f4bd9a
DOC remove css file which isno longer needed
2015-04-15 03:44:49 +05:00
Mikhail Korobov
7dcd7f3ca7
DOC make local docs use the same theme as readthedocs.org
...
sphinx_rtd_theme is builtin in recent Sphinx versions.
2015-04-15 03:43:30 +05:00
Mikhail Korobov
abeb8e3a01
TST skip a test in Python 3 because it imports some parts of Twisted which are not ported yet
2015-04-15 03:27:11 +05:00
Mikhail Korobov
647eeaea61
TST add a test for GH-1050.
2015-04-15 03:23:30 +05:00
Mikhail Korobov
1534e8540b
FEED_EXPORT_FIELDS option
2015-04-15 02:48:26 +05:00
Mikhail Korobov
7644813286
allow Crawler, CrawlerRunner and CrawlerProcess to accept dicts instead of Setting objects
2015-04-14 23:26:05 +05:00
Nicolás Alejandro Ramírez Quiros
c2c8098562
Merge pull request #1155 from kmike/remove-deprecated
...
remove deprecated code from FeedExporter
2015-04-14 14:09:10 -03:00
Mikhail Korobov
5436ba117b
remove deprecated code from FeedExporter
2015-04-14 20:19:28 +05:00
Mikhail Korobov
973c31f735
TST cleanup: use assertIn instead of assert_
2015-04-14 20:11:46 +05:00
Pablo Hoffman
71c0aface7
Merge pull request #1148 from Curita/verify-spidermanager-interface
...
Verify SPIDER_MANAGER_CLASS interface while loading it in CrawlerRunner
2015-04-13 14:25:32 -03:00
Daniel Graña
e85679fa6b
Merge pull request #1147 from Curita/pass-crawlers-to-runner-crawl-calls
...
Allow passing Crawler instances directly to CrawlerRunner.crawl()
2015-04-13 14:23:15 -03:00
Julia Medina
5af557e610
Merge pull request #1152 from jdemaeyer/fix/tests-settings-api
...
Fix deprecated settings API in tests
2015-04-12 23:56:40 -03:00
Daniel Graña
f71175a449
More replaces of references to old sel shortcut
2015-04-12 21:56:23 -03:00
Daniel Graña
f9208dbcc4
Merge pull request #1154 from dianakhuang/patch-2
...
Remove references to the `sel` object in shell.rst
2015-04-12 21:55:35 -03:00
Diana Huang
91a60d9f3d
Remove references to the sel object in shell.rst
...
The current documentation has references to the deprecated `sel` when interacting with the shell. I've removed them and replaced uses of `sel.xpath` with `response.xpath` instead.
2015-04-12 13:44:32 -04:00
Jakob de Maeyer
cf9d848f0f
Fixed deprecated settings API in cmdline test
2015-04-12 14:18:47 +02:00
Elias Dorneles
dce48b8654
documenting Files Pipeline together with Images Pipeline
2015-04-11 13:57:55 -03:00
Mikhail Korobov
6f000b8cd4
Merge pull request #952 from Digenis/unicode_xpath_exception
...
[MRG+1] encode unicode selector exception
2015-04-11 00:38:42 +05:00
Nikolaos-Digenis Karagiannis
bf301b7328
encode invalid xpath with unicode_escape under PY2
...
The exception quotes an xpath string
which may be unicode.
2015-04-10 22:23:40 +03:00
Julia Medina
24a07fd892
Verify SPIDER_MANAGER_CLASS interface in CrawlerRunner
2015-04-10 13:43:33 -03:00
Julia Medina
3dabde6706
Update docs for CrawlerRunner.crawl() new usage
2015-04-10 12:09:07 -03:00
Julia Medina
86b0951327
Delete crawler_deferreds doc in CrawlerRunner
...
This attribute is now an internal one since it's main use-case was
covered by CrawlerRunner.stop().
2015-04-10 12:06:27 -03:00
