Pablo Hoffman
|
fff2871828
|
added doc section (and FAQ) about spider arguments
|
2012-09-04 14:49:30 -03:00 |
|
Pablo Hoffman
|
f4a17ec272
|
removed references to Scrapy Snippets site
|
2012-09-03 22:19:15 -03:00 |
|
Pablo Hoffman
|
b901e64044
|
replaced memory usage acounting with (more portable) resource module, removed scrapy.utils.memory module. closes #161
|
2012-09-03 19:28:16 -03:00 |
|
Pablo Hoffman
|
e2f9daac67
|
fixed formatting in scrapyd release notes
|
2012-09-03 16:58:58 -03:00 |
|
Pablo Hoffman
|
dd1398b280
|
removed another instance of scrapy.conf.settings singleton, this time from download handlers
|
2012-09-03 16:44:18 -03:00 |
|
Pablo Hoffman
|
7c8af83138
|
added issue role to documentation
|
2012-08-31 18:39:30 -03:00 |
|
Daniel Graña
|
a2d22307ad
|
update news.rst
|
2012-08-31 17:38:40 -03:00 |
|
Pablo Hoffman
|
be206ca5ab
|
added process_start_requests method to spider middlewares
|
2012-08-31 16:41:50 -03:00 |
|
Pablo Hoffman
|
b920674666
|
corrected minor issue with doc references
|
2012-08-31 16:41:49 -03:00 |
|
Pablo Hoffman
|
4ec99117d3
|
fixed minor doc typo
|
2012-08-30 11:56:30 -03:00 |
|
Pablo Hoffman
|
4a5f70278f
|
minor tidy up to installation guide windows notes
|
2012-08-29 15:44:24 -03:00 |
|
Pablo Hoffman
|
098d892c03
|
simplified installation guide to only mention pip/easy_install mechanism, and provide hints for Windows users
|
2012-08-29 15:37:05 -03:00 |
|
Pablo Hoffman
|
70f8e517a1
|
promoted DjangoItem to main contrib
|
2012-08-29 11:23:11 -03:00 |
|
Pablo Hoffman
|
da234af456
|
Merge branch 'singleton_removal'
|
2012-08-28 18:42:33 -03:00 |
|
Pablo Hoffman
|
babfc6e79b
|
Updated documentation after singleton removal changes.
Also removed some unused code and made some minor additional
refactoring.
|
2012-08-28 18:35:57 -03:00 |
|
Pablo Hoffman
|
5fa5c4545b
|
use ScrapyJSONEncoder JsonItemExporter & JsonLinesItemExporter, to support nested items properly
|
2012-08-22 13:46:50 -03:00 |
|
Pablo Hoffman
|
36f47a4aec
|
Removed per-spider settings concept, and scrapy.conf.settings singleton from many extensions and middlewares. There are some still remaining, that will be removed in future commits
|
2012-08-21 17:27:45 -03:00 |
|
Daniel Graña
|
abcc8c9f63
|
Recommend pypi as single way to install on Windows
|
2012-08-06 10:21:13 -03:00 |
|
Daniel Graña
|
b7b0c49520
|
append parse command to example code sections in docs. closes #162
|
2012-08-06 09:10:16 -03:00 |
|
Pablo Hoffman
|
832e45073b
|
fixed typo in stats documentation. closes #159
|
2012-07-20 17:13:06 -03:00 |
|
Valentin-Costel Hăloiu
|
00bfb37e79
|
Update master
|
2012-07-04 06:55:01 +03:00 |
|
Daniel Graña
|
277ed0ae23
|
Merge pull request #145 from alexcepoi/cookies-changes
domain and path support for request cookies
|
2012-06-25 11:29:04 -07:00 |
|
Alexandru Cepoi
|
177c81745d
|
domain and path support for request cookies
|
2012-06-25 20:17:59 +02:00 |
|
Pablo Hoffman
|
179e3810dc
|
fixed links to doc. closes #150
|
2012-06-24 01:00:33 -03:00 |
|
Alexandru Cepoi
|
f4faa19e31
|
added docs topic debugging spiders
|
2012-06-21 20:03:33 +02:00 |
|
Alexandru Cepoi
|
3e05a2ecf6
|
update docs for parse command
|
2012-06-12 18:28:10 +02:00 |
|
Pablo Hoffman
|
e1be9c01bc
|
updated FAQ about bot bans
|
2012-06-08 18:33:53 -03:00 |
|
Daniel Graña
|
ae2ff4d33a
|
update news file with 0.14.4 release notes
|
2012-05-15 16:16:02 -03:00 |
|
Pablo Hoffman
|
9686f97242
|
added precise to supported ubuntu distros
|
2012-05-12 19:54:36 -03:00 |
|
Pablo Hoffman
|
58e88ed246
|
scrapyd: do not set SCRAPY_FEED_URI/SCRAPY_LOG_FILE if items_dir/logs_dir settings are not set
|
2012-05-08 17:43:00 -03:00 |
|
Pablo Hoffman
|
9c3b9f2968
|
fixed bug in json-rpc webservice reported in https://groups.google.com/d/topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py
|
2012-05-03 12:05:40 -03:00 |
|
Pablo Hoffman
|
abcac4fcbd
|
updated maintainer to scrapinghub
|
2012-05-02 03:25:35 -03:00 |
|
stav
|
86dba76d1f
|
documentation indentation
|
2012-04-30 13:09:34 -05:00 |
|
Pablo Hoffman
|
c7f33c534b
|
removed redundant lines from release notes
|
2012-04-20 09:09:55 -03:00 |
|
Daniel Graña
|
15c8c01828
|
add 0.14.3 release notes
|
2012-04-19 23:25:15 -03:00 |
|
Pablo Hoffman
|
97f362d64e
|
removed deprecated/undocumented class: HTMLImageLinkExtractor
|
2012-04-19 12:07:46 -03:00 |
|
Pablo Hoffman
|
2fb5e62c39
|
doc: update overview page to point to the genspider command. refs #107
|
2012-04-19 02:37:22 -03:00 |
|
Pablo Hoffman
|
d567d8efbe
|
added note to docs/topics/firebug.rst about google directory being shut down
|
2012-04-19 01:34:20 -03:00 |
|
Pablo Hoffman
|
30ddbf624e
|
mention about some scrapy.xlib modules removed in the release notes
|
2012-04-17 12:31:18 -03:00 |
|
Pablo Hoffman
|
d99ee6deb9
|
added some missing entries to release notes
|
2012-04-17 12:29:48 -03:00 |
|
Daniel Graña
|
d8ebf16fe5
|
Merge pull request #114 from stav/master
Scrapy DOC changes
|
2012-04-11 12:08:45 -07:00 |
|
Pablo Hoffman
|
7cca916ed5
|
added release notes to official documentation, including all release notes since Scrapy 0.7
|
2012-04-11 15:53:23 -03:00 |
|
stav
|
f1802289cd
|
small doc typo change to get the fork rolling
|
2012-04-11 12:05:39 -05:00 |
|
Pablo Hoffman
|
4f28ffcb2c
|
removed no longer needed dependency on simplejson
|
2012-04-10 16:01:36 -03:00 |
|
Pablo Hoffman
|
6e8edbd72e
|
switched default selectors backend to lxml
|
2012-04-10 15:52:14 -03:00 |
|
Pablo Hoffman
|
27018fced7
|
changed default user agent to Scrapy/0.15 (+http://scrapy.org) and removed no longer needed BOT_VERSION setting
|
2012-03-23 13:45:21 -03:00 |
|
Pablo Hoffman
|
8933e2f2be
|
added REFERER_ENABLED setting, to control referer middleware
|
2012-03-22 16:35:14 -03:00 |
|
Jason Yeo
|
da826aa13d
|
fixed minor mistake in Request objects documentation
|
2012-03-21 10:25:41 +08:00 |
|
Pablo Hoffman
|
175c70ad44
|
fixed minor defect in link extractors documentation
|
2012-03-20 22:56:45 -03:00 |
|
Pablo Hoffman
|
35fb01156e
|
removed some obsolete remaining code related to sqlite support in scrapy
|
2012-03-16 11:55:55 -03:00 |
|