Pablo Hoffman
|
234fd709ad
|
fixed doc typo (thanks Victor)
|
2010-03-19 10:32:17 -03:00 |
|
Daniel Grana
|
184cf6684f
|
Remove HttpException references from docs. Since 0.7, scrapy returns non-200 as Response objects and does not raise HttpException anymore
|
2010-03-18 10:05:33 -03:00 |
|
Daniel Grana
|
17091902f3
|
Explicity say where to save item class in "Defining our item" section of tutorial
|
2010-03-12 14:12:49 -02:00 |
|
Pablo Hoffman
|
c5cd8b9d3d
|
Fixed bug in open_in_browser() function with Python 2.5 (closes #145).
|
2010-03-12 09:31:05 -02:00 |
|
Daniel Grana
|
2322322ee6
|
Add missing priority and errback arguments to Request.replace method signature
|
2010-02-24 15:43:09 -02:00 |
|
Pablo Hoffman
|
60961e5499
|
minor documentation fix (refs #135)
|
2010-02-19 23:09:48 -02:00 |
|
Pablo Hoffman
|
53dfc4d3dd
|
fixed bug which was causing the DOWNLOAD_DELAY setting to be ignored (the spider download_delay attribute was working though)
|
2010-02-19 16:32:30 -02:00 |
|
Pablo Hoffman
|
51faec5dcd
|
fixed bug which was considering DOWNLOAD_DELAY as an int setting, where it should be a float
|
2010-02-19 15:42:54 -02:00 |
|
Daniel Grana
|
91f4d6dc51
|
docs: adds another spider example that yields multiples requests/items from a single callback
|
2010-02-18 16:51:05 -02:00 |
|
Pablo Hoffman
|
57d60eae39
|
sort settings doc alphabetically by setting name
|
2010-01-31 18:11:13 -02:00 |
|
Pablo Hoffman
|
b1c2756778
|
added spiders to some error logging in Engine and Scraper core components
|
2010-01-28 10:56:04 -02:00 |
|
Pablo Hoffman
|
67858af83c
|
fixed doc typo
|
2010-01-18 18:16:58 -02:00 |
|
Pablo Hoffman
|
496db55518
|
added some encoding aliases not provided in Python by default - fixes #130
|
2010-01-17 05:19:51 -02:00 |
|
Pablo Hoffman
|
08eeaf98a2
|
fixed description of LOG_STDOUT setting
|
2010-01-13 15:51:08 -02:00 |
|
Pablo Hoffman
|
48739ae60c
|
install.rst: added explanation about why libxml2 2.6.28 or above is required
|
2010-01-13 12:20:24 -02:00 |
|
Pablo Hoffman
|
d60412ce19
|
titlecased Scrapy easy_install and some fixes to sign_release.sh script
|
2009-12-13 14:23:31 -02:00 |
|
Pablo Hoffman
|
8a801e7166
|
Added tag 0.8 for changeset eef0b17d8752
|
2009-12-12 18:02:42 -02:00 |
|
Pablo Hoffman
|
980ca75d0d
|
Removed tag 0.8-rc1
0.8
|
2009-12-12 18:02:25 -02:00 |
|
Pablo Hoffman
|
cd9a2d8edb
|
removed rc1 from version 0.8 (good enough for a stable release)
|
2009-12-12 17:57:20 -02:00 |
|
Pablo Hoffman
|
422d6facb2
|
Automated merge with http://hg.scrapy.org/scrapy-stable
|
2009-12-12 16:52:07 -02:00 |
|
Pablo Hoffman
|
9d50604d24
|
added |version| to documentation title
|
2009-12-12 16:51:59 -02:00 |
|
Pablo Hoffman
|
b6493f8bb8
|
Added tag 0.8-rc1 for changeset 22de0cc4b778
|
2009-12-12 16:15:49 -02:00 |
|
Pablo Hoffman
|
1fda0e78d5
|
removed (pretty useless) build_release.sh script - see http://dev.scrapy.org/wiki/ScrapyReleaseProcedure
|
2009-12-12 15:54:52 -02:00 |
|
Pablo Hoffman
|
024c00a512
|
title-cased project name in setup.py
|
2009-12-12 15:48:02 -02:00 |
|
Pablo Hoffman
|
a953efd8e5
|
Automated merge with http://hg.scrapy.org/scrapy-stable
|
2009-12-12 15:40:16 -02:00 |
|
Pablo Hoffman
|
f22fe95ae9
|
changed version to 0.8-rc1
|
2009-12-12 15:31:03 -02:00 |
|
Pablo Hoffman
|
3d6f598abc
|
added minor delay to httpcache tests, for them to pass on win32
|
2009-12-12 15:30:21 -02:00 |
|
Pablo Hoffman
|
9c31fc447a
|
Changed character used in unit test because it's not a valid file name char on win32
|
2009-12-12 11:07:50 -02:00 |
|
Pablo Hoffman
|
3012030b2f
|
Fixed bug in file:// downloader handler with uris containing percent-escaped chars
|
2009-12-12 10:57:17 -02:00 |
|
Pablo Hoffman
|
cca4be4d64
|
uncommented some lines in extras/build_release.sh
|
2009-12-11 23:52:53 -02:00 |
|
Ismael Carnales
|
4ecc909bc1
|
Fix RobotsTxtMiddleware reference in doc
|
2009-12-04 15:37:24 -02:00 |
|
Pablo Hoffman
|
fe88aad27d
|
removed some old code from scrapy.spider.models
|
2009-12-02 23:30:00 -02:00 |
|
Pablo Hoffman
|
41894c776e
|
adjusted some core code and comments for consistency after the move to spider references
|
2009-12-02 23:06:17 -02:00 |
|
Pablo Hoffman
|
57bae5335f
|
Added Settings class tests, and fixed minor bug
|
2009-12-02 15:52:17 -02:00 |
|
Pablo Hoffman
|
dbe0a6875c
|
Decoupled Settings class from environment settings singleton (scrapy.conf.settings)
|
2009-12-02 15:11:11 -02:00 |
|
Pablo Hoffman
|
925eecce70
|
fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically
|
2009-12-02 13:59:58 -02:00 |
|
Pablo Hoffman
|
dda7e01d2f
|
don't fail if OpenSSL is not installed in test_dependencies.py
|
2009-12-02 11:26:34 -02:00 |
|
Ismael Carnales
|
07344666e2
|
Move webconsole extensions doc to webconsole topic
|
2009-12-01 10:47:11 -02:00 |
|
Ismael Carnales
|
e694c8ed02
|
Remove domain references in close spider extension doc
|
2009-11-30 11:38:56 -02:00 |
|
Ismael Carnales
|
12a7ff7312
|
Rename Close domain to close spider in extensions doc
|
2009-11-30 11:36:18 -02:00 |
|
Ismael Carnales
|
8d9cedd88b
|
Reorder signals doc to respect alphabetical order
|
2009-11-30 11:29:19 -02:00 |
|
Ismael Carnales
|
93cc3d2715
|
Correct param formatting in item pipelines doc
|
2009-11-30 11:04:15 -02:00 |
|
Pablo Hoffman
|
cabee59d4d
|
Fixed compatibility issues with Twisted 9 (closes #128)
|
2009-11-28 22:15:09 -02:00 |
|
Pablo Hoffman
|
6084be3b2e
|
added iter_all() function to scrapy.util.trackref module and improved memory leaks documentation. also added a new FAQ antry about memory issues
|
2009-11-28 16:21:59 -02:00 |
|
Pablo Hoffman
|
de35eee3cd
|
Automated merge after applying ajones patch
|
2009-11-28 12:31:05 -02:00 |
|
Pablo Hoffman
|
207aae2b04
|
Fixed logging of "Spider closed" message in engine
|
2009-11-26 19:12:33 -02:00 |
|
Pablo Hoffman
|
34fcf6ba5b
|
Added informative message when trying to use trackref and it's not enabled
|
2009-11-26 18:37:45 -02:00 |
|
Pablo Hoffman
|
fd50891113
|
Keep track of pending next-request calls in the engine and downloader, to cancel them properly when the spider is closed. This also avoids keeping spider references alive, after they are closed.
|
2009-11-26 17:00:16 -02:00 |
|
Pablo Hoffman
|
c0f1c8de04
|
use DelayedCall.active() instead DelayedCall.called, to support cancelled tasks
|
2009-11-26 16:10:28 -02:00 |
|
Pablo Hoffman
|
88417a3ed1
|
Fixed bug in LiveStats webconsole module which was keeping references to spiders alive, after they were closed
|
2009-11-25 22:51:58 -02:00 |
|