1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-24 07:24:12 +00:00

1924 Commits

Author SHA1 Message Date
Pablo Hoffman
c1f8198639 Added RANDOMIZE_DOWNLOAD_DELAY setting 2010-02-19 21:53:18 -02:00
Pablo Hoffman
23fcf48a89 Automated merge with http://hg.scrapy.org/scrapy-0.8/ 2010-02-19 16:34:01 -02:00
Pablo Hoffman
53dfc4d3dd fixed bug which was causing the DOWNLOAD_DELAY setting to be ignored (the spider download_delay attribute was working though) 2010-02-19 16:32:30 -02:00
Pablo Hoffman
a67c389728 Automated merge with http://hg.scrapy.org/scrapy-0.8/ 2010-02-19 15:44:23 -02:00
Pablo Hoffman
51faec5dcd fixed bug which was considering DOWNLOAD_DELAY as an int setting, where it should be a float 2010-02-19 15:42:54 -02:00
Daniel Grana
8dc95bf105 Automated merge with ssh://hg.scrapy.org/scrapy-0.8 2010-02-18 16:52:45 -02:00
Daniel Grana
91f4d6dc51 docs: adds another spider example that yields multiples requests/items from a single callback 2010-02-18 16:51:05 -02:00
Pablo Hoffman
d337aeb7e7 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-31 18:11:43 -02:00
Pablo Hoffman
57d60eae39 sort settings doc alphabetically by setting name 2010-01-31 18:11:13 -02:00
Pablo Hoffman
843b371968 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-28 10:56:49 -02:00
Pablo Hoffman
b1c2756778 added spiders to some error logging in Engine and Scraper core components 2010-01-28 10:56:04 -02:00
Pablo Hoffman
407f0671c1 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-18 18:17:08 -02:00
Pablo Hoffman
67858af83c fixed doc typo 2010-01-18 18:16:58 -02:00
Pablo Hoffman
49ac3bd2d2 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-17 05:20:23 -02:00
Pablo Hoffman
496db55518 added some encoding aliases not provided in Python by default - fixes #130 2010-01-17 05:19:51 -02:00
Pablo Hoffman
c0da2edf6f Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-13 15:52:06 -02:00
Pablo Hoffman
08eeaf98a2 fixed description of LOG_STDOUT setting 2010-01-13 15:51:08 -02:00
Pablo Hoffman
8e5a3baf1e Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-13 12:21:26 -02:00
Pablo Hoffman
48739ae60c install.rst: added explanation about why libxml2 2.6.28 or above is required 2010-01-13 12:20:24 -02:00
Pablo Hoffman
e7ef2eba1e Automated merge with http://hg.scrapy.org/scrapy-0.8 2009-12-13 14:24:10 -02:00
Pablo Hoffman
d60412ce19 titlecased Scrapy easy_install and some fixes to sign_release.sh script 2009-12-13 14:23:31 -02:00
Pablo Hoffman
34971ea6e7 bumped version to 0.9-dev 2009-12-12 18:15:18 -02:00
Pablo Hoffman
8a801e7166 Added tag 0.8 for changeset eef0b17d8752 2009-12-12 18:02:42 -02:00
Pablo Hoffman
980ca75d0d Removed tag 0.8-rc1 0.8 2009-12-12 18:02:25 -02:00
Pablo Hoffman
cd9a2d8edb removed rc1 from version 0.8 (good enough for a stable release) 2009-12-12 17:57:20 -02:00
Pablo Hoffman
422d6facb2 Automated merge with http://hg.scrapy.org/scrapy-stable 2009-12-12 16:52:07 -02:00
Pablo Hoffman
9d50604d24 added |version| to documentation title 2009-12-12 16:51:59 -02:00
Pablo Hoffman
b6493f8bb8 Added tag 0.8-rc1 for changeset 22de0cc4b778 2009-12-12 16:15:49 -02:00
Pablo Hoffman
1fda0e78d5 removed (pretty useless) build_release.sh script - see http://dev.scrapy.org/wiki/ScrapyReleaseProcedure 2009-12-12 15:54:52 -02:00
Pablo Hoffman
024c00a512 title-cased project name in setup.py 2009-12-12 15:48:02 -02:00
Pablo Hoffman
a953efd8e5 Automated merge with http://hg.scrapy.org/scrapy-stable 2009-12-12 15:40:16 -02:00
Pablo Hoffman
f22fe95ae9 changed version to 0.8-rc1 2009-12-12 15:31:03 -02:00
Pablo Hoffman
3d6f598abc added minor delay to httpcache tests, for them to pass on win32 2009-12-12 15:30:21 -02:00
Pablo Hoffman
9c31fc447a Changed character used in unit test because it's not a valid file name char on win32 2009-12-12 11:07:50 -02:00
Pablo Hoffman
3012030b2f Fixed bug in file:// downloader handler with uris containing percent-escaped chars 2009-12-12 10:57:17 -02:00
Pablo Hoffman
cca4be4d64 uncommented some lines in extras/build_release.sh 2009-12-11 23:52:53 -02:00
Ismael Carnales
4ecc909bc1 Fix RobotsTxtMiddleware reference in doc 2009-12-04 15:37:24 -02:00
Pablo Hoffman
fe88aad27d removed some old code from scrapy.spider.models 2009-12-02 23:30:00 -02:00
Pablo Hoffman
41894c776e adjusted some core code and comments for consistency after the move to spider references 2009-12-02 23:06:17 -02:00
Pablo Hoffman
57bae5335f Added Settings class tests, and fixed minor bug 2009-12-02 15:52:17 -02:00
Pablo Hoffman
dbe0a6875c Decoupled Settings class from environment settings singleton (scrapy.conf.settings) 2009-12-02 15:11:11 -02:00
Pablo Hoffman
925eecce70 fixed bug in OpenSSL depedency test which was comparing versions alphabetically, instead of numerically 2009-12-02 13:59:58 -02:00
Pablo Hoffman
dda7e01d2f don't fail if OpenSSL is not installed in test_dependencies.py 2009-12-02 11:26:34 -02:00
Ismael Carnales
07344666e2 Move webconsole extensions doc to webconsole topic 2009-12-01 10:47:11 -02:00
Ismael Carnales
e694c8ed02 Remove domain references in close spider extension doc 2009-11-30 11:38:56 -02:00
Ismael Carnales
12a7ff7312 Rename Close domain to close spider in extensions doc 2009-11-30 11:36:18 -02:00
Ismael Carnales
8d9cedd88b Reorder signals doc to respect alphabetical order 2009-11-30 11:29:19 -02:00
Ismael Carnales
93cc3d2715 Correct param formatting in item pipelines doc 2009-11-30 11:04:15 -02:00
Pablo Hoffman
cabee59d4d Fixed compatibility issues with Twisted 9 (closes #128) 2009-11-28 22:15:09 -02:00
Pablo Hoffman
6084be3b2e added iter_all() function to scrapy.util.trackref module and improved memory leaks documentation. also added a new FAQ antry about memory issues 2009-11-28 16:21:59 -02:00