BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 02:24:03 +00:00
Code Releases Wiki Activity
2,007 Commits 39 Branches 119 Tags
Commit Graph

2007 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Pablo Hoffman
4fa833c849 Added LOG_ENCODING setting 2010-03-24 12:13:38 -03:00
Pablo Hoffman
87e68e7438 Made MailSender non IO-blocking, and improved MailSender documentation 2010-03-22 13:37:37 -03:00
Pablo Hoffman
1dfc79b5d0 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-03-20 20:48:11 -03:00
Pablo Hoffman
99a876754c Improved "What else?" section of "Scrapy at a glance" overview 2010-03-20 20:24:18 -03:00
Pablo Hoffman
264cd2e035 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-03-19 10:32:42 -03:00
Pablo Hoffman
234fd709ad fixed doc typo (thanks Victor) 2010-03-19 10:32:17 -03:00
Daniel Grana
184cf6684f Remove HttpException references from docs. Since 0.7, scrapy returns non-200 as Response objects and does not raise HttpException anymore 2010-03-18 10:05:33 -03:00
Pablo Hoffman
403a21ec74 removed obsolete scrapy.crawler module 2010-03-12 17:28:33 -02:00
Daniel Grana
17091902f3 Explicity say where to save item class in "Defining our item" section of tutorial 2010-03-12 14:12:49 -02:00
Pablo Hoffman
54ae2c36d0 better implementation of open_in_browser() tests 2010-03-12 10:19:50 -02:00
Pablo Hoffman
38a296aa2c Added tests to open_in_browser() function 2010-03-12 09:52:39 -02:00
Pablo Hoffman
2ab94d75e2 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-03-12 09:32:35 -02:00
Pablo Hoffman
c5cd8b9d3d Fixed bug in open_in_browser() function with Python 2.5 (closes #145). 2010-03-12 09:31:05 -02:00
Pablo Hoffman
39e4df0cff removed unmaintained (and untested) contrib_exp ShoveItemPipeline 2010-03-10 00:10:36 -02:00
Pablo Hoffman
a505a9d490 minor code refactoring on scrapy.command.cmdline module 2010-03-04 11:09:16 -02:00
Pablo Hoffman
4c1ec0c97e replaced hacky command_executed dict by standard signal 2010-03-04 10:58:18 -02:00
Pablo Hoffman
861f9691c7 removed partly-obsolete module scrapy.contrib.groupsettings 2010-03-04 10:40:41 -02:00
Pablo Hoffman
d12cd22d5e switched default scheduler order to DFO, which consumes less memory by default 2010-03-04 10:15:58 -02:00
Daniel Grana
700be3202b Automated merge with ssh://hg.scrapy.org/scrapy-0.8 2010-02-24 15:44:41 -02:00
Daniel Grana
2322322ee6 Add missing priority and errback arguments to Request.replace method signature 2010-02-24 15:43:09 -02:00
Pablo Hoffman
180c091fb2 Fixed encoding issue (reported in #135) when the encoding declared in the HTTP header is unknown. This is the patch proposed by Rolando, with an update to the Request/Response documentation. 2010-02-24 14:01:29 -02:00
Pablo Hoffman
bbef0fe870 Automated merge with http://hg.scrapy.org/users/rolando/scrapy/ 2010-02-20 11:12:37 -02:00
Rolando Espinoza La fuente
7b1ad321e3 examples/experimental: added imdb top movies spider 2010-02-19 21:31:17 -04:00
Pablo Hoffman
cb99edd153 simplified and improved AUTHORS file 2010-02-19 23:16:55 -02:00
Pablo Hoffman
a3d22c7240 Automated merge with http://hg.scrapy.org/scrapy-0.8/ 2010-02-19 23:11:24 -02:00
Pablo Hoffman
60961e5499 minor documentation fix (refs #135) 2010-02-19 23:09:48 -02:00
Pablo Hoffman
c1f8198639 Added RANDOMIZE_DOWNLOAD_DELAY setting 2010-02-19 21:53:18 -02:00
Rolando Espinoza La fuente
4a053a762f examples/experimental: added gooledir crawler 2010-02-19 18:28:16 -04:00
Rolando Espinoza La fuente
a6a3f085a7 docs: added crawlspider v2 outline documentation 
Sign-Off: Rolando Espinoza La fuente
 2010-02-19 18:22:38 -04:00
Rolando Espinoza La fuente
17d1543929 contrib_exp: added crawlspider v2 package + tests 
Sign-Off: Rolando Espinoza La fuente
 2010-02-19 18:19:01 -04:00
Rolando Espinoza La fuente
7ddd4441e3 utils.python: added equal_attributes() to compare two objects arbitrary attributes 
Sign-Off: Rolando Espinoza La fuente
 2010-02-19 17:57:48 -04:00
Rolando Espinoza La fuente
7235040936 merged upstream 2010-02-19 17:41:45 -04:00
Pablo Hoffman
23fcf48a89 Automated merge with http://hg.scrapy.org/scrapy-0.8/ 2010-02-19 16:34:01 -02:00
Pablo Hoffman
53dfc4d3dd fixed bug which was causing the DOWNLOAD_DELAY setting to be ignored (the spider download_delay attribute was working though) 2010-02-19 16:32:30 -02:00
Pablo Hoffman
a67c389728 Automated merge with http://hg.scrapy.org/scrapy-0.8/ 2010-02-19 15:44:23 -02:00
Pablo Hoffman
51faec5dcd fixed bug which was considering DOWNLOAD_DELAY as an int setting, where it should be a float 2010-02-19 15:42:54 -02:00
Daniel Grana
8dc95bf105 Automated merge with ssh://hg.scrapy.org/scrapy-0.8 2010-02-18 16:52:45 -02:00
Daniel Grana
91f4d6dc51 docs: adds another spider example that yields multiples requests/items from a single callback 2010-02-18 16:51:05 -02:00
Pablo Hoffman
d337aeb7e7 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-31 18:11:43 -02:00
Pablo Hoffman
57d60eae39 sort settings doc alphabetically by setting name 2010-01-31 18:11:13 -02:00
Pablo Hoffman
843b371968 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-28 10:56:49 -02:00
Pablo Hoffman
b1c2756778 added spiders to some error logging in Engine and Scraper core components 2010-01-28 10:56:04 -02:00
Pablo Hoffman
407f0671c1 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-18 18:17:08 -02:00
Pablo Hoffman
67858af83c fixed doc typo 2010-01-18 18:16:58 -02:00
Pablo Hoffman
49ac3bd2d2 Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-17 05:20:23 -02:00
Pablo Hoffman
496db55518 added some encoding aliases not provided in Python by default - fixes #130 2010-01-17 05:19:51 -02:00
Pablo Hoffman
c0da2edf6f Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-13 15:52:06 -02:00
Pablo Hoffman
08eeaf98a2 fixed description of LOG_STDOUT setting 2010-01-13 15:51:08 -02:00
Pablo Hoffman
8e5a3baf1e Automated merge with http://hg.scrapy.org/scrapy-0.8 2010-01-13 12:21:26 -02:00
Pablo Hoffman
48739ae60c install.rst: added explanation about why libxml2 2.6.28 or above is required 2010-01-13 12:20:24 -02:00