BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-27 09:24:29 +00:00
Code Releases Wiki Activity
585 Commits 39 Branches 119 Tags
Commit Graph

585 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
elpolilla
a98ba31816 Bugfix in parse command. Some options were not being processed 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40535
 2008-12-18 16:49:09 +00:00
Ismael Carnales
cf8b5fae37 massive rework of templates and styles 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40534
 2008-12-18 16:22:09 +00:00
elpolilla
bda22a539c Added more options to unquote_markup that are passed to remove_entities 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40533
 2008-12-18 16:12:49 +00:00
elpolilla
08150f5acb Added "unquote_markup" function to scrapy.utils.markup 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40532
 2008-12-18 16:03:46 +00:00
Ismael Carnales
5b1aeac3ec fixed typo in style 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40531
 2008-12-18 13:34:40 +00:00
Ismael Carnales
2fab6549d4 make menu float in the right of logo 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40530
 2008-12-18 13:33:21 +00:00
Ismael Carnales
4fd712e1e5 added new logo, also make it clickable 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40529
 2008-12-18 13:06:13 +00:00
Ezequiel Rivero
4856e2d64c fix of the footer. 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40528
 2008-12-18 10:36:21 +00:00
elpolilla
1247193980 Updated scrapy tutorial 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40527
 2008-12-17 17:43:20 +00:00
elpolilla
770094697a Improved items set_adaptors method, and added a __repr__ method to AdaptorPipes 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40526
 2008-12-17 16:40:29 +00:00
Ismael Carnales
4a16bbf74c more margin makes it more legible 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40525
 2008-12-16 19:01:50 +00:00
Ismael Carnales
e7adff7ae2 removed footer margin 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40524
 2008-12-16 19:00:24 +00:00
Ismael Carnales
8671c33e4c now using left-aligned liquid layout 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40523
 2008-12-16 18:59:18 +00:00
Daniel Grana
570f49d407 stats: limit the default number of stats history to 10 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40522
 2008-12-16 18:49:12 +00:00
Ismael Carnales
7414e93102 added breadcrumb navigation to docs 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40521
 2008-12-16 16:57:52 +00:00
Ismael Carnales
ed93eec374 removed border from last menu item 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40520
 2008-12-16 16:55:29 +00:00
Ismael Carnales
f3d6d71150 make home and download validate xhtml strict, watch out please 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40519
 2008-12-16 16:52:08 +00:00
Ismael Carnales
a8b2f0c7e9 added charset 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40518
 2008-12-16 16:46:28 +00:00
Ismael Carnales
e3d1afe98c fixed html, is good to close the lis xD 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40517
 2008-12-16 16:42:02 +00:00
Ismael Carnales
58ce43c14e moved parents on top of prev/next links 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40516
 2008-12-16 16:18:34 +00:00
Ismael Carnales
89de849ed1 updated install link 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40515
 2008-12-16 16:17:29 +00:00
Ismael Carnales
6766a39628 added view to serve images 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40514
 2008-12-16 16:14:15 +00:00
Ismael Carnales
aab5a4a7dd added links and reformated some texts 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40513
 2008-12-16 15:53:01 +00:00
Ismael Carnales
e140b1e435 completed the install doc 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40512
 2008-12-16 15:40:27 +00:00
Ismael Carnales
a026e382ed renamed intro to overview 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40511
 2008-12-16 15:02:32 +00:00
Ismael Carnales
e1ea75baac archived old documentation 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40510
 2008-12-16 15:01:26 +00:00
Ismael Carnales
99f956c166 making dir for old docs 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40509
 2008-12-16 15:00:35 +00:00
Ismael Carnales
de003d15cd renamed tutorial2 to tutorial 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40508
 2008-12-16 14:59:38 +00:00
Ismael Carnales
7f5117e337 reworking docs structure 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40507
 2008-12-16 14:58:52 +00:00
Ismael Carnales
3e1eea8da0 updated install with info for Arch Linux 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40506
 2008-12-16 13:16:08 +00:00
Ismael Carnales
4b2d29a6ce renamed .static to _static 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40505
 2008-12-16 11:58:24 +00:00
Ismael Carnales
26c749b396 added extension for settings and basic skeleton of reference/settings 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40504
 2008-12-16 11:53:20 +00:00
elpolilla
8d4a1e66e8 Modified the new scrapy tutorial and added some images 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40503
 2008-12-16 11:46:19 +00:00
elpolilla
14b2a4ff81 Modified Scrapy tutorial 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40502
 2008-12-16 00:39:48 +00:00
samus_
f9931518aa restoring decompressor while errors are fixed 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40501
 2008-12-15 17:08:57 +00:00
elpolilla
95c00c99b0 Corrected syntax errors in templates 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40500
 2008-12-15 15:06:52 +00:00
Ismael Carnales
e5a476f95e fixed footer menu 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40499
 2008-12-15 14:30:25 +00:00
elpolilla
2e01fa1667 Added part of the new scrapy tutorial 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40498
 2008-12-15 13:44:42 +00:00
elpolilla
1cf569f88a Reverting last change in scrapy-ctl script. PYTHONPATH should be set manually 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40497
 2008-12-15 12:14:41 +00:00
Pablo Hoffman
d72056c91e removed incorrect text 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40496
 2008-12-15 12:02:16 +00:00
elpolilla
2d0cca538e . Added path detection to scrapy-ctl script, which was giving problems with new projects 
. Corrected typo in CrawlSpiders template

--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40495
 2008-12-15 11:58:57 +00:00
elpolilla
6b0e1f090e . Replaced Decompressor tool by Decompression mmiddleware, including its tests 
. Removed references to Decompressor tool in FeedSpiders

--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40494
 2008-12-15 02:29:47 +00:00
Pablo Hoffman
dcc340234d scrapy.org: updated Home, added Download & Home articles. Updated footer & header 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40493
 2008-12-14 06:29:19 +00:00
Pablo Hoffman
becf3bd7aa added BSD license 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40492
 2008-12-14 05:23:47 +00:00
Pablo Hoffman
4599893f35 fixed bug in DownloaderStats middleware 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40491
 2008-12-14 04:32:01 +00:00
Pablo Hoffman
1510efcac9 Sorted out downloader-related stats: 
* added DownloaderStats (downloader middleware) to handle all downloader-related stats
 * removed downloader related stats from CoreStats
 * removed downloader exception stats from RetryMiddleware

--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40490
 2008-12-14 04:01:54 +00:00
samus_
3d16160bf7 adding RetryMiddleware errors to the stats 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40489
 2008-12-14 01:49:59 +00:00
samus_
bd4c106a61 * adjusted RETRY_TIMES setting and behaviour 
* refactored scrapy.contrib.downloadermiddleware.retry.RetryMiddleware
* created test for it (scrapy.tests.test_middleware_retry.RetryTest)
* updated docstring at scrapy.core.downloader.middleware.DownloaderMiddlewareManager

--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40488
 2008-12-12 21:26:00 +00:00
Ismael Carnales
f7fce6cdb9 changed formatting of srapy intro 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40487
 2008-12-12 10:50:41 +00:00
elpolilla
7efa85ccc7 Added missing import and convenient check in ShoveItem pipeline 
--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40486
 2008-12-11 13:54:54 +00:00