1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 00:43:59 +00:00

831 Commits

Author SHA1 Message Date
Daniel Graña
1117687c47 update docs 2014-04-23 23:39:58 -03:00
Mikhail Korobov
2d3803672b DOC use top-level shortcuts in docs 2014-04-15 01:09:35 +06:00
Julia Medina
80081054a2 Fix broken links in documentation 2014-04-09 18:57:52 -03:00
Julia Medina
f0a0d0bc22 Ignore known broken links in docs linkcheck 2014-04-09 18:46:21 -03:00
Ana Sabina Uban
73109bf950 Fixed SgmlLinkExtractor constructor to properly handle both string and list parameters (attrs, tags, deny_extensions) 2014-03-27 16:12:00 +02:00
tpeng
fd7b40e892 add message when raise IngoreReques; fix item_scraped document 2014-03-18 15:23:25 +08:00
Julia Medina
b9e2aad874 Doc for disabling download handler 2014-03-12 23:21:33 -03:00
Julia Medina
ca1c1a82b5 FormRequest doc improvements
Clickdata doc enhancements:
 * Fix xml attributes mention
 * nr is 0-indexed reference
2014-03-12 12:34:50 -03:00
Julia Medina
e29ab4d112 New doc: clickdata in Formrequest.from_response
Documentation about:
 * clickdata parameter in Formrequest.from_response
 * nr attribute in clickdata dict
 * default behaviour when clickdata is None
2014-03-12 06:43:50 -03:00
Nikolaos-Digenis Karagiannis
8ac9d40665 ItemLoader doc: missing args in replace_value() 2014-03-09 15:16:57 +02:00
Pablo Hoffman
0bc2cbaf09 Merge pull request #613 from breno/master
Update scrapy command line doc with additional scrapy parse options
2014-03-07 10:35:58 -08:00
Mikhail Korobov
d8fb4a35db Merge pull request #627 from Digenis/master
SpiderMW doc typo: SWP request, response
2014-03-07 12:41:39 +05:00
Capi Etheriel
72b6c96d9a Running lucasdemarchi/codespell to fix typos in docs 2014-03-06 12:40:55 -03:00
Nikolaos-Digenis Karagiannis
4335420f40 SpiderMW doc typo: SWP request, response 2014-03-06 16:09:37 +02:00
Alexey Bezhan
210a0a6fe1 Fix some typos, whitespace and small errors in docs 2014-02-27 18:02:22 +00:00
Alexey Bezhan
2e59d77580 Clarify MapCompose documentation 2014-02-27 17:56:14 +00:00
Cash Costello
c532e13dcd Added missing word in practices.rst 2014-02-27 13:08:36 -02:00
Pablo Hoffman
6d8b7b29ef remove unused setting: DOWNLOADER_DEBUG 2014-02-27 12:16:05 -02:00
Breno Colom
551c1c5eae Update scrapy command line doc with additional scrapy parse options 2014-02-24 18:10:51 -05:00
Pablo Hoffman
822adb1d5f Merge pull request #602 from Blender3D/email
Added a mimetype parameter to `MailSender.send`
2014-02-20 12:05:14 -08:00
Capi Etheriel
1ec1100b27 fixes dynamic itemclass example usage of type() 2014-02-18 20:59:05 -03:00
Nikita Nikishin
a676017fe4 Fixed #441. 2014-02-18 03:50:43 -05:00
Paul Tremberth
41765ca18d DupeFilter: add setting for verbose logging + stats counter for filtered requests 2014-02-17 13:42:42 +01:00
Pablo Hoffman
d24212c8e5 remove references to deprecated scrapy-developers list 2014-02-16 21:44:49 -02:00
Rolando Espinoza
28f946b05f DOC Use pipelines module name instead of pipieline following default project files. 2014-02-15 11:01:26 -04:00
Daniel Graña
180fc98cd8 Add 0.22.2 release notes 2014-02-14 15:45:44 -02:00
Daniel Graña
6ca49ce76a Merge pull request #594 from dangra/593-engineslots
fix a reference to unexistent engine.slots.
2014-02-14 09:39:30 -08:00
Daniel Graña
b58285b635 fix a reference to unexistent engine.slots. closes #593 2014-02-14 15:31:05 -02:00
Nikolaos-Digenis Karagiannis
43a797e2f7 downloaderMW doc typo (spiderMW doc copy remnant) 2014-02-11 22:30:00 +02:00
tracicot
b2f4b296df Correct typos 2014-02-10 11:46:23 -02:00
Daniel Graña
783d8e3ae1 Add 0.22.1 release notes 2014-02-08 17:09:04 -02:00
Paul Tremberth
57f30bcb04 Docs: 4-space indent for final spider example 2014-02-01 23:34:55 +01:00
Rolando Espinoza
a6279fe95b DOC Fixed HTTPCACHE_STORAGE typo in the default value which is now Filesystem instead Dbm. 2014-01-30 11:53:42 -04:00
Rolando Espinoza
4255e12bc7 Updated the tutorial crawl output with latest output. 2014-01-23 18:18:56 -04:00
Rolando Espinoza
9aab9224cb Updated shell docs with the crawler reference and fixed the actual shell output.
Also updated the shell example with a reproducible code example.
2014-01-23 18:04:57 -04:00
Daniel Graña
677afe7e54 show ubuntu setup instructions as literal code 2014-01-20 16:22:53 -02:00
Daniel Graña
ebfb5b7096 replace warning about updating package lists by a note on package upgrade 2014-01-20 15:18:34 -02:00
Daniel Graña
52c3ff9190 fix apt-get line 2014-01-20 14:39:26 -02:00
Daniel Graña
eb73ddd301 Update Ubuntu installation instructions 2014-01-20 14:15:01 -02:00
stray-leone
7f30a671c3 modify the version of scrapy ubuntu package
latest version is 0.22.
with scrapy-0.18, tutorial project provides error
relative issue : https://github.com/scrapy/scrapy/issues/511
2014-01-20 10:24:34 -02:00
Daniel Graña
431f2d109f fix 0.22.0 release date 2014-01-17 17:54:01 -02:00
Mikhail Korobov
dfd13f9941 fix typos in news.rst and remove (not released yet) header 2014-01-18 01:50:19 +06:00
Daniel Graña
d1f1b074e1 Merge 0.22.0 release notes 2014-01-17 15:55:46 -02:00
Mikhail Korobov
7b7a1d8dfd Make Filesystem storage backend default again. See GH-500. 2014-01-17 04:32:08 +06:00
Mikhail Korobov
b03fe04999 Rename AjaxCrawlableMiddleware to AjaxCrawlMiddleware 2014-01-16 23:09:37 +06:00
Pablo Hoffman
ed6fd4933f Merge pull request #524 from hobsonlane/master
documentation code example corrections per pablohoffman
2014-01-16 06:44:51 -08:00
Pablo Hoffman
71ada5476e Merge pull request #472 from redapple/exslt
Register EXSLT namespaces by default (resolves #470)
2014-01-16 06:32:05 -08:00
Daniel Graña
b9bb9bed6b Merge pull request #343 from kmike/ajax-crawlable
[MRG] AjaxCrawlableMiddleware
2014-01-16 05:07:39 -08:00
Hobson Lane
85a80d0752 remove "for brevity's sake" line and correct "Torrent item"
Torrent item -> TorrentItem class
2014-01-15 17:29:23 -08:00
Paul Tremberth
827c0cf51f Rename "regexp" prefix to "re" 2014-01-15 15:00:25 +01:00