Nikolaos-Digenis Karagiannis
4335420f40
SpiderMW doc typo: SWP request, response
2014-03-06 16:09:37 +02:00
Pablo Hoffman
262e7599f4
Merge pull request #622 from ajw0100/generalize-file-pipeline-log-messages
...
Generalize the file pipeline log messages
2014-03-02 18:25:51 -08:00
A.J. Welch
67aa586a90
Generalize the file pipeline log messages so they are not specific to downloading images.
2014-03-02 17:55:04 -08:00
Pablo Hoffman
c99f1d2315
Merge pull request #618 from allait/master
...
Fix some small typos and errors in docs
2014-02-27 11:22:47 -08:00
Alexey Bezhan
210a0a6fe1
Fix some typos, whitespace and small errors in docs
2014-02-27 18:02:22 +00:00
Alexey Bezhan
2e59d77580
Clarify MapCompose documentation
2014-02-27 17:56:14 +00:00
Cash Costello
c532e13dcd
Added missing word in practices.rst
2014-02-27 13:08:36 -02:00
Pablo Hoffman
6d8b7b29ef
remove unused setting: DOWNLOADER_DEBUG
2014-02-27 12:16:05 -02:00
Pablo Hoffman
822adb1d5f
Merge pull request #602 from Blender3D/email
...
Added a mimetype parameter to `MailSender.send`
2014-02-20 12:05:14 -08:00
Pablo Hoffman
9e62041b57
remove no longer used setting: MAIL_DEBUG
2014-02-20 12:03:31 -02:00
Pablo Hoffman
091c336b59
rename attribute to match conventions used for XXX_DEBUG settings (in autothrottle and cookies mw)
2014-02-20 12:03:06 -02:00
Pablo Hoffman
5f42dbf9f6
Merge pull request #603 from barraponto/dynamic-itemclass-docfix
...
fixes dynamic itemclass example usage of type()
2014-02-19 09:41:47 -08:00
Capi Etheriel
1ec1100b27
fixes dynamic itemclass example usage of type()
2014-02-18 20:59:05 -03:00
Daniel Graña
70a57dc730
Merge pull request #553 from redapple/dupefilter-verbose
...
DupeFilter: add settings for verbose logging and filtered requests stats
2014-02-18 05:21:32 -08:00
Daniel Graña
ec48df7f8d
Merge pull request #555 from redapple/crawlspider-processlinks
...
CrawlSpider: support process_links as generator
2014-02-18 05:11:04 -08:00
Nikita Nikishin
a676017fe4
Fixed #441 .
2014-02-18 03:50:43 -05:00
Paul Tremberth
66fb1738a2
Remove _log_level attribute as per comments
2014-02-17 13:42:42 +01:00
Paul Tremberth
41765ca18d
DupeFilter: add setting for verbose logging + stats counter for filtered requests
2014-02-17 13:42:42 +01:00
Mikhail Korobov
42dc34f924
TST Improved twisted installation in tox.ini for Python 3.3
...
Install twisted trunk because released twisted doesn't install properly,
see https://twistedmatrix.com/trac/ticket/6539 .
Also, test-requirements are removed for 3.3 because mitmproxy doesn't
install in Python 3.3, and mock is in Python 3.3 standard library.
Note that trial scrapy is not doing what is expected because twisted doesn't
have trial runner for 3.3 yet, so this command will most likely call "trial"
outside tox virtualenv and will use incorrect interpreter.
2014-02-17 17:21:38 +06:00
Pablo Hoffman
d24212c8e5
remove references to deprecated scrapy-developers list
2014-02-16 21:44:49 -02:00
Pablo Hoffman
fcbd7b4901
Merge pull request #596 from darkrho/doc-pipeline
...
DOC Use pipelines module name instead of pipieline following default project files.
2014-02-16 14:19:52 -08:00
Rolando Espinoza
28f946b05f
DOC Use pipelines module name instead of pipieline following default project files.
2014-02-15 11:01:26 -04:00
Daniel Graña
180fc98cd8
Add 0.22.2 release notes
2014-02-14 15:45:44 -02:00
Daniel Graña
6ca49ce76a
Merge pull request #594 from dangra/593-engineslots
...
fix a reference to unexistent engine.slots.
2014-02-14 09:39:30 -08:00
Daniel Graña
b58285b635
fix a reference to unexistent engine.slots. closes #593
2014-02-14 15:31:05 -02:00
Pablo Hoffman
c886d7459f
add SEP-021 (Add-ons) - work in progress
2014-02-11 20:16:09 -02:00
Mikhail Korobov
9caf37553e
Merge pull request #590 from Digenis/master
...
downloaderMW doc typo (spiderMW doc copy remnant)
2014-02-12 02:49:30 +05:00
Nikolaos-Digenis Karagiannis
43a797e2f7
downloaderMW doc typo (spiderMW doc copy remnant)
2014-02-11 22:30:00 +02:00
tracicot
b2f4b296df
Correct typos
2014-02-10 11:46:23 -02:00
Daniel Graña
783d8e3ae1
Add 0.22.1 release notes
2014-02-08 17:09:04 -02:00
Daniel Graña
877e345d79
localhost666 can resolve under certain circumstances
...
localhost666 is resolvable if the host running the tests contains a
"search mydomain.com" in /etc/resolv.conf and a wildcard dns entry
exists for *.mydomain.com
2014-02-08 16:38:22 -02:00
Daniel Graña
45c9dab15b
Merge pull request #582 from kmike/inspect-workaround
...
[WIP] Handle cases when inspect.stack() fails
2014-02-06 19:41:32 -08:00
Daniel Graña
9e95b36a09
test inspect.stack failure
2014-02-07 01:36:43 -02:00
Daniel Graña
c12e3a58b4
Merge pull request #585 from kmike/mitmproxy-reqs-cleanup
...
[MRG] testing PIL dependency is removed because there is a new mitmproxy version
2014-02-05 14:39:56 -08:00
Daniel Graña
3d4fe60e47
Merge pull request #584 from dangra/581-deprecated-subclass-fix
...
Fix wrong checks on subclassing of deprecated classes
2014-02-05 13:48:40 -08:00
Daniel Graña
ee896b154c
Fix wrong checks on subclassing of deprecated classes. closes #581
2014-02-05 19:47:04 -02:00
Mikhail Korobov
8e88fbc255
testing PIL dependency is removed because there is a new mitmproxy version
2014-02-06 00:49:26 +06:00
Mikhail Korobov
8a1905e6ee
Handle cases when inspect.stack() fails
2014-02-05 02:28:51 +06:00
Daniel Graña
45417e6b03
Merge pull request #574 from redapple/htmllx-tests
...
Fix HtmlParserLinkExtractor and tests after #485 merge
2014-02-02 19:09:02 -08:00
Mikhail Korobov
b74e7dd30a
Merge pull request #575 from redapple/docs-tutorialindent
...
Docs: 4-space indent for final spider example
2014-02-01 15:07:01 -08:00
Paul Tremberth
57f30bcb04
Docs: 4-space indent for final spider example
2014-02-01 23:34:55 +01:00
Paul Tremberth
8017d85d8a
Fix HtmlParserLinkExtractor and tests after #485 merge
2014-02-01 22:52:56 +01:00
Pablo Hoffman
e31fb49320
make 'basic' the default template spider in genspider, and added info with next steps to startproject. closes #488
2014-02-01 17:38:31 -02:00
Pablo Hoffman
c928eef585
Merge pull request #485 from bblanchon/sgml-extractor-link-text
...
SgmlLinkExtractor: Fixed link text when there is an inner tag
2014-02-01 10:28:56 -08:00
Paul Tremberth
38a96fba2d
CrawSpider: support process_links as generator
...
Adding tests for CrawlSpider's process_links
2014-01-31 21:25:05 +01:00
Daniel Graña
e1c6d3ffdf
Merge pull request #566 from redapple/offsite-stats
...
OffsiteMiddleware: add 2 stats counters
2014-01-31 10:05:35 -08:00
Daniel Graña
1e553ec0cd
Merge pull request #570 from redapple/travistests
...
[MRG] Fix tests for Travis-CI build
2014-01-31 09:16:54 -08:00
Paul Tremberth
cc157f182b
Fix tests for Travis-CI build
2014-01-31 01:27:54 +01:00
Mikhail Korobov
05158803df
Merge pull request #571 from darkrho/httpcache-storage-doc
...
DOC Fixed HTTPCACHE_STORAGE typo in the default value which is now Files...
2014-01-30 08:48:39 -08:00
Rolando Espinoza
a6279fe95b
DOC Fixed HTTPCACHE_STORAGE typo in the default value which is now Filesystem instead Dbm.
2014-01-30 11:53:42 -04:00
