5 Commits

Author	SHA1	Message	Date
Victoria Terenina (torymur)	667864ae94	testing robotstxt error	2015-04-30 16:28:57 +03:00
Julia Medina	d7c444fefb	Move scrapy/contrib/downloadermiddleware to scrapy/downloadermiddlewares	2015-04-29 21:24:30 -03:00
Berker Peksag	31e5f164d4	Import unittest.mock if available. ... mock is in the stdlib since Python 3.3.	2015-03-08 15:03:04 +02:00
Mikhail Korobov	36eec8f413	dont_obey_robotstxt meta key; don't process requests to /robots.txt	2014-09-23 00:10:43 +06:00
Daniel Graña	242c08553f	move tests under root dir	2014-07-30 19:45:08 -03:00