Daniel Graña d74b60051d take in count response latencies when testing download delays

2013-07-16 16:22:29 -03:00

..

commands

obey request method when scrapy deploy is redirected to a new endpoint

2013-05-30 18:34:59 -03:00

contracts

scrapy contracts: python2.6 compat

2012-10-28 18:23:21 +01:00

contrib

Merge pull request #334 from nramirezuy/feedexport-remove_multispider

2013-07-03 14:26:49 -07:00

contrib_exp

format log lines lazily in case they are dropped by loglevels

2012-08-31 17:14:35 -03:00

core

Merge pull request #329 from kalessin/ftphandler

2013-07-15 16:39:46 -07:00

http

fix broken doctests

2013-04-25 11:56:56 -03:00

selector

added remove_namespaces() method to XmlXPathSelector objects

2013-01-18 12:20:03 -02:00

settings

added ftp handler

2013-06-27 16:52:59 -02:00

templates

Fix broken doc links.

2012-11-12 22:43:42 +02:00

tests

take in count response latencies when testing download delays

2013-07-16 16:22:29 -03:00

utils

use lxml parser with recover option to parse invalid sitemaps. closes #347

2013-07-15 12:26:16 -03:00

xlib

improve twisted version tests and enable HTTP11 handler by default if supported

2013-06-04 16:59:35 -03:00

__init__.py

improve twisted version tests and enable HTTP11 handler by default if supported

2013-06-04 16:59:35 -03:00

cmdline.py

pluggable sub-commands for scrapy comand-line

2013-03-06 05:25:38 +11:00

command.py

added --pdb command option to enable pdb debugger on failure.

2013-02-11 12:34:29 -04:00

conf.py

better backwards compatibility for scrapy.conf.settings

2012-10-25 11:41:40 -02:00

crawler.py

Log overriden Scrapy settings when Scrapy starts.

2013-02-28 11:35:11 -02:00

dupefilter.py

log (just once) when duplicate requests are filtered out. closes #105, #249

2013-03-12 19:28:43 -03:00

exceptions.py

proper unittest-like output for scrapy contracts

2012-10-27 23:26:40 +02:00

extension.py

Made ExtensionManager a subclass of MiddlewareManager

2010-08-22 05:33:08 -03:00

interfaces.py

removed class method from_settings from ISpiderManager interface

2011-08-26 09:24:01 -03:00

item.py

deleted unused import

2013-04-19 14:51:59 -03:00

link.py

warn if Link objects are instantiated with unicode urls

2012-05-16 13:12:25 -03:00

linkextractor.py

added more extensions to ignore on link extractors

2012-08-07 14:23:50 -03:00

log.py

log optional features available on startup

2013-06-04 19:25:26 -03:00

logformatter.py

Log level return from LogFormatter methods

2012-12-29 11:43:41 +07:00

mail.py

refactored MailSender to get rid of scrapy.conf singleton, also removed ill-designed scrapy.mail.mail_sent signal

2012-09-11 16:27:19 -03:00

middleware.py

format log lines lazily in case they are dropped by loglevels

2012-08-31 17:14:35 -03:00

mime.types

moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes

2011-08-07 02:49:57 -03:00

project.py

Another step towards singleton removal: deprecated crawler singleton import (from scrapy.project import crawler) by a new class method that extensions can implement to receive the crawler

2011-08-08 11:42:44 -03:00

resolver.py

removed wrong blocking api usage (socket.gethostbyname()) from downloader when using CONCURRENT_REQUESTS_PER_IP

2011-08-03 23:55:59 -03:00

responsetypes.py

- removed scrapy.conf singleton from scrapy.log, scrapy.responsetypes,

2012-09-19 03:03:34 -03:00

shell.py

fetch command should catch IgnoreRequest exception

2013-03-02 20:13:14 -06:00

signalmanager.py

remove debugging code

2013-02-27 03:52:55 -02:00

signals.py

removed request_received and added request_scheduled

2013-06-26 16:45:46 -03:00

spider.py

spider.log to pass keyword arguments into twisted log.msg

2013-02-11 05:00:06 +11:00

spidermanager.py

Removed signals/stats singletons

2012-08-21 18:32:30 -03:00

squeue.py

ported code to use queuelib

2013-04-23 17:48:09 -03:00

stats.py

Removed signals/stats singletons

2012-08-21 18:32:30 -03:00

statscol.py

minor message update: spider stats -> Scrapy stats

2012-10-12 16:53:44 -02:00

telnet.py

change manager in telnet variable to crawler

2013-05-08 11:58:15 +08:00

VERSION

get scrapy version from package data

2013-02-06 11:44:26 -02:00

webservice.py

format log lines lazily in case they are dropped by loglevels

2012-08-31 17:14:35 -03:00