Paul Tremberth a19dfafb25 Support case-insensitive domains in url_is_from_any_domain()

2014-04-16 22:33:30 +02:00

..

__init__.py

mv scrapy/trunk to root as part of svn2hg migration

2009-05-06 15:55:17 -03:00

conf.py

Reversed scrapy.cfg lookup order so that the one in the current project has more precedence. Also added alternative system-wide location for windows.

2010-10-18 03:18:54 -02:00

console.py

IPython refuses to update the namespace. fix #396

2013-10-10 00:57:14 -02:00

datatypes.py

Drop Python 2.6 support

2013-10-29 13:44:00 -02:00

decorator.py

Deprecate body_or_str helper function only used by xml iterators

2013-11-19 19:21:54 -02:00

defer.py

process_parallel was leaking the failures on its internal deferreds. closes #458

2013-11-09 02:12:52 -02:00

deprecate.py

Merge pull request #582 from kmike/inspect-workaround

2014-02-06 19:41:32 -08:00

display.py

Added "from __future__ import print_function" in all relevant places except xlib

2013-10-20 11:55:07 +06:00

engine.py

fix a reference to unexistent engine.slots. closes #593

2014-02-14 15:31:05 -02:00

ftp.py

Added new Feed exports extension with documentation and storage tests. Closes #197.

2010-08-17 14:27:48 -03:00

gz.py

fixed scrapy.utils.gz.gunzip() broken after changes from Python 2.7.3 to 2.7.4

2013-08-09 18:20:04 -03:00

http.py

added new downloader middleware: ChunkedTransferMiddleware

2011-08-09 03:03:25 -03:00

httpobj.py

remove Url class and use str instead for Request and Response urls. Also added urlparse_cached function for achieving the same caching functionality provided by old Url class

2009-08-17 21:16:55 -03:00

iterators.py

Do not call body_as_unicode on non text responses. closes #462

2013-11-19 20:13:34 -02:00

job.py

Initial support for a persistent scheduler, to support pausing and resuming

2011-08-02 11:57:55 -03:00

jsonrpc.py

Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py

2013-10-20 01:59:35 +06:00

markup.py

Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.

2011-04-18 22:37:19 -03:00

misc.py

replaced __import__ by importlib.import_module.

2013-10-27 18:33:51 -04:00

multipart.py

Moved several functions from scrapy.utils.{http,markup,multipart,response,url} (and their tests) to a new library called 'w3lib'. Scrapy will now depend on w3lib.

2011-04-18 22:37:19 -03:00

ossignal.py

Some enhancements to Scrapy core:

2009-09-03 08:27:48 -03:00

project.py

replaced __import__ by importlib.import_module.

2013-10-27 18:33:51 -04:00

python.py

do not return applied arguments on partial functions

2013-12-30 09:25:11 -02:00

reactor.py

more core refactoring including moving engine next request call logic to a separate class

2011-07-25 10:46:00 -03:00

reqser.py

Initial support for a persistent scheduler, to support pausing and resuming

2011-08-02 11:57:55 -03:00

request.py

Added "from __future__ import print_function" in all relevant places except xlib

2013-10-20 11:55:07 +06:00

response.py

Deprecate body_or_str helper function only used by xml iterators

2013-11-19 19:21:54 -02:00

serialize.py

Rename BaseSpider to Spider. See GH-495.

2013-12-30 19:46:41 +06:00

signal.py

format log lines lazily in case they are dropped by loglevels

2012-08-31 17:14:35 -03:00

sitemap.py

Fixed XXE flaw in sitemap reader

2014-04-01 23:54:04 +08:00

spider.py

Rename BaseSpider to Spider. See GH-495.

2013-12-30 19:46:41 +06:00

template.py

Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25

2012-03-01 08:18:12 -02:00

test.py

TST fix file descriptor leak and a bad variable name in get_testlog

2014-03-19 04:18:04 +06:00

testproc.py

Raise error when settings module is missing.

2012-10-03 12:31:19 -03:00

testsite.py

Added "from __future__ import print_function" in all relevant places except xlib

2013-10-20 11:55:07 +06:00

trackref.py

python3: scrapy.__version__, NoneType, urlparse_monkeypatches

2013-11-03 22:20:33 +06:00

txweb.py

allow remote ajax requests to the webservice

2013-03-19 12:00:49 +01:00

url.py

Support case-insensitive domains in url_is_from_any_domain()

2014-04-16 22:33:30 +02:00