Pablo Hoffman 564abd10ad Refactored HttpCache middleware: ...

* simplified code
* performance improvements
* removed awkward/unused domain sectorization
* it can now receive Settings on constructor
* added unittests
* added documentation about filesystem storage structure

Also made scrapy.conf.Settings objects instantiable with a dict which is used to override default settings.

2009-11-13 14:25:47 -02:00

..

_images

mv scrapy/trunk to root as part of svn2hg migration

2009-05-06 15:55:17 -03:00

architecture.rst

added link to architecture overview and fixed old link

2009-07-16 19:15:19 -03:00

downloader-middleware.rst

Refactored HttpCache middleware:

2009-11-13 14:25:47 -02:00

email.rst

merged topics and reference doc

2009-08-18 14:05:15 -03:00

exceptions.rst

removed documentation about ugly DontCloseDomain exception (which will be removed in the future)

2009-08-24 11:57:21 -03:00

exporters.rst

Changed item pipeline API to pass spider references (instead of domain names) to process_item() method

2009-11-06 13:46:36 -02:00

extensions.rst

renamed CloseDomain extension to CloseSpider, and renamed CLOSEDOMAIN_* settings to CLOSESPIDER_*

2009-11-06 15:54:17 -02:00

firebug.rst

moved scrapy.newitem to scrapy.item and declared newitem api officially stable. updated docs and example project. deprecated old ScrapedItem

2009-08-19 21:39:58 -03:00

firefox.rst

mv scrapy/trunk to root as part of svn2hg migration

2009-05-06 15:55:17 -03:00

images.rst

moved images pipeline documentation to stable doc

2009-10-07 22:57:25 -02:00

item-pipeline.rst

Changed item pipeline API to pass spider references (instead of domain names) to process_item() method

2009-11-06 13:46:36 -02:00

items.rst

moved scrapy.newitem to scrapy.item and declared newitem api officially stable. updated docs and example project. deprecated old ScrapedItem

2009-08-19 21:39:58 -03:00

leaks.rst

* Renamed domain_{opened,closed,idle} signals to spider_{opened,closed,idle}

2009-11-03 00:39:02 -02:00

link-extractors.rst

fixed error in link extractors doc, thanks tarasm

2009-08-21 08:34:53 -03:00

loaders.rst

moved scrapy.xpath to scrapy.selector

2009-08-19 21:50:52 -03:00

logging.rst

updated logging doc to include new spider argument in log functions

2009-11-04 14:49:24 -02:00

request-response.rst

added clarification about new dont_click argument of FormRequest.from_response() method

2009-10-29 13:47:10 -02:00

scrapy-ctl.rst

some deployment changes in preparation for the 0.7.0 release candidate

2009-09-16 22:40:36 -03:00

selectors.rst

moved scrapy.xpath to scrapy.selector

2009-08-19 21:50:52 -03:00

settings.rst

Refactored HttpCache middleware:

2009-11-13 14:25:47 -02:00

shell.rst

added inspect_response() function for inspecting responses from spiders

2009-08-27 19:33:33 -03:00

signals.rst

* Renamed domain_{opened,closed,idle} signals to spider_{opened,closed,idle}

2009-11-03 00:39:02 -02:00

spider-middleware.rst

made offsite middleware log messages when filtering out requests

2009-11-12 10:17:21 -02:00

spiders.rst

modified doc to reflect the new spider callback return policy (lists not needed)

2009-09-22 11:25:40 -03:00

stats.rst

* Renamed domain_{opened,closed,idle} signals to spider_{opened,closed,idle}

2009-11-03 00:39:02 -02:00

telnetconsole.rst

moved engine.getstatus() method to scrapy.utils.engine function, to leave reporting logic out of engine code. added est() shortcut to telnet console

2009-08-31 12:44:32 -03:00

webconsole.rst

merged topics and reference doc

2009-08-18 14:05:15 -03:00