Pablo Hoffman dbda33efa6 scrapyd: added support for storing items by default ...

Items are stored the same way as logs, in jsonlines format.

Also renamed logs_to_keep setting to jobs_to_keep.

2012-01-03 23:08:54 -02:00

..

_images

removed remaining references to scheduler middleware from doc, as it will be removed on next release

2011-05-18 19:48:48 -03:00

architecture.rst

removed remaining references to scheduler middleware from doc, as it will be removed on next release

2011-05-18 19:48:48 -03:00

commands.rst

updated documentation to remove references to old issue tracker and mercurial repos

2011-09-25 13:06:24 -03:00

downloader-middleware.rst

added new downloader middleware: ChunkedTransferMiddleware

2011-08-09 03:03:25 -03:00

email.rst

removed (somewhat hacky) MAIL_DEBUG setting

2010-08-22 22:42:00 -03:00

exceptions.rst

added CloseSpider exception, to manually close spiders

2011-07-12 14:24:10 -03:00

exporters.rst

added join_multivalued parameter to CsvItemExporter

2011-03-24 13:15:52 -03:00

extensions.rst

added LogStats extension for periodically logging basic stats (like crawled pages and scraped items)

2011-06-14 00:50:05 -03:00

feed-exports.rst

fixed PickeItemExporter bug, added unittest, and added pickle to suported feed exports formats

2011-10-25 02:36:51 -02:00

firebug.rst

Replaced default spider manager (TwistedPluginSpiderManger) with a simpler one that doesn't depend on Twisted Plugins infrastructure.

2010-07-30 17:30:32 -03:00

firefox.rst

#154: Language fixes to the documentation

2010-04-18 23:39:54 -03:00

images.rst

Simplified images pipeline by allowing it to be used without having to override it in your project. Closes #217

2010-08-31 16:03:08 -03:00

item-pipeline.rst

Updated Scrapy Tutorial to reference feed exports, instead a custom written pipeline, and extended item pipeline documentation to include a JSON writer.

2010-10-10 20:31:05 -02:00

items.rst

Removed support for default values in Scrapy items, which have proven confusing in the past

2011-05-19 21:42:46 -03:00

jobs.rst

added initial documentation about suspend and resume crawls

2011-09-02 13:12:27 -03:00

leaks.rst

Applied documentation patch provided by Lucian Ursu (closes #207)

2010-08-21 01:26:35 -03:00

link-extractors.rst

updated documentation to remove references to old issue tracker and mercurial repos

2011-09-25 13:06:24 -03:00

loaders.rst

Applied documentation patch provided by Lucian Ursu (closes #207)

2010-08-21 01:26:35 -03:00

logging.rst

Applied documentation patch provided by Lucian Ursu (closes #207)

2010-08-21 01:26:35 -03:00

request-response.rst

doc: removed duplicated callback argument from Request.replace()

2011-12-23 15:55:46 -02:00

scrapyd.rst

scrapyd: added support for storing items by default

2012-01-03 23:08:54 -02:00

selectors.rst

* Added lxml backend for XPath selectors. Closes #147

2010-10-25 14:47:10 -02:00

settings.rst

updated documentation about DEPTH_PRIORITY and DFO/BFO crawls

2011-09-23 13:22:25 -03:00

shell.rst

Updated some old messages in Scrapy shell doc

2010-09-05 04:45:43 -03:00

signals.rst

added note about engine_started signal

2011-08-07 03:57:09 -03:00

spider-middleware.rst

updated documentation about DEPTH_PRIORITY and DFO/BFO crawls

2011-09-23 13:22:25 -03:00

spiders.rst

SitemapSpider: added support for filtering which sitemaps to follow (patch contributed by Rolando Espinoza). closes #330

2011-06-23 18:18:29 -03:00

stats.rst

removed SimpledbStatsCollector from scrapy code, it was moved to https://github.com/scrapinghub/scaws

2011-07-20 10:38:16 -03:00

telnetconsole.rst

Some telnet console changes:

2011-08-08 15:01:08 -03:00

ubuntu.rst

ubuntu repos: added support for oneiric release

2011-10-25 14:26:38 -02:00

webservice.rst

Bind the web server and telnet server to a configurable interface (WEBSERVICE_HOST). The default is to bind to all interfaces. Also add documentation for WEBSERVICE_HOST and TELNETCONSOLE_HOST.

2010-11-01 00:59:04 -02:00