samus_ ebd5f465aa this changeset improves the extractors' implementation: ...

* moved LinkExtractor.extract_links to a private method and created wrapper in order to be able to work with text directly
* removed fugly new_response_from_xpaths from scrapy.utils.response and replaced it with a better internal algorithm
* moved former _normalize_input from scrapy.utils.iterators to scrapy.utils.response to fill the hole
* turned extractors' output lists into generators; this is safe because the result is always used in for..in constructs
* adapted test for generators (test should be rewritted anyways)

--HG--
extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40597

2009-01-02 08:42:36 +00:00

scrapy

this changeset improves the extractors' implementation:

2009-01-02 08:42:36 +00:00

sites

the badge is back to green ... hulk is angry

2008-12-30 11:27:19 +00:00

.hgignore

dummy file to shift a revision

2009-05-04 18:16:20 +00:00

Description

Scrapy, a fast high-level web crawling & scraping framework for Python.

crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python

BSD-3-Clause 128 MiB

Languages

Python 99.8%

HTML 0.1%