scrapy/tests/sample_data/link_extractor/sgml_linkextractor.html

<html>
<head>
<base href='http://example.com' />
<title>Sample page with links for testing RegexLinkExtractor</title>
</head>
<body>
<div id='wrapper'>
<div id='subwrapper'>
<area href='sample1.html' />
<a href='sample2.html'>sample 2<img src='sample2.jpg'/></a>
</div>
<a href='http://example.com/sample3.html' title='sample 3'>sample 3 text</a>
<a href='sample3.html'>sample 3 repetition</a>
<a href='http://www.google.com/something'></a>
<a href='http://example.com/innertag.html'><b>inner</b> tag</a>
</div>
</body>
</html>
. Added tests for RegexLinkExtractor . Modified LinkExtractor in order to percent-encode urls using the response encoding . Improved LinkExtractors processing of unique links --HG-- rename : scrapy/trunk/scrapy/tests/sample_data/image_linkextractor.html => scrapy/trunk/scrapy/tests/sample_data/link_extractor/image_linkextractor.html extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40609 2009-01-02 18:32:55 +00:00			`<html>`
			`<head>`
			`<base href='http://example.com' />`
			`<title>Sample page with links for testing RegexLinkExtractor</title>`
			`</head>`
			`<body>`
			`<div id='wrapper'>`
			`<div id='subwrapper'>`
. Added strip() to link texts in LinkExtractor in order to avoid extracting line breaks and such . Added test for restrict_xpaths in RegexLinkExtractor --HG-- extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40681 2009-01-08 11:05:15 +00:00			`<area href='sample1.html' />`
			`<a href='sample2.html'>sample 2<img src='sample2.jpg'/></a>`
. Added tests for RegexLinkExtractor . Modified LinkExtractor in order to percent-encode urls using the response encoding . Improved LinkExtractors processing of unique links --HG-- rename : scrapy/trunk/scrapy/tests/sample_data/image_linkextractor.html => scrapy/trunk/scrapy/tests/sample_data/link_extractor/image_linkextractor.html extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40609 2009-01-02 18:32:55 +00:00			`</div>`
linkextractor: unique after urljoin_rfc Now, '/foo.html' and 'http://example.org/foo.html' are considered as the same and only one is kept. Signed-off-by: Ping Yin <pkufranky@gmail.com> 2010-04-02 19:45:30 +08:00			`<a href='http://example.com/sample3.html' title='sample 3'>sample 3 text</a>`
. Added tests for RegexLinkExtractor . Modified LinkExtractor in order to percent-encode urls using the response encoding . Improved LinkExtractors processing of unique links --HG-- rename : scrapy/trunk/scrapy/tests/sample_data/image_linkextractor.html => scrapy/trunk/scrapy/tests/sample_data/link_extractor/image_linkextractor.html extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40609 2009-01-02 18:32:55 +00:00			`<a href='sample3.html'>sample 3 repetition</a>`
			`<a href='http://www.google.com/something'></a>`
BaseSgmlLinkExtractor: Added unit test of a link with an inner tag 2013-12-07 20:42:21 +01:00			`<a href='http://example.com/innertag.html'><b>inner</b> tag</a>`
. Added tests for RegexLinkExtractor . Modified LinkExtractor in order to percent-encode urls using the response encoding . Improved LinkExtractors processing of unique links --HG-- rename : scrapy/trunk/scrapy/tests/sample_data/image_linkextractor.html => scrapy/trunk/scrapy/tests/sample_data/link_extractor/image_linkextractor.html extra : convert_revision : svn%3Ab85faa78-f9eb-468e-a121-7cced6da292c%40609 2009-01-02 18:32:55 +00:00			`</div>`
			`</body>`
			`</html>`