4558 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Mikhail Korobov	6f000b8cd4	Merge pull request #952 from Digenis/unicode_xpath_exception ... [MRG+1] encode unicode selector exception	2015-04-11 00:38:42 +05:00
Nikolaos-Digenis Karagiannis	bf301b7328	encode invalid xpath with unicode_escape under PY2 ... The exception quotes an xpath string which may be unicode.	2015-04-10 22:23:40 +03:00
Julia Medina	f8ca5d1092	Merge pull request #1134 from nyov/remove-contrib ... [MRG+1] dissolve contrib_exp	2015-04-10 10:33:43 -03:00
Julia Medina	543d02bc64	Avoid name clashing in deploy.py, fixes #1143	2015-04-09 21:36:24 -03:00
Pablo Hoffman	39fd2e62ef	fix typo in deploy.rst	2015-04-09 18:01:11 -03:00
Pablo Hoffman	1a12922b77	improve scrapy deploy documentation	2015-04-09 17:39:01 -03:00
Pablo Hoffman	9ea309c354	rename deployment.rst -> deploy.rst (consist with others like debug.rst)	2015-04-09 16:56:35 -03:00
Pablo Hoffman	d8184a7239	Merge pull request #1124 from rdowinton/deployment-doc ... Added deployment section covering scrapyd-deploy and shub	2015-04-09 16:53:25 -03:00
nyov	6d48c19acd	dissolve scrapy.contrib_exp	2015-04-07 21:20:48 +00:00
Pablo Hoffman	4b11501eb5	Merge pull request #963 from tpeng/fix-xmliter-lxml ... [MRG+1] support namespace prefix in xmliter_lxml	2015-04-07 18:13:01 -03:00
Daniel Graña	9706119336	Merge pull request #1128 from Curita/move-spider-settings-population-to-crawler ... [MRG+1] Move spider settings population from CrawlerRunner to Crawler.__init__	2015-04-04 18:08:05 -03:00
Julia Medina	fcf97001a5	Merge pull request #1121 from nyov/nyov/py3-urllib ... [MRG+1] more python3 compatibility changes for urllib	2015-04-02 22:33:43 -03:00
Julia Medina	6f9265b44b	Move spider settings population to Crawler.__init__	2015-04-01 23:29:10 -03:00
Julia Medina	66aef0488a	Merge pull request #1127 from nyov/docs-fix ... documentation build warning fixes	2015-04-01 17:02:28 -03:00
nyov	dc88be75e2	more python3 compatibility changes for urllib	2015-04-01 19:50:56 +00:00
nyov	92b574309e	documentation build warning fixes	2015-04-01 19:46:21 +00:00
Daniel Graña	27591b55fc	Merge pull request #1123 from sibiryakov/reactor-threadpool-size ... [MRG+1] Reactor threadpool max size setting	2015-04-01 15:08:03 -03:00
Alexander Sibiryakov	b794cdaf4b	Broad crawls notes.	2015-04-01 12:07:03 +02:00
Alexander Sibiryakov	e7b274edf3	Reformat to 80 characters per line.	2015-04-01 11:49:55 +02:00
Alexander Sibiryakov	94fceb4c15	Fixing underscore size.	2015-04-01 11:25:10 +02:00
Alexander Sibiryakov	5916df64cd	Removing unnecessary import.	2015-04-01 11:24:12 +02:00
Daniel Graña	ec4251afd7	Merge pull request #1089 from drack3800/master ... [MRG+1] Add test for webclient with POST method and no body given	2015-03-31 17:30:08 -03:00
Richard Dowinton	2d142d6401	Added deployment section covering scrapyd-deploy and shub	2015-03-31 12:17:31 +01:00
Alexander Sibiryakov	5864d291d4	Setting documentation.	2015-03-31 11:10:56 +02:00
Alexander Sibiryakov	c1cd019f56	Setting maximum thread pool size in reactor.	2015-03-31 10:56:31 +02:00
Elias Dorneles	0c74821805	Merge pull request #1112 from eliasdorneles/minor-grammar-fixes ... Some minor grammar fixes	2015-03-27 21:23:55 -03:00
Elias Dorneles	18c5bc75c2	some more minor grammar fixes	2015-03-27 21:00:21 -03:00
Elias Dorneles	7135c4e694	some minor grammar fixes	2015-03-27 17:56:56 -03:00
Nicolás Alejandro Ramírez Quiros	a3702e749f	Merge pull request #1073 from eliasdorneles/add-more-settings-to-template ... [MRG+1] Adding more settings to project template	2015-03-27 15:37:26 -03:00
Pablo Hoffman	bb4c922d85	Merge pull request #1081 from scrapy/dict-items ... Allow spiders to return dicts.	2015-03-27 15:19:27 -03:00
Daniel Graña	55a23d102f	Merge pull request #1086 from Curita/response-urljoin ... Add Response.urljoin() helper	2015-03-27 15:17:54 -03:00
Julia Medina	f4e241a018	Merge pull request #1106 from eliasdorneles/overview-page-improvements ... [MRG+1] some improvements to overview page	2015-03-27 15:16:33 -03:00
nyov	84edc2ebc7	Add Response.urljoin() testcase ... and add evaluation of base-url for HtmlResponse.	2015-03-27 05:59:01 +00:00
Mikhail Korobov	39085ae18f	Merge pull request #1098 from nyov/nyov/userconfig ... [+1 MRG]look in ~/.config/scrapy.cfg for user config	2015-03-27 02:11:35 +05:00
nyov	1134a9cab0	config: look in ~/.config/scrapy.cfg as well	2015-03-26 20:36:14 +00:00
Mikhail Korobov	1ce0425542	Merge pull request #1108 from pbronez/master ... Converted sel.xpath() calls to response.xpath() in Extracting the data. Fixes GH-1107.	2015-03-27 00:52:17 +05:00
Peter Bronez	475766c73a	Converted sel.xpath() calls to response.xpath() in Extracting the data	2015-03-26 15:34:30 -04:00
Elias Dorneles	4dcecc98f9	moved example data to a better place	2015-03-26 15:45:17 -03:00
Elias Dorneles	7402e27230	fix community link	2015-03-26 15:35:31 -03:00
Elias Dorneles	729861c864	fixing indentation	2015-03-26 15:31:42 -03:00
Elias Dorneles	13d0ecde77	addressing more review comments, to avoid ambiguity on desired reading flow	2015-03-26 15:26:16 -03:00
Elias Dorneles	76e3bf1250	addressing comments from the review plus further editing	2015-03-26 14:26:20 -03:00
Elias Dorneles	8f4a268f37	added bit about async requests, improved phrasing	2015-03-26 12:14:56 -03:00
Elias Dorneles	32423d4a33	some improvements to overview page	2015-03-25 19:27:52 -03:00
Mikhail Korobov	e3e60da6c2	Merge pull request #1105 from ramiro/patch-1 ... Add missing callback arg in jobs topic example.	2015-03-26 03:19:39 +05:00
Ramiro Morales	933dbc6be6	Oops	2015-03-25 18:33:17 -03:00
Ramiro Morales	ca2575001e	Add missing callback arg in jobs topic example.	2015-03-25 18:32:20 -03:00
drack3800	6afd1a78bd	style fix	2015-03-25 20:43:07 +03:00
Daniel Graña	ad36de4e62	Merge pull request #1101 from nyov/nyov/tls-sni ... handle TLS SNI	2015-03-24 18:21:10 -03:00
nyov	aaeb837db4	handle TLS SNI if we have twisted>=14.0 ... (closes #981, #1101)	2015-03-24 10:52:29 +00:00