1603 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Pablo Hoffman	566758eeb7	removed useless --restrict command line argument	2009-08-28 19:38:04 -03:00
Pablo Hoffman	046e63b1cc	added --version command line option	2009-08-28 18:26:29 -03:00
Pablo Hoffman	18e9fd9771	some better code reusage	2009-08-28 18:07:35 -03:00
Pablo Hoffman	7dd43da9a5	removed unnecesary assertEqual's	2009-08-28 18:01:06 -03:00
Pablo Hoffman	83a2b580f7	renamed test_scrapy_ctl.py to test_commands.py ... --HG-- rename : scrapy/tests/test_scrapy_ctl.py => scrapy/tests/test_commands.py	2009-08-28 17:58:50 -03:00
Pablo Hoffman	ee40929df4	some line wrapping at 80 cols	2009-08-28 17:52:44 -03:00
Pablo Hoffman	3e7e321a07	sorted out import order and removed unused imports from previous changeset	2009-08-28 17:47:45 -03:00
Ismael Carnales	0b68d4bbef	added tests for scrapy-ctl commands	2009-08-28 14:42:07 -03:00
Ismael Carnales	3616ccb479	changed SCRAPYSETTINGS_MODULE to SCRAPY_SETTINGS_MODULE	2009-08-28 11:20:05 -03:00
Pablo Hoffman	0bfa1a910c	removed wrong docstring	2009-08-28 02:21:32 -03:00
Pablo Hoffman	da20cf53f5	added compatibility with python 2.5	2009-08-27 20:05:11 -03:00
Pablo Hoffman	609aed4553	added inspect_response() function for inspecting responses from spiders	2009-08-27 19:33:33 -03:00
Pablo Hoffman	ea4f16bae6	refactored scrapy shell implementation, dropping IPython dependency, and adding a new 'view' shortcut	2009-08-27 18:24:08 -03:00
Pablo Hoffman	13be33f0e7	added open_in_browser function to scrapy.utils.response	2009-08-27 18:20:51 -03:00
Pablo Hoffman	02de8cb6fa	some other minor code cleanups for Settings class	2009-08-27 14:41:49 -03:00
Pablo Hoffman	90e6aefb4d	some refactoring to Settings class	2009-08-27 14:08:48 -03:00
Pablo Hoffman	78481bf4d3	fixed bug when spider returns None	2009-08-27 12:10:31 -03:00
Pablo Hoffman	ab0def3f8b	made scrapy.command.cmdline module executable from command line	2009-08-27 11:49:35 -03:00
Pablo Hoffman	625137464f	fixed bug in help command (thanks slav0nic for reporting)	2009-08-26 16:18:25 -03:00
Ismael Carnales	0e163a9816	added override field save test to DjangoItem	2009-08-26 11:58:40 -03:00
Ismael Carnales	62e03419b7	fixed bug in DjangoItem	2009-08-26 11:45:59 -03:00
Ismael Carnales	8efe6eb55e	made DjangoItem a descendant of Item and its metaclass	2009-08-26 11:38:49 -03:00
Ismael Carnales	fb39bca24f	added djangoitem doc	2009-08-26 08:44:22 -03:00
Pablo Hoffman	65ab611fb0	more updates to HttpErrorMiddleware doc	2009-08-26 08:30:18 -03:00
Pablo Hoffman	44783a3a06	minor improvements to FAQ entry	2009-08-26 00:18:58 -03:00
Pablo Hoffman	4dba75a73f	updated HttpErrorMiddleware doc	2009-08-25 20:13:58 -03:00
Daniel Grana	14c6c4623a	remove debug line :(	2009-08-25 16:51:41 -03:00
Daniel Grana	fe4683d637	pylinted decorators utils	2009-08-25 16:50:40 -03:00
Daniel Grana	9f1ed63763	report caller's file:lineno of deprecated function instead of file:lineno of deprecated function	2009-08-24 20:27:08 -03:00
Ismael Carnales	9bafa7325c	fixed errors in djangoitem tests	2009-08-24 17:30:58 -03:00
Ismael Carnales	decbdc5346	added DjangoItem item class	2009-08-24 17:16:18 -03:00
Daniel Grana	7b30c31b59	Automated merge with ssh://hg.scrapy.org/scrapy	2009-08-24 16:46:25 -03:00
Daniel Grana	9fbaef90fe	fix spider templates handling in genspider command	2009-08-24 16:46:20 -03:00
Pablo Hoffman	8a074c9cb5	removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command	2009-08-24 15:43:36 -03:00
Ismael Carnales	39540b188a	changed torrent in overview doc	2009-08-24 15:11:04 -03:00
Ismael Carnales	4b5aa30867	minor update to tutorial	2009-08-24 14:34:17 -03:00
Pablo Hoffman	0363040884	doc: added FAQ entry about Accept-Language	2009-08-24 13:56:44 -03:00
Ismael Carnales	85282a4b76	added scrapy commandline scripts doc	2009-08-24 12:02:44 -03:00
Pablo Hoffman	ead8cb9fac	removed documentation about ugly DontCloseDomain exception (which will be removed in the future)	2009-08-24 11:57:21 -03:00
Pablo Hoffman	74f706b356	renamed "parse_item" method of XMLFeedSpider to "parse_node", keeping backwards compatibility	2009-08-24 10:54:34 -03:00
Pablo Hoffman	31693eb90f	dropped "cache" attribute of Request and Response objects	2009-08-24 10:34:05 -03:00
Pablo Hoffman	79bf4c817a	replaced old memoizemethod decorator with a more efficient one (memoizemethod_noargs)	2009-08-24 10:21:04 -03:00
Pablo Hoffman	4f2925420f	minor improvements to Response.__repr__	2009-08-24 09:54:02 -03:00
Pablo Hoffman	b71de57b21	some simplifications to Request and Response classes	2009-08-24 09:47:26 -03:00
Pablo Hoffman	81832773ee	ported get_base_url and get_meta_refresh to use WeakKeyDictionary (instead of Request.cache)	2009-08-24 08:58:51 -03:00
Pablo Hoffman	49e11d34c2	switched request_fingerprint to use WeakKeyDictionary for caching (instead of Request.cache)	2009-08-24 08:45:23 -03:00
Pablo Hoffman	0186c6937a	HTTP auth middleware: added doc and unittest	2009-08-24 08:07:20 -03:00
Pablo Hoffman	c7e916407d	fixed test name	2009-08-24 07:57:00 -03:00
Pablo Hoffman	2cb0cfe7ea	simplified some code	2009-08-24 07:29:30 -03:00
Daniel Grana	73e7788ba2	dont try to guess if spider output is iterable for Items and Requests objects	2009-08-24 01:25:14 -03:00