Pablo Hoffman
7dd43da9a5
removed unnecesary assertEqual's
2009-08-28 18:01:06 -03:00
Pablo Hoffman
83a2b580f7
renamed test_scrapy_ctl.py to test_commands.py
...
--HG--
rename : scrapy/tests/test_scrapy_ctl.py => scrapy/tests/test_commands.py
2009-08-28 17:58:50 -03:00
Pablo Hoffman
ee40929df4
some line wrapping at 80 cols
2009-08-28 17:52:44 -03:00
Pablo Hoffman
3e7e321a07
sorted out import order and removed unused imports from previous changeset
2009-08-28 17:47:45 -03:00
Ismael Carnales
0b68d4bbef
added tests for scrapy-ctl commands
2009-08-28 14:42:07 -03:00
Ismael Carnales
3616ccb479
changed SCRAPYSETTINGS_MODULE to SCRAPY_SETTINGS_MODULE
2009-08-28 11:20:05 -03:00
Pablo Hoffman
0bfa1a910c
removed wrong docstring
2009-08-28 02:21:32 -03:00
Pablo Hoffman
da20cf53f5
added compatibility with python 2.5
2009-08-27 20:05:11 -03:00
Pablo Hoffman
609aed4553
added inspect_response() function for inspecting responses from spiders
2009-08-27 19:33:33 -03:00
Pablo Hoffman
ea4f16bae6
refactored scrapy shell implementation, dropping IPython dependency, and adding a new 'view' shortcut
2009-08-27 18:24:08 -03:00
Pablo Hoffman
13be33f0e7
added open_in_browser function to scrapy.utils.response
2009-08-27 18:20:51 -03:00
Pablo Hoffman
02de8cb6fa
some other minor code cleanups for Settings class
2009-08-27 14:41:49 -03:00
Pablo Hoffman
90e6aefb4d
some refactoring to Settings class
2009-08-27 14:08:48 -03:00
Pablo Hoffman
78481bf4d3
fixed bug when spider returns None
2009-08-27 12:10:31 -03:00
Pablo Hoffman
ab0def3f8b
made scrapy.command.cmdline module executable from command line
2009-08-27 11:49:35 -03:00
Pablo Hoffman
625137464f
fixed bug in help command (thanks slav0nic for reporting)
2009-08-26 16:18:25 -03:00
Ismael Carnales
0e163a9816
added override field save test to DjangoItem
2009-08-26 11:58:40 -03:00
Ismael Carnales
62e03419b7
fixed bug in DjangoItem
2009-08-26 11:45:59 -03:00
Ismael Carnales
8efe6eb55e
made DjangoItem a descendant of Item and its metaclass
2009-08-26 11:38:49 -03:00
Ismael Carnales
fb39bca24f
added djangoitem doc
2009-08-26 08:44:22 -03:00
Pablo Hoffman
65ab611fb0
more updates to HttpErrorMiddleware doc
2009-08-26 08:30:18 -03:00
Pablo Hoffman
44783a3a06
minor improvements to FAQ entry
2009-08-26 00:18:58 -03:00
Pablo Hoffman
4dba75a73f
updated HttpErrorMiddleware doc
2009-08-25 20:13:58 -03:00
Daniel Grana
14c6c4623a
remove debug line :(
2009-08-25 16:51:41 -03:00
Daniel Grana
fe4683d637
pylinted decorators utils
2009-08-25 16:50:40 -03:00
Daniel Grana
9f1ed63763
report caller's file:lineno of deprecated function instead of file:lineno of deprecated function
2009-08-24 20:27:08 -03:00
Ismael Carnales
9bafa7325c
fixed errors in djangoitem tests
2009-08-24 17:30:58 -03:00
Ismael Carnales
decbdc5346
added DjangoItem item class
2009-08-24 17:16:18 -03:00
Daniel Grana
7b30c31b59
Automated merge with ssh://hg.scrapy.org/scrapy
2009-08-24 16:46:25 -03:00
Daniel Grana
9fbaef90fe
fix spider templates handling in genspider command
2009-08-24 16:46:20 -03:00
Pablo Hoffman
8a074c9cb5
removed scrapy-admin.py command, and left only scrapy-ctl as the only scrapy command
2009-08-24 15:43:36 -03:00
Ismael Carnales
39540b188a
changed torrent in overview doc
2009-08-24 15:11:04 -03:00
Ismael Carnales
4b5aa30867
minor update to tutorial
2009-08-24 14:34:17 -03:00
Pablo Hoffman
0363040884
doc: added FAQ entry about Accept-Language
2009-08-24 13:56:44 -03:00
Ismael Carnales
85282a4b76
added scrapy commandline scripts doc
2009-08-24 12:02:44 -03:00
Pablo Hoffman
ead8cb9fac
removed documentation about ugly DontCloseDomain exception (which will be removed in the future)
2009-08-24 11:57:21 -03:00
Pablo Hoffman
74f706b356
renamed "parse_item" method of XMLFeedSpider to "parse_node", keeping backwards compatibility
2009-08-24 10:54:34 -03:00
Pablo Hoffman
31693eb90f
dropped "cache" attribute of Request and Response objects
2009-08-24 10:34:05 -03:00
Pablo Hoffman
79bf4c817a
replaced old memoizemethod decorator with a more efficient one (memoizemethod_noargs)
2009-08-24 10:21:04 -03:00
Pablo Hoffman
4f2925420f
minor improvements to Response.__repr__
2009-08-24 09:54:02 -03:00
Pablo Hoffman
b71de57b21
some simplifications to Request and Response classes
2009-08-24 09:47:26 -03:00
Pablo Hoffman
81832773ee
ported get_base_url and get_meta_refresh to use WeakKeyDictionary (instead of Request.cache)
2009-08-24 08:58:51 -03:00
Pablo Hoffman
49e11d34c2
switched request_fingerprint to use WeakKeyDictionary for caching (instead of Request.cache)
2009-08-24 08:45:23 -03:00
Pablo Hoffman
0186c6937a
HTTP auth middleware: added doc and unittest
2009-08-24 08:07:20 -03:00
Pablo Hoffman
c7e916407d
fixed test name
2009-08-24 07:57:00 -03:00
Pablo Hoffman
2cb0cfe7ea
simplified some code
2009-08-24 07:29:30 -03:00
Daniel Grana
73e7788ba2
dont try to guess if spider output is iterable for Items and Requests objects
2009-08-24 01:25:14 -03:00
Daniel Grana
6e2bd49a81
Host header must include port number when port used for connecting is not default protocol port
2009-08-24 01:16:49 -03:00
Pablo Hoffman
46aaea9f32
doc: improved documentation about debugging leaks
2009-08-23 20:36:00 -03:00
Pablo Hoffman
0ed849248f
some improvements to item exporters
...
- passed previous class attributes to instances attributes
- better handling of constructor arguments
- better coverage on unittets (including encoding)
- updated documentation with new changes
2009-08-23 05:48:35 -03:00
