Rafal Jagoda
ad6e449c63
Merge remote-tracking branch 'upstream/master'
2014-05-19 16:18:33 +01:00
Pablo Hoffman
2bf09b8a20
Merge pull request #714 from andrewbaxter/master
...
Elaborated Request priority value in Scrapy docs
2014-05-07 17:53:38 -04:00
Rendaw
8bdb6e2e3e
Elaborated request priority value.
2014-05-07 19:14:45 +09:00
Pablo Hoffman
6431e70dbe
Merge pull request #711 from cerivera/master
...
grammatical issue
2014-05-06 16:59:04 -04:00
Carlos Rivera
946b854ddf
grammatical issue
2014-05-06 15:41:59 -05:00
Pablo Hoffman
c424f3709c
add Julia to SEP-019 authors
2014-05-04 12:02:35 -03:00
Daniel Graña
4bd8eb17a8
Merge pull request #705 from Curita/sep19-update
...
Per-spider settings and api cleanup: sep#19 update
2014-05-04 10:13:33 -04:00
Rafal Jagoda
9d226e6266
add response arg to item_dropped signal handlers
...
#710
2014-05-02 14:42:01 +01:00
Daniel Graña
197e360730
Merge pull request #707 from redapple/gh-issue-706-start-requests
...
[MRG] Fix engine to support filtered start_requests
2014-04-28 12:13:40 -04:00
Paul Tremberth
7199555e1a
Check pending start_requests before calling _spider_idle() in engine ( fixes #706 )
2014-04-28 16:57:33 +02:00
Daniel Graña
ad14cf058b
Merge pull request #597 from chekunkov/dupefilter_request_fingerprint_test_and_docs
...
Dupefilter request_fingerprint test and docs
2014-04-28 10:37:35 -04:00
Alexander Chekunkov
4aa6179af7
added short RFPDupeFilter.request_fingerprint interface description
2014-04-26 15:46:53 +03:00
Alexander Chekunkov
baaa077725
added note about RFPDupeFilter.request_fingerprint overriding to the settings documentation
2014-04-26 15:43:12 +03:00
Alexander Chekunkov
6e4c77c684
test for RFPDupeFilter.request_fingerprint overriding
2014-04-26 15:42:01 +03:00
Paul Tremberth
4898d96337
Add tests for start requests, filtered and non-filtered
2014-04-26 13:47:42 +02:00
Pablo Hoffman
3932877bcd
signals doc: make argument order more consistent with code (although it doesn't matter in practice)
2014-04-25 16:03:32 -03:00
Julia Medina
9cbce9105b
sep#19 proposed changes
2014-04-25 01:57:24 -03:00
Pablo Hoffman
eb07e09166
Merge pull request #663 from pawl/patch-1
...
fixed typo
2014-04-24 17:59:36 -04:00
Mikhail Korobov
bdea071af3
DOC selectors.rst cleanup
2014-04-24 22:54:17 +06:00
ncp1113
5f18816428
for loops have to have a : at the end of the line
...
changed 3 instances
2014-04-24 22:50:21 +06:00
Mikhail Korobov
e8f56af9e1
Merge pull request #698 from allait/pep8templates
...
Fix PEP8 warnings in project and spider template files
2014-04-24 22:43:55 +06:00
Alexey Bezhan
5d37e4dc5a
Fix PEP8 warnings in spider templates
2014-04-24 17:30:35 +01:00
Alexey Bezhan
1d6cc257ea
Fix PEP8 warnings in project template files
2014-04-24 17:30:13 +01:00
Daniel Graña
9acf2be475
Merge pull request #690 from dangra/kmike-response-selectors
...
Added docs response selector shortcuts
2014-04-24 12:11:39 -04:00
Daniel Graña
1e7ddc8e52
Restore and deprecate "sel" shortcut
2014-04-24 12:47:45 -03:00
Daniel Graña
18412d75b5
Ammend example nesting selectors
2014-04-24 10:32:17 -03:00
Daniel Graña
b4593c2ae7
document shortcuts in TextResponse class
2014-04-24 00:15:00 -03:00
Daniel Graña
d37308ad77
Remove "sel" shortcut from scrapy shell$
...
Use response.xpath(), response.css() or response.selector instead.
2014-04-23 23:58:34 -03:00
Daniel Graña
72f68dcc8e
update spider templates
2014-04-23 23:39:58 -03:00
Daniel Graña
1117687c47
update docs
2014-04-23 23:39:58 -03:00
Daniel Graña
681c2985bc
remove .re() shortcut
2014-04-23 23:17:51 -03:00
Mikhail Korobov
134bd8a9e0
response.selector, response.xpath(), response.css() and response.re()
2014-04-23 23:17:51 -03:00
Daniel Graña
21d073d03b
Merge top-level-shortcuts
2014-04-23 23:14:09 -03:00
Daniel Graña
5246986d2e
Merge pull request #693 from redapple/domain-casesensitivity
...
Support case-insensitive domains in url_is_from_any_domain()
2014-04-21 22:43:38 -04:00
Mikhail Korobov
e482c6ec55
Merge pull request #692 from kmike/version_info_fix
...
fix scrapy.version_info when SCRAPY_VERSION_FROM_GIT is set
2014-04-17 20:07:05 +06:00
Paul Tremberth
a19dfafb25
Support case-insensitive domains in url_is_from_any_domain()
2014-04-16 22:33:30 +02:00
Mikhail Korobov
e8e689acd1
fix scrapy.version_info when SCRAPY_VERSION_FROM_GIT is set
2014-04-16 22:59:28 +06:00
Mikhail Korobov
c3426e952b
TST fix tests that became broken after adding top-level imports and switching to py.test.
...
py.test replaces AssertionError exception with its own subclass in an import hook.
For some reason when top-level shortcuts were added "except AssertionError" in
contracts.__init__ meant "except py.test AssertionError" while scrapy.exceptions.ContractFail
was still a subclass of a builtin AssertionError, so Contracts reported errors
instead of failures and this made tests in test_contracts.py fail.
For now - just disable fancy py.test asserts.
2014-04-15 06:54:14 +06:00
Mikhail Korobov
11e62117b7
suggest scrapy.Selector in deprecation warnings
2014-04-15 01:09:35 +06:00
Mikhail Korobov
2d3803672b
DOC use top-level shortcuts in docs
2014-04-15 01:09:35 +06:00
Mikhail Korobov
4ddad88d6f
use "import scrapy" in templates
2014-04-15 01:09:35 +06:00
Daniel Graña
62c7daf785
Add basic top-level shortcuts
2014-04-15 01:09:35 +06:00
Daniel Graña
9a643d689c
cleanup toplevel namespace
2014-04-15 01:09:35 +06:00
Mikhail Korobov
7814cbf319
remove unused import
2014-04-15 00:49:47 +06:00
Daniel Graña
2c8eceb5b8
Merge pull request #659 from denysbutenko/master
...
[MRG] Resolved issue #546 . Output format parsing from filename extension.
2014-04-14 14:08:05 -04:00
Daniel Graña
0a7e655948
Merge pull request #681 from kmike/version_info
...
[MRG] make scrapy.version_info a tuple of integers
2014-04-14 13:39:27 -04:00
Daniel Graña
21bff7b3b3
Merge pull request #687 from Curita/docs-linkcheck
...
Docs build and linkcheck in tox env
2014-04-11 15:36:00 -04:00
Julia Medina
80081054a2
Fix broken links in documentation
2014-04-09 18:57:52 -03:00
Julia Medina
f0a0d0bc22
Ignore known broken links in docs linkcheck
2014-04-09 18:46:21 -03:00
Julia Medina
c7c57178e0
New tox env: docs
2014-04-09 18:46:01 -03:00
