BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 21:43:53 +00:00
Code Releases Wiki Activity
5,133 Commits 39 Branches 119 Tags
Commit Graph

5133 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jakob de Maeyer
bb6dee611c Move Settings documentation to docstrings 2015-10-27 12:43:33 +01:00
Jakob de Maeyer
26586ef5a6 Deprecate _BASE settings, unify _BASE backwards-compatibility 2015-10-27 12:43:23 +01:00
Jakob de Maeyer
a769a1ef78 Introduce BaseSettings with full dictionary interface 2015-10-27 12:38:52 +01:00
Mikhail Korobov
4a9f76ebd3 Merge pull request #1555 from stummjr/patch-1 
fix typo in the documentation
 2015-10-26 12:30:46 +05:00
Valdir Stumm Jr
d577c4702d fixed a typo in the documentation. 2015-10-26 00:00:20 -02:00
Pablo Hoffman
8dc400c66d Merge pull request #1541 from chripede/patch-1 
[MRG+1] Version 1 now exists
 2015-10-14 10:58:54 -03:00
Christian Pedersen
cc76fb3dff Version 1 now exists 2015-10-14 14:07:34 +02:00
Pablo Hoffman
451318ef7a Merge pull request #1530 from scrapy/retry-400 
[MRG+1] DOC fix docs after GH-1289.
 2015-10-13 16:09:07 -03:00
Daniel Graña
411174cf38 Merge pull request #1535 from scrapy/py3-commands 
PY3 port bench, startproject, genspider, list and runspider commands
 2015-10-12 20:43:21 -03:00
Daniel Graña
65f4ba349c Merge pull request #1537 from scrapy/no-coveralls 
drop coveralls support
 2015-10-12 20:36:12 -03:00
Mikhail Korobov
09fc9b48b6 drop coveralls support 2015-10-12 18:12:56 +05:00
Mikhail Korobov
215905bdb6 PY3 port bench, startproject, genspider, list and runspider commands 2015-10-12 17:59:49 +05:00
Julia Medina
0117c811c9 Merge pull request #1533 from Digenis/xml_iter-nodename_with_dot 
[MRG+1] xmliter nodename with dot
 2015-10-12 09:33:27 -03:00
Mikhail Korobov
1b6d60c251 DOC fix docs after GH-1289. 2015-10-09 01:26:09 +05:00
Mikhail Korobov
9676cf8e53 Merge pull request #1527 from scrapy/no-pillow-300 
TST don't use broken Pillow version in tests
 2015-10-09 01:20:45 +05:00
Νικόλαος-Διγενής Καραγιάννης
f56062d045 escape nodename in xmliter regex 2015-10-07 14:58:47 +03:00
Νικόλαος-Διγενής Καραγιάννης
d66efb13ba test xml nodename with dots 2015-10-07 14:43:47 +03:00
Mikhail Korobov
4e9a43c228 Merge pull request #1532 from hoatle/docs-fixes 
Docs fixes
 2015-10-07 15:34:21 +05:00
hoatle
2869cf8dde fix another invalid xpath error 2015-10-07 16:03:43 +07:00
Hoat Le
4e66955411 fix ValueError: Invalid XPath: //div/[id="not-exists"]/text() on selectors.rst 
>>> response.xpath('//div/[id="not-exists"]/text()').extract_first() is None
Traceback (most recent call last):
  File "<console>", line 1, in <module>
  File "/home/vagrant/.virtualenvs/scrapy/lib/python2.7/site-packages/scrapy/http/response/text.py", line 109, in xpath
    return self.selector.xpath(query)
  File "/home/vagrant/.virtualenvs/scrapy/lib/python2.7/site-packages/scrapy/selector/unified.py", line 100, in xpath
    raise ValueError(msg if six.PY3 else msg.encode("unicode_escape"))
ValueError: Invalid XPath: //div/[id="not-exists"]/text()
 2015-10-07 15:43:02 +07:00
Mikhail Korobov
669be0a2b0 TST don't use broken Pillow version in tests 2015-10-06 17:24:52 +05:00
Mikhail Korobov
91cbf97415 Merge pull request #1522 from smirecki/fix-typos-in-docs-topics 
DOC Typos corrections
 2015-10-03 13:23:38 +05:00
smirecki
8379bea7ed Typos corrections 
I've made a few small corrections, some spelling changes and typo fixes.
I've tried to respect regional spelling differences and avoided proposing hyphenating compound words.

 Please enter the commit message for your changes. Lines starting
 2015-10-02 23:48:27 -04:00
Daniel Graña
fe15f93e53 Merge pull request #1498 from Preetwinder/scrapy-add_scheme 
[MRG+1] #1487 add_scheme_if_missing for `scrapy shell` command
 2015-09-30 21:38:58 -03:00
Marius Gedminas
0620e76433 Fix list formatting 2015-09-29 03:33:30 +05:00
Marius Gedminas
eaad10facf Typo 2015-09-28 14:44:15 +05:00
Pablo Hoffman
75cd056223 disable log on version command. closes #1426 2015-09-25 16:39:21 -03:00
preetwinder
47c8e2ba78 Restructure tests for add_http_if_no_scheme function 2015-09-24 17:57:25 +00:00
preetwinder
9d96e767a1 Minor changes to add_http_if_no_scheme 2015-09-24 17:31:30 +00:00
preetwinder
8c629eee3e adds docstring, tests and correction 2015-09-24 17:28:44 +00:00
preetwinder
c517951a48 add_scheme_if_missing for scrapy shell command 2015-09-24 17:28:44 +00:00
Daniel Graña
69398fa148 Merge pull request #1505 from scrapy/fix-test-suite 
TST pin pytest to 2.7.3
 2015-09-21 18:19:59 -03:00
Mikhail Korobov
916141a08f TST pin pytest to 2.7.3 2015-09-21 21:12:52 +05:00
Mikhail Korobov
181f8d27d7 Merge pull request #1501 from scrapy/disable-log-on-startproject 
disable log on startproject command
 2015-09-20 02:47:41 +05:00
Daniel Graña
51b1249033 Revert "test suite requires recent queuelib to pass because it depends on queuelib test suite" 
This reverts commit a3390afc66134e77f98ae3bfae7bc23479ed8566.
 2015-09-18 02:27:07 -03:00
Daniel Graña
a3390afc66 test suite requires recent queuelib to pass because it depends on queuelib test suite 2015-09-17 19:42:29 -03:00
Daniel Graña
a57efdb008 Add PyPI download stats badge 2015-09-17 14:07:57 -03:00
Pablo Hoffman
22327ef47b disable log on startproject command 2015-09-17 01:05:52 -03:00
Daniel Graña
3c596dcf46 Merge pull request #1467 from dacjames/master 
add support for a nested loaders
 2015-09-16 22:03:19 -03:00
Mikhail Korobov
09f388c328 Merge pull request #1497 from haiiiiiyun/fix_typo_middlware 
fix typo middlware
 2015-09-16 15:39:24 +05:00
hy
14f7f22555 fix typos in downloader-middleware.rst and exceptions.rst, middlware -> middleware 2015-09-16 16:59:23 +08:00
Daniel Collins
036109e7de updte nested loader documentation 2015-09-15 23:49:35 -07:00
Daniel Graña
5279da9916 Merge pull request #1496 from scrapy/default-template 
[MRG+1] style fixes for settings.py created by `scrapy startproject`
 2015-09-14 17:14:15 -03:00
Mikhail Korobov
3e13740a57 Merge pull request #1481 from mlyundin/develop 
cleanup
 2015-09-15 00:36:50 +05:00
Daniel Graña
4d1c5c3d32 Merge pull request #1488 from scrapy/py3-redirect-downloader-mware 
[MRG+1] PY3 redirect downloader mware
 2015-09-14 02:20:13 -03:00
Mikhail Korobov
5a13022713 style fixes for settings.py created by scrapy startproject 2015-09-13 21:46:20 +05:00
Elias Dorneles
430e90f4b2 minor refactor on metarefresh redirect mware test 2015-09-13 12:29:41 -03:00
Elias Dorneles
b06d0706e6 refactoring redirect logic 2015-09-13 11:49:59 -03:00
Elias Dorneles
81950f773d made encoding conversion more explicit, added test for header with utf-8 encoding replicating what browsers do 2015-09-11 18:51:48 -03:00
Elias Dorneles
179c4588ca adding test for latin1 location 2015-09-10 19:36:47 -03:00