BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-27 18:44:07 +00:00
Code Releases Wiki Activity
5,465 Commits 39 Branches 119 Tags
Commit Graph

5465 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Elias Dorneles
c75f1fe46a restore bytes instead of text, for easier reviewing 2016-01-23 16:09:57 -02:00
Paul Tremberth
5f09da60c1 Revert "Use pytest.mark.parametrize decorator" 
This reverts commit 1a30a7774b7d530394fdd761f2a59403b778fe10.
 2016-01-22 23:48:58 +01:00
Paul Tremberth
1a30a7774b Use pytest.mark.parametrize decorator 2016-01-22 18:22:19 +01:00
Paul Tremberth
61ca8d587a Merge remote-tracking branch 'origin/master' into 1550-shell_file-cont 2016-01-22 18:16:36 +01:00
Paul Tremberth
7a51d370f3 Regex-based guess_scheme() + refactor tests 2016-01-22 17:16:27 +01:00
Paul Tremberth
60052b3c68 Remove unused re import 2016-01-22 13:18:08 +01:00
Paul Tremberth
be239f339c Remove unused import 2016-01-22 13:13:46 +01:00
Elias Dorneles
d0955fd083 add back test for latin-1 encoding 2016-01-22 10:07:55 -02:00
Paul Tremberth
6d73e057b5 Extract guess_scheme function and refactor tests 2016-01-22 13:07:42 +01:00
Mikhail Korobov
c75f7ed20b Merge pull request #1711 from scrapy/py3-parse-command-tests 
PY3 enable tests for scrapy parse command
 2016-01-22 15:21:26 +05:00
Mikhail Korobov
35ada10729 PY3 enable tests for scrapy parse command 
scrapy parse command is already ported
 2016-01-22 13:39:27 +05:00
Elias Dorneles
e938752973 add test for PythonItemExporter binary mode 2016-01-21 21:51:59 -02:00
Elias Dorneles
2514973242 re-enable skipped feed export tests 2016-01-21 21:22:12 -02:00
Elias Dorneles
b746d85f4c PY3 port csv exporter 2016-01-21 21:12:43 -02:00
Paul Tremberth
8bd5b60889 Remove relpath filepath 2016-01-21 23:23:50 +01:00
Paul Tremberth
240ecbf323 Add local file tests for scrapy shell command 
Continuation of #1579
 2016-01-21 22:59:48 +01:00
Elias Dorneles
9f35c28643 fix indentation 2016-01-21 18:43:36 -02:00
Elias Dorneles
fed7c8b4fc fix: use is_listlike 2016-01-21 18:39:59 -02:00
Elias Dorneles
c76190d491 PY3: ported json(lines), xml exporters 2016-01-21 18:24:06 -02:00
Elias Dorneles
b6ef1f19fd make BaseItemExporter export unicode, pushed down previous behavior for classes that need it 2016-01-21 15:36:14 -02:00
Elias Dorneles
a76ecd4ef0 remove test_exporters from py3 ignores 2016-01-21 15:36:14 -02:00
Paul Tremberth
1406cab19b Merge remote-tracking branch 'origin/master' into 1550-shell_file 2016-01-21 16:48:16 +01:00
Elias Dorneles
e0074d7f4d Merge pull request #1692 from lopuhin/py3-test-crawl 
[MRG+1] Py3: port test crawl
 2016-01-21 13:05:20 -02:00
Konstantin Lopuhin
5813de8838 py3: unskip test_closespider - it passes after fixing mockserver.Follow resouce on py3 2016-01-21 17:53:08 +03:00
Konstantin Lopuhin
4607f2843e py3: unskip test_crawl 2016-01-21 17:53:08 +03:00
Konstantin Lopuhin
bf5f54fa33 py3: fix getarg 2016-01-21 17:52:12 +03:00
Konstantin Lopuhin
ad2b3321b9 py3 compat: use range, fixes CrawlTestCase.test_start_requests_bug_yielding 2016-01-21 17:52:12 +03:00
Konstantin Lopuhin
0680950b98 py3: pass CrawlTestCase.test_referer_header, fixing Echo resource in mockserver and json decoding in test 2016-01-21 17:52:12 +03:00
Konstantin Lopuhin
20b839b44b py3: pass first crawl test (test_follow_all): fix mock server 2016-01-21 17:52:12 +03:00
Daniel Graña
0f500a1f82 Merge pull request #1708 from scrapy/fix-scrapy-bench 
PY3 fixed scrapy bench command
 2016-01-21 11:51:27 -03:00
Daniel Graña
5346011eaa Merge pull request #1637 from eLRuLL/py3-httpproxy-retry 
[MRG+1] py3 fix HttpProxy and Retry Middlewares
 2016-01-21 11:49:42 -03:00
Raul Gallegos
a06a5f00f4 adding configurable encoding for httpproxy authentication 2016-01-21 09:35:04 -05:00
Raul Gallegos
f042ad0f39 py3 fix HttpProxy and Retry Middlewares 2016-01-21 09:35:04 -05:00
Paul Tremberth
c9e046d11d Merge pull request #1657 from palego/os.mknod-fails-on-macos 
[MRG+1] change os.mknod() for open()
 2016-01-21 15:17:57 +01:00
Mikhail Korobov
a18dc24471 correctly process arguments for bench server 2016-01-21 18:44:37 +05:00
Mikhail Korobov
80c55f19a1 PY3 fixed scrapy bench command 2016-01-21 18:31:58 +05:00
Mikhail Korobov
e44ce8634f Merge pull request #1706 from scrapy/fix-form-request-formcss-version 
Fix version number to appear new feature
 2016-01-21 16:48:21 +05:00
Elias Dorneles
d4c4ca8062 fix version number to appear new feature 2016-01-21 09:42:15 -02:00
Paul Tremberth
da83f2dca7 Merge pull request #1693 from lopuhin/py3-commands-fetch-shell 
[MRG+1] Py3: port commands fetch and shell
 2016-01-21 10:59:32 +01:00
Paul Tremberth
6d8620ffe7 Merge pull request #1691 from lopuhin/py3-test-engine 
[MRG+1] Py3: port test_engine
 2016-01-21 10:30:39 +01:00
Elias Dorneles
a6e5c848fe Merge pull request #1382 from barraponto/formcss 
[MRG+1] Implement FormRequest.from_response CSS support
 2016-01-21 01:17:47 -02:00
Capi Etheriel
659715ecd9 implements FormRequest.from_response CSS support 2016-01-21 01:05:20 -02:00
Konstantin Lopuhin
fd24e22442 use byte constants for prefix instead of encoding it 2016-01-20 23:30:58 +03:00
Konstantin Lopuhin
a5da7531c4 py3 backout skipping test_closespider - it was fixed on another branch 2016-01-20 23:01:29 +03:00
Konstantin Lopuhin
c6d013ec85 py3 fetch command: it may actually be better to try to print bytes as-is 2016-01-20 23:01:29 +03:00
Konstantin Lopuhin
47d3c63338 py3: port fetch and shell commands, and review + enable already passing test_closespider.py and tests/test_utils_template.py 2016-01-20 23:01:29 +03:00
Konstantin Lopuhin
c1db60188a py3: unskip passing test_engine 2016-01-20 22:57:46 +03:00
Konstantin Lopuhin
0b08b4bfcf fix engine tests - this callback (spider_closed_callback) should accept one argument, but the error was hidden on py2 2016-01-20 22:57:46 +03:00
Konstantin Lopuhin
a32b59ac75 py3: fix EngineTest.test_crawler 2016-01-20 22:57:46 +03:00
Daniel Graña
56b69d2ea8 Merge pull request #1689 from scrapy/remove-lsprof 
[MRG+1] Remove --lsprof command-line option.
 2016-01-20 16:52:25 -03:00