BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-23 06:24:08 +00:00
Code Releases Wiki Activity
4,241 Commits 39 Branches 119 Tags
Commit Graph

4241 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Julia Medina
81187feaac Ignore files with import errors on pytest test discover 2014-04-04 21:47:19 -03:00
Julia Medina
560a84657c Support doctest and __init__.py test discover in pytest 2014-04-04 21:43:12 -03:00
Julia Medina
1779b31e9b Add py33 environment to allowed failures in travis-ci 2014-04-04 21:43:12 -03:00
Julia Medina
20b4c8f3ea Trial functionality for running tests with pytest 
* Change current dir to tmp dir on each test run
  * Log twisted with test.log
 2014-04-04 21:42:00 -03:00
Mikhail Korobov
713aec3919 make scrapy.version_info a tuple of integers 2014-04-05 05:54:49 +06:00
Claudio Salazar
554102fd70 Added resolve_entities to kwargs in SafeXMLParser 2014-04-05 00:40:41 +08:00
Claudio Salazar
d034df36e8 Added test against XXE attacks for Sitemap 2014-04-05 00:22:36 +08:00
Claudio Salazar
c2a424daae Fixed XML selector against XXE attacks 2014-04-05 00:13:27 +08:00
Daniel Graña
986be9a396 Run testsuite with py.test 2014-04-03 12:26:44 -03:00
Daniel Graña
f3d15085b4 Merge pull request #674 from dangra/pypy 
[WIP] try to restore pypy tests
 2014-04-02 19:45:00 -07:00
Claudio Salazar
43217fd698 Fixed XXE flaw in sitemap reader 2014-04-01 23:54:04 +08:00
Daniel Graña
95853b325b try to restore pypy tests 2014-03-28 15:56:23 -03:00
Daniel Graña
ade7662f23 Merge pull request #661 from ananana/sgml-attrs-tuple 
Fixed default value of attrs argument in SgmlLinkExtractor to be tuple
 2014-03-27 09:06:43 -07:00
Ana Sabina Uban
73109bf950 Fixed SgmlLinkExtractor constructor to properly handle both string and list parameters (attrs, tags, deny_extensions) 2014-03-27 16:12:00 +02:00
Denys Butenko
7e353761a3 Added more verbose error message for unrecognized output format. PEP8. 2014-03-26 12:27:52 +02:00
Daniel Graña
f687455046 Merge pull request #660 from rubenvereecken/issue193 
Added content-type check as per issue #193
 2014-03-24 06:10:23 -07:00
Ruben Vereecken
54434095fc Redefined test for #193 2014-03-21 14:41:07 +01:00
Paul Brown
a1ee354609 fixed typo 2014-03-20 15:16:48 -05:00
Ruben Vereecken
92780b70da Added content-type check as per issue #193 2014-03-20 20:41:08 +01:00
Denys Butenko
aa79abc5bd Add import os for crawl. 2014-03-20 12:36:05 +02:00
Denys Butenko
e64d6e3f3c Fix default value. 2014-03-19 21:32:32 +02:00
Denys Butenko
9822eb78cc Added back -t option. If --output-format not defined parse from extension --output 2014-03-19 21:18:01 +02:00
Denys Butenko
8e0b2bd343 Resolved issue #546. Output format parsing from filename extension. 2014-03-19 19:00:55 +02:00
Daniel Graña
3df6946256 Merge pull request #656 from kmike/httperror-logging 
[MRG] Fix for #612 + small tests cleanup
 2014-03-18 19:46:59 -07:00
Mikhail Korobov
60f9dc7a54 TST fix file descriptor leak and a bad variable name in get_testlog 2014-03-19 04:18:04 +06:00
Mikhail Korobov
75060d1424 Fix for #612 + integration-style tests for HttpErrorMiddleware 2014-03-19 04:04:24 +06:00
Mikhail Korobov
364790eb07 scrapy.utils.test.docrawl function 2014-03-19 03:30:58 +06:00
Mikhail Korobov
15454e7845 reduce code duplication in test_spidermiddleware_httperror 2014-03-19 01:50:09 +06:00
Mikhail Korobov
9edbb68b39 Merge pull request #612 from deed02392/patch-1 
Update httperror.py
 2014-03-18 22:30:07 +05:00
Mikhail Korobov
ff41d5451e Merge pull request #654 from tpeng/patch-2 
add message when raise IngoreReques; fix item_scraped document
 2014-03-18 21:33:05 +05:00
tpeng
fd7b40e892 add message when raise IngoreReques; fix item_scraped document 2014-03-18 15:23:25 +08:00
Daniel Graña
b8ecbb7632 Merge pull request #650 from Curita/dlhandler-disable 
Allow to disable a downloader handler just like any other component
 2014-03-17 19:39:46 -07:00
Daniel Graña
f921d2aff1 Merge pull request #645 from Curita/formrequest-clickdata-doc 
Documentation for FormRequest.from_response clickdata parameter
 2014-03-13 12:18:26 -07:00
Daniel Graña
c2fd1f8a7c Merge pull request #646 from Curita/formrequest-clickdata-nr-index-tests 
Tests for clickdata's nr index in FormRequest
 2014-03-13 12:17:55 -07:00
Julia Medina
2177d4feec Minor fixes in LoadTestCase in test_downloader_handlers 
* same __init__ parameters in both download handlers's mocks
 * additional assertion in test_disabled_handler
 2014-03-13 01:29:10 -03:00
Julia Medina
b9e2aad874 Doc for disabling download handler 2014-03-12 23:21:33 -03:00
Julia Medina
6573459481 Fix minor typo in DownloaderHandlers comment 2014-03-12 22:33:42 -03:00
Julia Medina
efb86f966d Tests for loading download handlers 2014-03-12 22:32:48 -03:00
Rolando Espinoza La fuente
a1df15b9ce Alow to disable a downloader handler just like any other component. 2014-03-12 20:25:51 -03:00
Julia Medina
ae4eb90cbf More appropriate assert in FormRequest test 2014-03-12 13:11:41 -03:00
Julia Medina
ca1c1a82b5 FormRequest doc improvements 
Clickdata doc enhancements:
 * Fix xml attributes mention
 * nr is 0-indexed reference
 2014-03-12 12:34:50 -03:00
Julia Medina
a63b7e1c3e New tests: clickdata's nr in Formrequest.from_response 2014-03-12 07:26:52 -03:00
Julia Medina
e29ab4d112 New doc: clickdata in Formrequest.from_response 
Documentation about:
 * clickdata parameter in Formrequest.from_response
 * nr attribute in clickdata dict
 * default behaviour when clickdata is None
 2014-03-12 06:43:50 -03:00
Pablo Hoffman
5bbc20f5dd Merge pull request #643 from Digenis/master 
ItemLoader doc: missing args in replace_value()
 2014-03-09 08:06:37 -07:00
Nikolaos-Digenis Karagiannis
8ac9d40665 ItemLoader doc: missing args in replace_value() 2014-03-09 15:16:57 +02:00
Pablo Hoffman
a762834dcd Merge pull request #642 from aspidites/sep-014.rst 
sep 14 for #629
 2014-03-07 19:25:25 -08:00
Edwin O Marshall
38ea9373a5 sep 14 for #629 2014-03-07 18:05:21 -05:00
Pablo Hoffman
0bc2cbaf09 Merge pull request #613 from breno/master 
Update scrapy command line doc with additional scrapy parse options
 2014-03-07 10:35:58 -08:00
Pablo Hoffman
753893229a Merge pull request #641 from aspidites/remaining_seps 
Converted remaining SEPs...
 2014-03-07 10:32:33 -08:00
Pablo Hoffman
690fbdb93c Merge pull request #633 from aspidites/sep-004.rst 
sep 4 for #629
 2014-03-07 10:32:07 -08:00