BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-22 21:44:02 +00:00
Code Releases Wiki Activity
7,499 Commits 39 Branches 119 Tags
Commit Graph

81 Commits

Author SHA1 Message Date
Adrián Chaves
b8ef12cd47 Add bandit to CI 2019-11-14 12:11:28 +01:00
Andrey Rahmatullin
d874c4d90b Remove the old Python 2 PyPy installation code from .travis.yml (#4138) 2019-11-07 18:02:17 +01:00
Marc Hernández
e8b1e46e85 Add pytest-flake8 (#3945) 2019-11-07 14:05:01 +01:00
Andrey Rahmatullin
229e722a03 Initial Python 2 removal (#4091) 2019-10-31 10:46:02 +01:00
Roy
9b47dc6a70 [travis, setup] Adding official python 3.8 support 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-28 11:24:52 +00:00
Roy Healy
b5a00262ec
Update .travis.yml 
Reverting change to 3.8 extra dependency environment.
 2019-10-28 09:59:33 +00:00
Roy Healy
85ac5c5c57
Update .travis.yml 
Co-Authored-By: Mikhail Korobov <kmike84@gmail.com>
 2019-10-21 19:06:43 +01:00
Roy
c12a075164 [.travis.yml] Added python 3.8 fields 
https://github.com/scrapy/scrapy/issues/4085
 2019-10-21 18:34:15 +01:00
elacuesta
5dbeece8da [MRG+1] Drop py34 support - Update CI envs (#3892) 
* Drop py34 support

* Travis experiments

* More Travis experiments

* Bump Twisted version for py35+ (stretch)

* Remove Debian build

* Remove pinned lxml for Py34

* Fix merge error

* Remove unused tox env

* Add environment with pinned versions for py36

* Bump minimum Twisted version in py27; Envs with pinned versions for py27 and py35

* Add botocore as extra dep for py27 tests

* Update requirements-py2.txt

* Add botocore and Pillow as extra dependencies
 2019-08-07 12:36:52 +05:00
Anubhav Patel
8e813953bd [MRG+1] [GSoC 2019] Interface for robots.txt parsers (#3796) 
Make the robots.txt parser configurable through the new ROBOTSTXT_PARSER setting, support the Reppy and Robotexclusionrulesparser parsers, and allow implementing custom robots.txt parsers.
 2019-08-02 09:43:29 +02:00
Daniel Graña
7333fc02aa Pin Travis-ci build environment to previous default: Trusty 
Travis-ci changed the default build environment to Xenial as explained in https://blog.travis-ci.com/2019-04-15-xenial-default-build-environment
This causes builds meant for Debian Jessie to break as noted by @wRAR in https://github.com/scrapy/scrapy/issues/3917#issuecomment-516426389

This change pins the environment to known working ubuntu trusty distribution prior to dropping Jessie support and upgrade to Xenial as base.

Closes #1369
 2019-07-30 23:16:11 -03:00
Lucy Wang
4d48759978 remove "sudo: false" now that travis no longer supports it 
https://changelog.travis-ci.com/deprecation-container-based-linux-build-environment-82037
 2018-12-10 14:44:17 +08:00
Konstantin Lopuhin
b3cd12dc48 Try to get python3.7 by using xenial base and sudo 
See https://github.com/travis-ci/travis-ci/issues/9815#issuecomment-401756442
and https://github.com/travis-ci/travis-ci/issues/9815#issuecomment-402045581
 2018-07-09 13:12:47 +03:00
Konstantin Lopuhin
2773fe09e4 Make "docs" the last build, even though it still uses python3.6 for now 2018-07-09 12:36:58 +03:00
Konstantin Lopuhin
cf9399acc1 Use python 3.7 on travis 2018-07-09 12:26:56 +03:00
Konstantin Lopuhin
1d2e2735fc Merge branch 'master' of https://github.com/patiences/scrapy into patiences-master 2018-07-09 11:59:22 +03:00
Mikhail Korobov
8782901fc8
[MRG+1] TST test agains latest pypy (#3309) 
pypy3 is not upgraded, as tests segfault with pypy3 6.0 for some reason
 2018-06-28 01:11:15 +05:00
Patience Shyu
fab68ff626 Use 3.7-dev version for travis 2018-03-02 17:05:14 +01:00
Patience Shyu
aca2655c12 [WIP] Run tests for Python 3.7 2018-03-02 14:57:39 +01:00
Konstantin Lopuhin
f71df6f9ad Run tests for PyPy3 2017-12-25 14:48:06 +03:00
Hugo
f11c21c6fc Test on Python 3.4 2017-12-20 17:05:56 +02:00
Hugo
44623687ab Drop support for EOL Python 3.3 2017-12-19 17:59:05 +02:00
Konstantin Lopuhin
abb6d0a1c1 Use portable pypy directly 
They are provided by https://github.com/squeaky-pl/portable-pypy
 2017-11-01 17:52:32 +03:00
Konstantin Lopuhin
84111969c4 Update pypy version regexp to get last release 
PyPy changed naming conention since 5.8 release, not it's called
pypy2.7-x.x.x
 2017-09-20 13:35:48 +02:00
Konstantin Lopuhin
5ba8e5adc0 Remove duplicate PyPy toxenv from Travis config 
Thanks for the catch @redapple
 2017-06-19 17:45:28 +03:00
Konstantin Lopuhin
271b3a485c Require pypy build to pass 2017-06-19 16:46:16 +03:00
Paul Tremberth
f3f7a41861 Travis CI: use portable pypy for Linux 2017-04-12 16:32:21 +02:00
Paul Tremberth
8c4f614d21 Enable PyPy tests on Travis 2017-02-01 15:19:17 +01:00
Paul Tremberth
a347c75baa Merge branch 'master' into patch-1 2017-01-23 11:40:38 +01:00
Paul Tremberth
6b838b0296 Use matrix build config 2017-01-06 16:10:14 +01:00
Paul Tremberth
53769245f5 Use python 3.6 directly 2017-01-06 16:02:14 +01:00
Paul Tremberth
40851a3d4c Use Python 3.6-dev on Travis 2017-01-06 15:44:32 +01:00
Paul Tremberth
a214731471 Add Python 3.6 tox env + Travis CI build for it 2017-01-06 15:38:35 +01:00
Alex
8a86574394 .devN release suffix must be preceded with a dot 
https://packaging.python.org/distributing/#standards-compliance-for-interoperability
 2016-12-28 14:25:22 +00:00
Paul Tremberth
58cd7bf895 Remove "precise" test env from Travis-CI config 2016-09-01 11:17:53 +02:00
Paul Tremberth
2b2bfcea88 Add "jessie" build to Travis-CI config 2016-09-01 10:20:49 +02:00
Daniel Graña
6cf4fdbae6 Enable travis builds on tag patterns 2016-02-03 22:56:49 -03:00
Paul Tremberth
ee4fadc007 Use .read1() if available when using GzipFile 2016-01-15 14:57:15 +01:00
Paul Tremberth
131f463247 Allow failures for Python 3.5 for now 2016-01-15 11:17:52 +01:00
Paul Tremberth
85b0e6c9c7 Travis: run tox with Python 3.5 + add Python 3.5 tests 2016-01-14 10:50:51 +01:00
Paul Tremberth
a93d49a64c Add Python 3.5 tox env and Python 3.4 tests in Travis CI 2016-01-13 13:09:16 +01:00
Mikhail Korobov
09fc9b48b6 drop coveralls support 2015-10-12 18:12:56 +05:00
Mikhail Korobov
d30e539049 don't run tests twice on Travis if a PR is made from a scrapy/scrapy branch 2015-09-04 22:06:46 +05:00
Daniel Graña
108c3e63a5 Add coverage report trough codecov.io 2015-08-13 13:56:24 -03:00
Daniel Graña
5c4666a3d4 Workaround for travis#253 2015-08-10 11:17:20 -03:00
Daniel Graña
49fd77d693 indent travis yaml 2015-07-31 16:45:43 -03:00
Daniel Graña
5d4cdb59a9 cache pip cache 2015-07-31 16:39:12 -03:00
Daniel Graña
5ae94ae42d Use new travis-ci container based builds 2015-07-31 16:33:37 -03:00
Julia Medina
26f50d3f43 Extend regex for tags that deploy to PyPI to support new release cycle 2015-05-27 09:17:18 -03:00
Julia Medina
cbebcbddb1 Add docs toxenv to .travis.yml 2015-05-14 20:54:28 -03:00