BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-24 09:23:57 +00:00
Code Releases Wiki Activity
5,728 Commits 39 Branches 119 Tags
Commit Graph

58 Commits

Author SHA1 Message Date
Mikhail Korobov
936266a61a Merge pull request #934 from Dineshs91/zsh-support 
[MRG+1] Added zsh completion for Scrapy command-line tool and updated bash completion
 2015-07-31 03:18:19 +05:00
agusc
140f58251b removed SUFFIX from scrapy name package 2015-06-15 17:02:09 -03:00
Julia Medina
d3f576a816 Move scrapy/spider.py to scrapy/spiders/__init__.py 2015-05-09 04:20:09 -03:00
nyov
7ae37d61f9 remove scrapy deploy command 
(closes #1027, #1095, #1102)
 2015-04-20 20:35:06 -03:00
dinesh
d55ae53513 Remove deploy and server commands from bash completion 2015-04-05 17:50:12 +05:30
dinesh
b1247355dc Remove server command 2015-04-05 17:48:54 +05:30
dinesh
843a9cdbb5 Remove deploy command from arguments 
As scrapy deploy is being removed
 2015-04-03 21:24:31 +05:30
dinesh
7129dc36d1 Move scrapy_zsh_completion inside extras directory 2015-04-03 21:20:06 +05:30
dinesh
e2b4fabbf5 Fix zsh completion path 2015-04-03 08:34:16 +05:30
dinesh
9d0ea5a396 Added zsh completion for the Scrapy command-line tool 2015-04-03 08:18:47 +05:30
Pablo Hoffman
8360380db0 removed scrapy-ws.py, moved to scrapy-jsonrpc package 2014-08-19 10:30:25 -03:00
Daniel Graña
f35fac11a2 scrapy.bat is not needed anymore 2014-08-01 16:23:26 -03:00
Daniel Graña
242c08553f move tests under root dir 2014-07-30 19:45:08 -03:00
Felix Yan
6f7efa1d1d PY3: use six for robotparser and urlparse 2014-07-14 21:26:37 +08:00
Pablo Hoffman
d24212c8e5 remove references to deprecated scrapy-developers list 2014-02-16 21:44:49 -02:00
Mikhail Korobov
a27d91f0a6 Rename BaseSpider to Spider. See GH-495. 2013-12-30 19:46:41 +06:00
alexanderlukanin13
ae4a61a2d5 Added "from __future__ import print_function" in all relevant places except xlib 2013-10-20 11:55:07 +06:00
alexanderlukanin13
d381a35732 Python 3 compatible syntax: print, except, raise, octal numbers; removed Python 2.2 boolean compatibility code in xlib/pydispatch/dispatcher.py 2013-10-20 01:59:35 +06:00
Daniel Graña
910effd145 get scrapy version from package data 2013-02-06 11:44:26 -02:00
Daniel Graña
5db45b3825 remove scrapyd, it was migrated to its own repository 2013-02-06 05:24:07 +00:00
Daniel Graña
e676ad31d0 Support sending requests trough multiples slots in QPS exmaple spider 2012-12-05 17:06:38 -02:00
Daniel Graña
dcc0a540c0 QPS bench server and a useful spider spider to generate requests 2012-12-05 15:08:34 -02:00
Pablo Hoffman
c3e91ba73e updated scrapy_bash_completion 2012-10-12 20:02:03 -02:00
Pablo Hoffman
452595790e fix test-scrapyd.sh after changes made to website 2012-10-08 15:30:19 -02:00
Pablo Hoffman
098d892c03 simplified installation guide to only mention pip/easy_install mechanism, and provide hints for Windows users 2012-08-29 15:37:05 -03:00
Pablo Hoffman
52151e8703 fixed bug in FeedExports extension, introduced in previous commit 2012-08-28 19:32:43 -03:00
Pablo Hoffman
9c3b9f2968 fixed bug in json-rpc webservice reported in https://groups.google.com/d/topic/scrapy-users/qgVBmFybNAQ/discussion. also removed no longer supported 'run' command from extras/scrapy-ws.py 2012-05-03 12:05:40 -03:00
Pablo Hoffman
abcac4fcbd updated maintainer to scrapinghub 2012-05-02 03:25:35 -03:00
Pablo Hoffman
731c569b5c fixed test-scrapyd.sh script after changed on insophia website 2012-03-22 16:38:28 -03:00
Pablo Hoffman
e521da2e2f Dropped support for Python 2.5. See: http://blog.scrapy.org/scrapy-dropping-support-for-python-25 2012-03-01 08:18:12 -02:00
Pablo Hoffman
fb44f303a9 extras/makedeb.py: no longer obtaining version from git 2012-01-02 13:28:51 -02:00
Pablo Hoffman
b003687389 moved rpm-install.sh to extras/ 2011-09-18 06:08:28 -03:00
Pablo Hoffman
1e43afeaea added support for generating version from git revision, and use it in extras/makedeb.py 2011-09-09 03:03:46 -03:00
Pablo Hoffman
76af0cdd44 updated documentation and code to use -s instead of --set option 2011-09-01 14:35:37 -03:00
Pablo Hoffman
accac332e3 adapted test-scrapyd.sh to be compatible with older versions of mktemp, and to not hang forever is spider doesn't run for some reason 2011-08-27 01:43:32 -03:00
Pablo Hoffman
6d6cff33ca added scrapyd system test script to extras/test-scrapyd.sh 2011-08-27 01:23:36 -03:00
Pablo Hoffman
841007b5c5 added envvar SCRAPY_VERSION_FROM_HG=1 to extras/makedeb.py script 2011-06-18 03:31:47 -03:00
Pablo Hoffman
9d9c8877da added 'scrapy edit' command 2011-06-05 22:02:56 -03:00
Pablo Hoffman
87aa63da2b moved coverage report script to extras/ 2010-12-15 12:08:59 -02:00
Pablo Hoffman
91e6753035 scrapy.bat: minor fix to support spaces in python installation dir (windows) 2010-11-22 00:39:45 -02:00
Pablo Hoffman
a034d078c8 Changed Debian packaging to use the scrapy version in the package name, so we can have multiple Scrapy versions in the same apt repo 
--HG--
rename : debian/scrapy.1 => debian/scrapy-files/scrapy.1
rename : debian/000-default => debian/scrapyd-files/000-default
rename : debian/scrapyd.upstart => debian/scrapyd.scrapyd.upstart
rename : debian/scrapy.1 => extras/scrapy.1
 2010-11-17 17:03:00 -02:00
Pablo Hoffman
1d567cdce6 Added new 'deploy' command. Closes #261 2010-10-18 22:38:46 -02:00
Pablo Hoffman
9158e9d682 Some changes to Scrapyd to support multiple configuration files, to make it easier to deploy Scrapyd applications. Also documented 'egg_runner' and 'application' options 
--HG--
rename : debian/scrapyd.cfg => debian/000-default
rename : scrapyd/default_scrapyd.cfg => scrapyd/default_scrapyd.conf
 2010-09-07 09:17:25 -03:00
Pablo Hoffman
37e9c5d78e Added new Scrapy service with support for: 
* multiple projects
* uploading scrapy projects as Python eggs
* scheduling spiders using a JSON API

Documentation is added along with the code.

Closes #218.

--HG--
rename : debian/scrapy-service.default => debian/scrapyd.default
rename : debian/scrapy-service.dirs => debian/scrapyd.dirs
rename : debian/scrapy-service.install => debian/scrapyd.install
rename : debian/scrapy-service.lintian-overrides => debian/scrapyd.lintian-overrides
rename : debian/scrapy-service.postinst => debian/scrapyd.postinst
rename : debian/scrapy-service.postrm => debian/scrapyd.postrm
rename : debian/scrapy-service.upstart => debian/scrapyd.upstart
rename : extras/scrapy.tac => extras/scrapyd.tac
 2010-09-03 15:54:42 -03:00
Pablo Hoffman
e14cc2c12a Moved scrapy-ws script to extras/ and fixed broken methods due to changes in web service API 
--HG--
rename : bin/scrapy-ws.py => extras/scrapy-ws.py
 2010-08-27 00:33:08 -03:00
Pablo Hoffman
cf8a085f44 Minor improvement to bash autocompletion 2010-08-22 20:10:11 -03:00
Pablo Hoffman
0d9e75c684 Added bash completion for the Scrapy command-line tool. Closes #210 2010-08-21 03:23:45 -03:00
Pablo Hoffman
34554da201 Deprecated scrapy-ctl.py command in favour of simpler "scrapy" command. Closes #199. Also updated documenation accordingly and added convenient scrapy.bat script for running from Windows. 
--HG--
rename : debian/scrapy-ctl.1 => debian/scrapy.1
rename : docs/topics/scrapy-ctl.rst => docs/topics/cmdline.rst
 2010-08-18 19:48:32 -03:00
Pablo Hoffman
4262a0af8c moved sign_release.sh code to Makefile 2010-06-14 09:49:07 -03:00
Pablo Hoffman
247fc26598 moved scrapy.tac to extras/ 
--HG--
rename : bin/scrapy.tac => extras/scrapy.tac
 2010-06-13 23:09:08 -03:00