BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-23 21:44:19 +00:00
Code Releases Wiki Activity
7,297 Commits 39 Branches 119 Tags
Commit Graph

7297 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Mikhail Korobov
71cfe550fb
Merge pull request #3737 from anubhavp28/anothersmallfix 
[MRG+1] Fixes a link in comment
 2019-04-13 01:50:19 +05:00
Adrián Chaves
92fa657f9e
Merge pull request #3730 from ankostis/doc_logstats_delay 
[MRG+1] doc: document LOGSTATS_INTERVAL setting
 2019-04-11 17:34:45 +02:00
Matthijs Vos
07adca34e1 Fix 'Too many values to unpack' 2019-04-10 13:01:46 +02:00
Matthijs Vos
50730ed228 Try it with a string 2019-04-10 13:01:01 +02:00
Matthijs Vos
d27c2c68ba Wrap scrapy check in environment 2019-04-10 12:56:50 +02:00
Anubhav Patel
4cfdc14974 fixes a link in comment 2019-04-09 17:52:02 +05:30
Anubhav Patel
e6048d55f9 changes parameter name 2019-04-09 17:34:20 +05:30
Mikhail Korobov
9280185054
Merge pull request #3520 from whalebot-helmsman/round-robin-scheduler-tested 
[MRG+1] Downloader-aware Priority Queue for Scrapy
 2019-04-07 00:06:08 +05:00
Maram Sumanth
aa46e1995c [MRG+1] Show elapsed time in statscollector (#3638) 
* Update corestats.py

* Update corestats.py

* corrected tests

* Update corestats.py

* Update scrapy/extensions/corestats.py
 2019-04-07 00:03:40 +05:00
Mikhail Korobov
f816375df5
Merge pull request #3726 from ankostis/fixctrlc 
[MRG+1] fix: do not catch system exceptions like KeyboardInterrupt
 2019-04-06 23:54:15 +05:00
Kostis Anagnostopoulos
a8f83ab967 doc: document LOGSTATS_INTERVAL setting 2019-04-06 14:58:32 +02:00
Daniel Graña
2079e3c42a
Merge pull request #3728 from victor-torres/process_spider_exception 
[MRG+1] fix typo on Spider Middleware template (Response -> Request)
 2019-04-06 06:52:31 -03:00
Victor Torres
35ce92a419 fix typo (Response -> Request) 
check docs for more information b5c552d17f/docs/topics/spider-middleware.rst
 2019-04-05 14:31:15 -03:00
Kostis Anagnostopoulos
3a493b6066 fix: do not catch system exceptions like KeyboardInterrupt 2019-04-05 11:52:00 +02:00
Mikhail Korobov
d39feabae3
Merge pull request #3724 from float13/tutorial_grammar 
[MRG+1] Docs - Tutorial - Minor grammar edits
 2019-04-05 12:31:59 +05:00
float13
a101d5fe5c text edit - delete 2 extra words 2019-04-05 01:12:20 -04:00
float13
77e3695686 grammar fix - add apostrophe-s to browser 2019-04-05 01:04:59 -04:00
float13
d711ecfc18 grammar fix - delete extra word "shell" 2019-04-05 00:56:51 -04:00
float13
6336e1d1f3 grammar fix - delete unneeded apostrophe in "lets" 2019-04-05 00:54:46 -04:00
Mikhail Korobov
c2d8f6f456
Merge pull request #3718 from Gallaecio/deprecate-is-gzipped 
Deprecate the scrapy.utils.gz.is_gzipped function
 2019-04-03 19:01:35 +05:00
Adrián Chaves
7acf4eec79 Deprecate the scrapy.utils.gz.is_gzipped function 2019-04-02 18:36:03 +02:00
Eugenio Lacuesta
7a38623cec [Docs] Clarify comment about meta dictionary 2019-04-01 17:09:49 -03:00
Eugenio Lacuesta
8ebbc731b2 [Docs] Rephrase Rule docs 2019-04-01 16:15:03 -03:00
Eugenio Lacuesta
07ff9248a5 [Docs] CrawlSpider: add note about link text 2019-04-01 12:31:26 -03:00
Konstantin Lopuhin
b5c552d17f
Merge pull request #2061 from elacuesta/process_spider_exception_generator 
[MRG+1] process_spider_exception on generators
 2019-04-01 10:43:19 +03:00
Eugenio Lacuesta
0522fe35c3 parse command: improve option description 2019-03-29 16:15:34 -03:00
Eugenio Lacuesta
294ef51bb2 parse command: update docs about passing callback keyword arguments 2019-03-29 16:12:55 -03:00
Eugenio Lacuesta
ccb56a317e Update docs about cb_kwargs and meta 2019-03-29 14:13:50 -03:00
Eugenio Lacuesta
f5e0b6b89a parse command: rename cb_kwargs option to cbkwargs 2019-03-29 14:03:26 -03:00
Vostretsov Nikita
1c6733454e added underlines 2019-03-29 10:44:55 +00:00
Vostretsov Nikita
ef743983a9 change wording 2019-03-29 10:38:13 +00:00
Vostretsov Nikita
f08f841d0b remove small single use method 2019-03-29 10:35:49 +00:00
Vostretsov Nikita
539a08cb85 Merge branch 'round-robin-scheduler-tested' of github.com:whalebot-helmsman/scrapy into round-robin-scheduler-tested 2019-03-29 10:31:52 +00:00
Vostretsov Nikita
554d872822 remove spacing 2019-03-29 10:31:15 +00:00
Vostretsov Nikita
2b4bcfaf49 remove comment 2019-03-29 10:30:26 +00:00
Adrián Chaves
1ee99e1f42
Update docs/topics/settings.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:29:15 +00:00
Adrián Chaves
bd228f1d96
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:29:04 +00:00
Adrián Chaves
e3df6be360
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:28:52 +00:00
Adrián Chaves
46b9ab0c58
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-29 10:28:36 +00:00
Eugenio Lacuesta
8fb077694f Request.cb_kwargs: Update docs 2019-03-28 16:32:35 -03:00
Eugenio Lacuesta
e8af6331b5 Add cb_kwargs option to the parse command 2019-03-28 15:03:40 -03:00
Eugenio Lacuesta
3efe3bea1c Update docs about cb_kwargs and meta 2019-03-28 14:16:03 -03:00
Eugenio Lacuesta
70a4d93aa3 Callback kwargs: more tests 2019-03-28 13:28:19 -03:00
Mikhail Korobov
ec719f55e7
Merge pull request #3682 from elacuesta/rule_process_request_response_parameter 
[MRG+1] Rule.process_request: access Response object
 2019-03-28 01:39:54 +05:00
Eugenio Lacuesta
c43a23152b Merge remote-tracking branch 'upstream/master' into callback_kwargs 2019-03-27 14:42:41 -03:00
Eugenio Lacuesta
8528f5065f [Doc] Update cb_kwargs example 2019-03-27 14:42:26 -03:00
Anubhav Patel
9c9bca4e1c make suggested changes. 2019-03-27 18:29:48 +05:30
Mikhail Korobov
845bae6637
Update docs/topics/broad-crawls.rst 
Co-Authored-By: whalebot-helmsman <whalebot.helmsman@gmail.com>
 2019-03-27 08:49:19 +00:00
Mikhail Korobov
820adb69c0
Merge pull request #3701 from Gallaecio/documentation-policy-api 
Update the documentation policies: Ask to use docstrings to document …
 2019-03-27 12:25:38 +05:00
Adrián Chaves
ce837b0f74 Update the documentation policies: Ask to use docstrings to document API members 2019-03-27 07:09:18 +01:00