BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 23:04:16 +00:00
Code Releases Wiki Activity
4,530 Commits 39 Branches 119 Tags
Commit Graph

4530 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Daniel Graña
a9292cfab7 jsonrpc webservice moved to https://github.com/scrapy/scrapy-jsonrpc repository 2014-08-15 23:28:13 -03:00
Rocio Aramberri
51b0bd281d fix dont settings on meta behaviour, add docs and tests 2014-08-15 13:47:42 -07:00
Julia Medina
6339864f95 Minor refactor in the docs and functions used in the shell command 2014-08-14 12:32:37 -03:00
Julia Medina
70f2010db1 Change error type when updating frozen settings 2014-08-14 11:59:25 -03:00
Julia Medina
3547ca6e61 Add example on running spiders outside projects 2014-08-14 11:50:33 -03:00
Julia Medina
419026615f Deprecate Crawler.spiders attribute 2014-08-14 09:19:41 -03:00
Julia Medina
c90977ca98 Drop support for scrapy.project.crawler (And scrapy.stats consequently) 2014-08-12 14:02:56 -03:00
Julia Medina
9cbbfd8b04 Adjust spiders' utils to new SpiderManager API 2014-08-12 14:02:56 -03:00
Julia Medina
900a487682 Support multiple simultaneous LogObservers listening different crawlers 2014-08-12 14:02:56 -03:00
Julia Medina
89df18bd2b Fix usage of crawler_process in ScrapyCommands 2014-08-12 14:02:56 -03:00
Julia Medina
d0edad4b0b Drop support for ScrapyCommand.crawler property 2014-08-12 14:02:56 -03:00
Julia Medina
870438e5f4 Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
Julia Medina
d40273561d CrawlerProcess cleanup changes 2014-08-12 14:02:55 -03:00
Julia Medina
980e30a187 Crawler interface cleanup 2014-08-12 14:02:55 -03:00
Julia Medina
d7038b2a13 SpiderManager interface cleanup 2014-08-12 14:02:55 -03:00
Julia Medina
39c6a80f9d Both getdict and getlist return copies of the requested values 2014-08-12 14:02:55 -03:00
Julia Medina
3ae971468f Add Settings.copy, freeze and frozencopy method 2014-08-12 14:02:55 -03:00
Julia Medina
a995727117 Connect spider_closed signal after a crawler is bound to a Spider 2014-08-12 14:02:55 -03:00
Julia Medina
eb0253e530 Update from_crawler method as well as set_crawler on CrawlSpider 2014-08-11 11:24:01 -03:00
Julia Medina
84fa004793 Add from_crawler class method to base Spider 2014-08-11 11:23:57 -03:00
Daniel Graña
8fece4b0b8 Add 0.24.4 release notes 2014-08-09 17:21:20 -03:00
Daniel Graña
02dd4a56a2 fix requirement typo 2014-08-09 00:44:48 -03:00
Daniel Graña
37787081d8 precise ships zope.interface 3.6.1 2014-08-09 00:37:08 -03:00
Daniel Graña
4badcc077d Add 0.24.3 release notes 2014-08-09 00:31:26 -03:00
Daniel Graña
0254f58763 Merge branch 'moderm-setuppy' 2014-08-08 18:09:43 -03:00
Daniel Graña
0772201ac8 Update installation docs 2014-08-08 18:07:38 -03:00
Daniel Graña
029c51acef There is a trove classifier for Scrapy framework! 
Added by https://bitbucket.org/pypa/pypi/issue/179
 2014-08-05 14:43:13 -03:00
Shane
c2497e660b Merge pull request #841 from cyberplant/patch-1 
Fixed buildbot tests, after 242c085
 2014-08-05 12:31:20 +01:00
Luar Roji
5e87ed6499 Fixed buildbot tests, after 242c085 2014-08-05 04:15:25 -07:00
Daniel Graña
3e1d157b9e Merge branch 'master' of https://github.com/scrapy/scrapy 2014-08-04 15:58:13 -03:00
Daniel Graña
9fb7b36a48 Merge branch 'w3lib-warnings' 2014-08-04 15:57:13 -03:00
Daniel Graña
3b64b2449e update other places where w3lib version is mentioned 2014-08-04 15:56:41 -03:00
Pablo Hoffman
69a665eb32 Merge pull request #832 from ivannotes/master 
Bugfix for leaking Proxy-Authorization header to targeted host
 2014-08-04 15:20:51 -03:00
Daniel Graña
511a26978f Merge pull request #817 from nramirezuy/fix-startproject-project-name 
[MRG] Fix startproject project name
 2014-08-04 11:55:35 -03:00
Paul Tremberth
480cfa1994 Update w3lib requirement to 1.8.0 2014-08-04 16:01:28 +02:00
Paul Tremberth
928e7f2924 Use w3lib.html.replace_entities() (remove_entities() is deprecated) 2014-08-03 12:02:25 +02:00
Daniel Graña
fcd34b6561 set zip_safe=False 2014-08-01 16:26:08 -03:00
Daniel Graña
1fc4e59cf4 do not ship tests package 2014-08-01 16:23:37 -03:00
Daniel Graña
f35fac11a2 scrapy.bat is not needed anymore 2014-08-01 16:23:26 -03:00
Daniel Graña
a8f45dc6dd Modernize setup.py 2014-08-01 15:43:33 -03:00
Mikhail Korobov
e62bbf0766 PY3 top-level shortcuts work 2014-08-02 00:24:32 +06:00
Daniel Graña
ee21eaa6f3 Merge pull request #835 from scrapy/modernize-asserts 
[MRG] modernize some of the asserts
 2014-08-01 15:19:36 -03:00
Mikhail Korobov
1f59a69a97 PY3 port scrapy.link 2014-08-02 00:16:01 +06:00
Mikhail Korobov
628a8d8a15 TST modernize some of the asserts 2014-08-01 23:44:23 +06:00
nramirezuy
53e74a69de exitcode and prints fixed, some code reworking 2014-08-01 14:36:30 -03:00
Nuno Maximiano
08224c92f4 add project name validation 2014-08-01 14:36:30 -03:00
Mikhail Korobov
e2c1226838 PY3 port scrapy.contrib.feedexport 2014-08-01 23:28:28 +06:00
Mikhail Korobov
51bd9f7d64 TST enable doctests for Python 3 2014-08-01 23:12:52 +06:00
Mikhail Korobov
444052a2f9 PY3 port scrapy.utils.misc.arg_to_iter; fix scrapy.utils.misc.md5sum doctest 2014-08-01 22:56:03 +06:00
Mikhail Korobov
83432184c8 PY3 enable more tests 2014-08-01 16:53:18 +06:00