1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-25 08:24:05 +00:00

82 Commits

Author SHA1 Message Date
Julia Medina
9a3e3ba505 Move scrapy/contrib remaining top-level files to scrapy/extensions 2015-04-29 21:27:19 -03:00
Julia Medina
54a4ce069c Rename scrapy/dupefilter.py to scrapy/dupefilters.py 2015-04-29 21:27:19 -03:00
Julia Medina
8021df18d4 Move scrapy/contrib/pipeline to scrapy/pipelines 2015-04-29 21:26:35 -03:00
Julia Medina
b47228ada8 Move scrapy/contrib/loader to scrapy/loader 2015-04-29 21:24:30 -03:00
Julia Medina
cf064b1437 Move scrapy/contrib/linkextractors to scrapy/linkextractors 2015-04-29 21:24:30 -03:00
Julia Medina
7804b3d778 Move scrapy/contrib/exporter to scrapy/exporters 2015-04-29 21:24:30 -03:00
Julia Medina
d7c444fefb Move scrapy/contrib/downloadermiddleware to scrapy/downloadermiddlewares 2015-04-29 21:24:30 -03:00
Julia Medina
c174d78f12 Deprecate scrapy/log.py 2015-04-22 17:24:40 -03:00
Julia Medina
ac40ef611a Custom handler to count log level occurrences in a crawler 2015-04-22 17:24:40 -03:00
Daniel Graña
e034947b54 Merge pull request #1166 from scrapy/spider-loader
[MRG+1] rename SpiderManager to SpiderLoader
2015-04-21 15:42:17 -03:00
Julia Medina
ffc60910aa Remove djangoitem since we moved it to scrapy/scrapy-djangoitem 2015-04-19 13:09:25 -03:00
Mikhail Korobov
403e7c7c70 rename scrapy.spidermanager.SpiderManager to scrapy.spiderloader.SpiderLoader 2015-04-16 20:07:53 +05:00
Daniel Graña
c013baa602 Merge pull request #1161 from scrapy/telnet-disable
disable scrapy.telnet if twisted.conch is not available
2015-04-15 00:32:42 -03:00
Mikhail Korobov
0b76487629 PY3 fix Python 3 syntax errors in ajaxcrawl.py
Tests for _has_ajaxcrawlable_meta passin Python 3.
2015-04-15 04:16:26 +05:00
Mikhail Korobov
378b6efc0e PY3 disable scrapy.telnet if twisted.conch is not available 2015-04-15 04:06:36 +05:00
Julia Medina
419026615f Deprecate Crawler.spiders attribute 2014-08-14 09:19:41 -03:00
Julia Medina
870438e5f4 Update tests utils, fixing get_crawler and removing docrawl 2014-08-12 14:02:56 -03:00
Mikhail Korobov
e62bbf0766 PY3 top-level shortcuts work 2014-08-02 00:24:32 +06:00
Mikhail Korobov
1f59a69a97 PY3 port scrapy.link 2014-08-02 00:16:01 +06:00
Mikhail Korobov
e2c1226838 PY3 port scrapy.contrib.feedexport 2014-08-01 23:28:28 +06:00
Mikhail Korobov
51bd9f7d64 TST enable doctests for Python 3 2014-08-01 23:12:52 +06:00
Mikhail Korobov
444052a2f9 PY3 port scrapy.utils.misc.arg_to_iter; fix scrapy.utils.misc.md5sum doctest 2014-08-01 22:56:03 +06:00
Mikhail Korobov
83432184c8 PY3 enable more tests 2014-08-01 16:53:18 +06:00
Mikhail Korobov
669b62c741 PY3 port scrapy.utils.spider 2014-08-01 16:43:39 +06:00
Mikhail Korobov
560c32d330 PY3 fix test_utils_sitemap.
Sitemap class is only initialized with bytes by Scrapy;
broken tests was only a testing issue.
2014-08-01 16:17:40 +06:00
Mikhail Korobov
330743411e PY3 enable more tests 2014-08-01 16:10:34 +06:00
Mikhail Korobov
7183a87c35 Merge pull request #828 from dangra/string-headers
normalize header values to bytes (and PY3)
2014-08-01 15:51:57 +06:00
Daniel Graña
ccae49813a PY3: port scrapy/utils/httpobj.py 2014-08-01 02:38:29 -03:00
Daniel Graña
c564334d00 PY3: port scrapy/utils/gz.py 2014-08-01 02:25:33 -03:00
Daniel Graña
910d0d36c1 PY3: port scrapy/utils/conf.py 2014-08-01 02:20:34 -03:00
Daniel Graña
f42b44b50e normalize header values to bytes 2014-08-01 00:02:50 -03:00
Daniel Graña
70ee66ba0c Collect the list of packages not working on python3 2014-07-31 14:06:34 -03:00