BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-27 04:24:05 +00:00
Code Releases Wiki Activity
2,949 Commits 39 Branches 119 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
olveyra e6d7afa13b Fix autothrottle in order to modify also inactive downloader slots, so cases fixed by inactive slots patch will work ok also when using autothrottle
2012-04-03 23:14:00 +00:00
artwork
added artwork files properly now
2012-03-20 10:46:45 -03:00
bin
slightly improved version of scrapyd script
2011-06-20 11:04:38 -03:00
debian
bumped required python-w3lib version in debian/control
2012-03-05 20:25:38 -02:00
docs
changed default user agent to Scrapy/0.15 (+http://scrapy.org) and removed no longer needed BOT_VERSION setting
2012-03-23 13:45:21 -03:00
extras
fixed test-scrapyd.sh script after changed on insophia website
2012-03-22 16:38:28 -03:00
scrapy
Fix autothrottle in order to modify also inactive downloader slots, so cases fixed by inactive slots patch will work ok also when using autothrottle
2012-04-03 23:14:00 +00:00
scrapyd
removed some obsolete remaining code related to sqlite support in scrapy
2012-03-16 11:55:55 -03:00
sep
added sep directory with Scrapy Enhancement Proposal imported from old Trac site
2012-03-20 10:15:00 -03:00
.coveragerc
Added rules to Makefile.buildbot for generating coverage reports
2010-12-15 11:13:45 -02:00
.gitignore
Merge branch '0.12'
2011-09-18 01:08:04 -03:00
.hgtags
Added tag 0.10.3 for changeset 803efdb19e0b
2010-09-29 13:34:56 -03:00
AUTHORS
added Darian Moody to AUTHORS
2011-06-12 01:42:30 -03:00
INSTALL
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
LICENSE
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
Makefile.buildbot
moved coverage report script to extras/
2010-12-15 12:08:59 -02:00
MANIFEST.in
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
2011-08-07 02:49:57 -03:00
README
fixed typo
2011-04-07 02:04:42 -03:00
setup.cfg
moved rpm-install.sh to extras/
2011-09-18 06:08:28 -03:00
setup.py
Removed (very old and possibly broken) backwards compatibility support for Twisted 2.5
2012-03-15 00:28:24 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more info visit the project home page at http://scrapy.org
Description
Scrapy, a fast high-level web crawling & scraping framework for Python.
crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python
Readme BSD-3-Clause 128 MiB
Languages
Python 99.8%
HTML 0.1%