BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-26 07:24:06 +00:00
Code Releases Wiki Activity
2,910 Commits 39 Branches 119 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Pablo Hoffman 4ed1a03521 Merge pull request #95 from scrapy/openmobilealliance-mimetype 
Handle as html standard mimetype defined by Open Mobile Alliance
2012-02-24 10:28:32 -08:00
bin
slightly improved version of scrapyd script
2011-06-20 11:04:38 -03:00
debian
make scrapyd debian package dependent on the same (or higher) version of scrapy package
2012-01-13 10:55:20 -02:00
docs
MemoryUsage extension: close the spiders (instead of stopping the engine) when the limit is exceeded, providing a descriptive reason for the close. Also fixed default value of MEMUSAGE_ENABLED setting to match the documentation.
2012-02-23 17:05:06 -02:00
extras
extras/makedeb.py: no longer obtaining version from git
2012-01-02 13:28:51 -02:00
scrapy
Merge pull request #95 from scrapy/openmobilealliance-mimetype
2012-02-24 10:28:32 -08:00
scrapyd
scrapyd: added Items link to completed jobs table
2012-01-12 17:43:44 -02:00
.coveragerc
Added rules to Makefile.buildbot for generating coverage reports
2010-12-15 11:13:45 -02:00
.gitignore
Merge branch '0.12'
2011-09-18 01:08:04 -03:00
.hgtags
Added tag 0.10.3 for changeset 803efdb19e0b
2010-09-29 13:34:56 -03:00
AUTHORS
added Darian Moody to AUTHORS
2011-06-12 01:42:30 -03:00
INSTALL
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
LICENSE
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
Makefile.buildbot
moved coverage report script to extras/
2010-12-15 12:08:59 -02:00
MANIFEST.in
moved module scrapy.core.downloader.responsetypes to scrapy.responsetypes
2011-08-07 02:49:57 -03:00
README
fixed typo
2011-04-07 02:04:42 -03:00
setup.cfg
moved rpm-install.sh to extras/
2011-09-18 06:08:28 -03:00
setup.py
use git describe for building version from git, and removed support for building version from hg
2012-01-02 13:05:26 -02:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more info visit the project home page at http://scrapy.org
Description
Scrapy, a fast high-level web crawling & scraping framework for Python.
crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python
Readme BSD-3-Clause 128 MiB
Languages
Python 99.8%
HTML 0.1%