BackTrackZ/scrapy
BackTrackZ/scrapy
1
0
Fork 0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-23 07:04:01 +00:00
Code Releases Wiki Activity
2,358 Commits 39 Branches 119 Tags
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Pablo Hoffman f47b9f608c simplified lockfile used by scrapyd (/var/run/scrapyd.pid instead of /var/run/scrapyd/scrapyd.pid). closes #271
2010-10-27 14:18:40 -02:00
bin
Added tests for Scrapyd components. Closes #237
2010-09-14 01:44:10 -03:00
debian
simplified lockfile used by scrapyd (/var/run/scrapyd.pid instead of /var/run/scrapyd/scrapyd.pid). closes #271
2010-10-27 14:18:40 -02:00
docs
Formatting fix in Scrapyd doc
2010-10-17 03:20:23 -02:00
examples
Changed format of scrapy.cfg file to contain a [settings] section and a 'default' key inside it, instead of the other way around
2010-09-02 21:22:17 -03:00
extras
Some changes to Scrapyd to support multiple configuration files, to make it easier to deploy Scrapyd applications. Also documented 'egg_runner' and 'application' options
2010-09-07 09:17:25 -03:00
profiling/priorityqueue
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
scrapy
changed robots.txt forbidden log level to DEBUG. closes #268
2010-10-27 09:17:58 -02:00
scrapyd
Refactored Scrapyd code to fix a couple of bugs that ocurred when running projects without eggs
2010-09-22 01:04:15 -03:00
scripts
removed python2.5 from rpm-install.sh script
2009-06-16 13:14:40 -03:00
.hgignore
ignore docs/build
2009-07-25 15:21:22 -03:00
.hgtags
Added tag 0.10.3 for changeset 803efdb19e0b
2010-09-29 13:34:56 -03:00
AUTHORS
Added Shuaib Khan to AUTHORS
2010-09-20 08:34:22 -03:00
INSTALL
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
LICENSE
mv scrapy/trunk to root as part of svn2hg migration
2009-05-06 15:55:17 -03:00
MANIFEST.in
Added missing mime.types files to MANIFEST.in
2010-09-11 04:30:08 -03:00
README
added scrapy-sqs.py to deployed scripts
2010-06-13 19:17:17 -03:00
setup.cfg
added bitmap for windows installer
2009-09-17 02:01:40 -03:00
setup.py
setup.py: added support for generating version from hg revision
2010-09-27 08:19:32 -03:00

README 

This is Scrapy, an opensource screen scraping framework written in Python.

For more visit the project home page at http://scrapy.org
Description
Scrapy, a fast high-level web crawling & scraping framework for Python.
crawlercrawlingframeworkhacktoberfestpythonscrapingweb-scrapingweb-scraping-python
Readme BSD-3-Clause 127 MiB
Languages
Python 99.8%
HTML 0.1%