mirrors/dockerfiles_vimagick
2
0
Fork 0
mirror of https://github.com/vimagick/dockerfiles.git synced 2025-12-21 21:33:02 +01:00
Code Issues Projects Releases Wiki Activity

update scrapyd

Browse Source
This commit is contained in:
kev
2017-01-22 13:32:27 +08:00
parent 8ac1bff50d
commit 50797ce5e4
2 changed files with 12 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
scrapyd/README.md
View File

@@ -3,25 +3,25 @@ scrapyd
![](http://dockeri.co/image/vimagick/scrapyd) ![](http://dockeri.co/image/vimagick/scrapyd)
[Scrapy][1] is an open source and collaborative framework for extracting the [scrapy][1] is an open source and collaborative framework for extracting the
data you need from websites. In a fast, simple, yet extensible way. data you need from websites. In a fast, simple, yet extensible way.
[Scrapyd][2] is a service for running Scrapy spiders. It allows you to deploy [scrapyd][2] is a service for running Scrapy spiders. It allows you to deploy
your Scrapy projects and control their spiders using a HTTP JSON API. your Scrapy projects and control their spiders using a HTTP JSON API.
[Scrapyd-client][3] is a client for scrapyd. It provides the scrapyd-deploy [scrapyd-client][3] is a client for scrapyd. It provides the scrapyd-deploy
utility which allows you to deploy your project to a Scrapyd server. utility which allows you to deploy your project to a Scrapyd server.
[ScrapyJS][4] provides Scrapy+JavaScript integration using Splash. [scrapy-splash][4] provides Scrapy+JavaScript integration using Splash.
[Pillow][5] is the Python Imaging Library to support the ImagesPipeline. [pillow][5] is the Python Imaging Library to support the ImagesPipeline.
This image is based on `debian:jessie`, 5 latest python packages are installed: This image is based on `debian:jessie`, 5 latest python packages are installed:
- `scrapy`: git+https://github.com/scrapy/scrapy.git - `scrapy`: git+https://github.com/scrapy/scrapy.git
- `scrapyd`: git+https://github.com/scrapy/scrapyd.git - `scrapyd`: git+https://github.com/scrapy/scrapyd.git
- `scrapyd-client`: git+https://github.com/scrapy/scrapyd-client.git - `scrapyd-client`: git+https://github.com/scrapy/scrapyd-client.git
- `scrapyjs`: git+https://github.com/scrapinghub/scrapy-splash.git - `scrapy-splash`: git+https://github.com/scrapinghub/scrapy-splash.git
- `pillow`: git+https://github.com/python-pillow/Pillow.git - `pillow`: git+https://github.com/python-pillow/Pillow.git
Please use this as base image for your own project. Please use this as base image for your own project.
@@ -33,6 +33,9 @@ scrapyd:
image: vimagick/scrapyd image: vimagick/scrapyd
ports: ports:
- "6800:6800" - "6800:6800"
volumes:
- ./data:/var/lib/scrapyd
- /usr/local/lib/python2.7/dist-packages
restart: always restart: always
scrapy: scrapy:

3
scrapyd/docker-compose.yml
View File

@@ -2,6 +2,9 @@ scrapyd:
image: vimagick/scrapyd image: vimagick/scrapyd
ports: ports:
- "6800:6800" - "6800:6800"
volumes:
- ./data:/var/lib/scrapyd
- /usr/local/lib/python2.7/dist-packages
restart: always restart: always
scrapy: scrapy: