Est. Budget: $200.00
We run a small python Scrapy server with a handful of projects. We need to finish configuring the same so that we can utilize scrapyd.
The scope of the work is:
1. Review current jobs and scrapy setup
2. Change the setup so that we can run jobs using Scrapyd
3. Document how our scraping jobs are to be deployed & monitored
Please note that due to security reasons, the scrapyd web interface cannot be used so we need the setup ...