Scrapy Jobs

8 were found based on your criteria

  • Hourly – Less than 1 week – 10-30 hrs/week – Posted
    I need someone to create a Scrapy program to crawl all of the urls on a given website up to X levels deep (internal links only) and return a list of unique urls. They will also need to provide a basic web API for creating new crawl jobs. Just something simple like: ..../crawl?url=somedomain.com&depth=4 They will need to provide an API interface for returning and purging the results: .../results?url=somedomain.com They will also need ...
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    This project is to implement a simple Python/Scrapy crawler with a REST API for uploading the crawl results to a server. When applying, please describe your: 1) Experience with Python and Scrapy 2) Experience with REST APIs 3) Working hours and availability
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    This project is to implement a simple Python/Scrapy crawler with a REST API for uploading the crawl results to a server. When applying, please describe your: 1) Experience with Python and Scrapy 2) Experience with REST APIs 3) Working hours and availability
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    This project is to implement some existing Python/Scrapy crawlers with a REST API for uploading the crawl results to a server. When applying, please describe your: 1) Experience with Python and Scrapy 2) Experience with REST APIs 3) Working hours and availability
  • Hourly – 3 to 6 months – 10-30 hrs/week – Posted
    We are looking for an expirenced programmer for web scraping based on Python or PHP scripts. You may use Scrapy framework. The goal is to get data out of different real estate websites to create an ongoing database of all real estate properties currently in the market. Some of the websites are have functions to prevent scraping (like captchas) where you have to get a way around. The scripts should be executed daily by a cron job to get all ...
loading