Scrapy Jobs

10 were found based on your criteria

  • Hourly – Less than 1 week – 10-30 hrs/week – Posted
    I need someone to create a Scrapy program to crawl all of the urls on a given website up to X levels deep (internal links only) and return a list of unique urls. They will also need to provide a basic web API for creating new crawl jobs. Just something simple like: ..../crawl?url=somedomain.com&depth=4 They will need to provide an API interface for returning and purging the results: .../results?url=somedomain.com They will also need ...
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    I need someone to help me collect emails based on URLs (Canada + US). Meaning I will provide you with URLs and your spiders will look for emails. I understand that emails can't be always retried, but I know that many of devs here on the site have technology like this. I am not interested in the manual scraping, so do not bother to apply if you are not a developer.
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    This is a job for a developer of a person who has an access to a software which allows you to scrape multiple directories. I need to scrape us directories for dentist offices info. I need as much info as it is possible - mostly email addresses. I am using yeallabot to scrape Canadian info, but this software is difficult to use for US. The info being scraped from the directories need to be in the yellabot csv though so I ...
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    This project is to implement a simple Python/Scrapy crawler with a REST API for uploading the crawl results to a server. When applying, please describe your: 1) Experience with Python and Scrapy 2) Experience with REST APIs 3) Working hours and availability
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    This project is to implement a simple Python/Scrapy crawler with a REST API for uploading the crawl results to a server. When applying, please describe your: 1) Experience with Python and Scrapy 2) Experience with REST APIs 3) Working hours and availability
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    This project is to implement some existing Python/Scrapy crawlers with a REST API for uploading the crawl results to a server. When applying, please describe your: 1) Experience with Python and Scrapy 2) Experience with REST APIs 3) Working hours and availability
  • Hourly – 3 to 6 months – 10-30 hrs/week – Posted
    We are looking for an expirenced programmer for web scraping based on Python or PHP scripts. You may use Scrapy framework. The goal is to get data out of different real estate websites to create an ongoing database of all real estate properties currently in the market. Some of the websites are have functions to prevent scraping (like captchas) where you have to get a way around. The scripts should be executed daily by a cron job to get all ...
loading