Web Crawler Jobs

32 were found based on your criteria

  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    Looking for a content scraper for Etsy platform. I currently have a web app using https://github.com/paquettg/php-html-parser so you must use this as your method for grawling and scraping. I dont need you to perform the scrape, I only need the script.
  • Fixed-Price – Est. Budget: $20.00 Posted
    We currently use Xenu Link Slueth to scrape seed domains in search of expired domains. The software becomes unstable over 900k urls crawled. We are looking to have a custom crawler built that can crawl, output, run api calls to url metric tools such as Majestic and Moz and then output the domains with specific metrics into downloadable files. Here is an example http://104.131.112.117/#/dashboard The crawler needs to be able to use seed domains that ...
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    Looking for someone with strong skills in website scraping and preferably also some experience using ElasticSearch to create a cloud based web scraping solution to regularly scrape specific sites and put the normalised data into cloud hosted ElasticSearch instance. Initially thinking of using Scrapy (Python) hosted on ScrapingHub but would consider other cloud hosted scraping alternatives. Initial requirement for 10 sites but there are plans for a much larger number.
  • Fixed-Price – Est. Budget: $30.00 Posted
    collect data from a website. you will be provided with an excel list of numbers. (~5000) you will input each number into the search box on the webpage, do a search, then click a couple of links to reach the final webpage we're interested in. You will then extract a few pieces of info on this final page. I'll send you a sample list to try. If no desired info is available from this website, a second webpage ...
  • Fixed-Price – Est. Budget: $50.00 Posted
    we require someone who understands and has worked with scrapy to setup our target websites into scrapyhub.com which will automate the process, this will be an ongoing project, and would suit someone who has a full time job, but would like to do this in the evenings etc. we have put a cost for the project but this needs a proper discussuin
  • Hourly – More than 6 months – 30+ hrs/week – Posted
    Hi there, I am looking for a full-time employee who can find websites that are NOT mobile. I am looking for someone who can find 1000 - 5000 leads per week. The leads will consist of businesses in the United States that have a desktop website, but not a mobile website. I am looking for someone full-time and will become part of a great team. Willing to pay a salary or per lead. I am need someone to start immediately. Thank ...
  • Fixed-Price – Est. Budget: $1,000.00 Posted
    We are interested in finding an expert that should develop a web application in .NET that will login to a specific website and query the system according to specific parameters. Is this you? Join us! Responsibilities: - Build web scrapers, crawlers, and routines for harvesting data from the web and 3rd parties; - Develop intelligent algorithm in order to parse web pages successfully; - Perform unit testing to ensure consistency; - Anticipate risks to websites; - Review business requirements and translate them in technical solutions ...
  • Hourly – Less than 1 month – 30+ hrs/week – Posted
    We need to create a Google Chrome Extension Web Scraper for LinkedIn. The user will navigate to a LinkedIn profile (public or private), open the Google Chrome Extension, and be able to scrape the following data into a Google Spreadsheet with a one-button click: General Profile LinkedIn URL Full Name Title Company Location Industry Email Phone Number Connection Count Work Experience (Top 3) Title Company Date From Date To Education (Top 3) Institution Name Education Level Degree Date From Date ...
  • Hourly – 1 to 3 months – 10-30 hrs/week – Posted
    We are looking for someone to extract data from a web site. We are members of the FGFOA www.fgfoa.org. they have over 2000 members and we would like to start a marketing campaign to part of the list. We need to get them in an excel format to do this. There are a few programs on the market or Macros that can be written to do this we would like some who is experience and has done this ...
loading