Web Crawler Jobs

24 were found based on your criteria

  • Fixed-Price – Est. Budget: $500.00 Posted
    We are UK Printing company, we are in the process of launching new ecommerce website. We are looking for professional whom are familiar with web scraping prices from websites, we want to scrap prices from our competition and partner websites, all of our partner websites require to login before having access to the correct prices, with the competition websites we can collect price without the need of login. We are looking for someone who is familiar with either import.io ...
  • Fixed-Price – Est. Budget: $20.00 Posted
    We currently use Xenu Link Slueth to scrape seed domains in search of expired domains. The software becomes unstable over 900k urls crawled. We are looking to have a custom crawler built that can crawl, output, run api calls to url metric tools such as Majestic and Moz and then output the domains with specific metrics into downloadable files. Here is an example http://104.131.112.117/#/dashboard The crawler needs to be able to use seed domains that ...
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    Looking for someone with strong skills in website scraping and preferably also some experience using ElasticSearch to create a cloud based web scraping solution to regularly scrape specific sites and put the normalised data into cloud hosted ElasticSearch instance. Initially thinking of using Scrapy (Python) hosted on ScrapingHub but would consider other cloud hosted scraping alternatives. Initial requirement for 10 sites but there are plans for a much larger number.
  • Fixed-Price – Est. Budget: $150.00 Posted
    I need 2 different scripts created for Visual Web Ripper to scrape content from 2 different websites. The first website is a real estate listing website and another is a classified ad website. The scripts are easy, all I need is from the real estate website is • first and last name • email address. • and date scraped From the classified ad website I need • ad url • Ad headline • address if available • email address • phone # if available • city which ad was posted ...
  • Fixed-Price – Est. Budget: $30.00 Posted
    collect data from a website. you will be provided with an excel list of numbers. (~5000) you will input each number into the search box on the webpage, do a search, then click a couple of links to reach the final webpage we're interested in. You will then extract a few pieces of info on this final page. I'll send you a sample list to try. If no desired info is available from this website, a second webpage ...
  • Hourly – More than 6 months – 10-30 hrs/week – Posted
    We are a Real Estate Company looking for a tech-savvy virtual assistant who can support us while we are expanding. You should have Fluent English speaking. Since we're based in US we have clientele from all over States, we require an American accent. Besides speaking, following are the key qualities we are looking for in a virtual assistant. - Quick Learner and Punctual (We value quality time spent, irregular logins will not be acceptable) - Excellent writing skills - Be learned with ...
  • Fixed-Price – Est. Budget: $50.00 Posted
    we require someone who understands and has worked with scrapy to setup our target websites into scrapyhub.com which will automate the process, this will be an ongoing project, and would suit someone who has a full time job, but would like to do this in the evenings etc. we have put a cost for the project but this needs a proper discussuin
  • Fixed-Price – Est. Budget: $150.00 Posted
    I have a list of approximately 10,000 keywords. I need all of the URL's from the Google search results (SERPs) for each keyword exported into a single CSV. Most keywords return under 100 results. This task could likely be doing with automated tools or scrapers, but it could also be done manually. Potential tools used could be: http://www.scrapebox.com/search-engine-scraper https://chrome.google.com/webstore/detail/link-klipper-extract-all/fahollcgofmpnehocdgofnhkkchiekoo?hl=en The final deliverable will be one ...
loading