Web Crawler Jobs

20 were found based on your criteria

  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    Looking for a content scraper for Etsy platform. I currently have a web app using https://github.com/paquettg/php-html-parser so you must use this as your method for grawling and scraping. I dont need you to perform the scrape, I only need the script.
  • Fixed-Price – Est. Budget: $20.00 Posted
    We currently use Xenu Link Slueth to scrape seed domains in search of expired domains. The software becomes unstable over 900k urls crawled. We are looking to have a custom crawler built that can crawl, output, run api calls to url metric tools such as Majestic and Moz and then output the domains with specific metrics into downloadable files. Here is an example http://104.131.112.117/#/dashboard The crawler needs to be able to use seed domains that ...
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    Looking for someone with strong skills in website scraping and preferably also some experience using ElasticSearch to create a cloud based web scraping solution to regularly scrape specific sites and put the normalised data into cloud hosted ElasticSearch instance. Initially thinking of using Scrapy (Python) hosted on ScrapingHub but would consider other cloud hosted scraping alternatives. Initial requirement for 10 sites but there are plans for a much larger number.
  • Fixed-Price – Est. Budget: $400.00 Posted
    Data Scrapping using Python. I would like to make a mobile app for UK based product category. The system will scrape all the best deals from the market and and list them on the system. I will provide you further details on discussion. This will be ongoing work, please let me know what would be monthly cost for this. you may be able to do this as a side work along with your other freelancing work.
  • Fixed-Price – Est. Budget: $5.00 Posted
    Dear Freelancer, I want to have a script that I can run every day to scrape. I want to script itself so i can run it myself every day. I want the script to be written in the python language. The pages I need to scrape are: http://derivatives.euronext.com/en/products/commodities-futures/EMA-DPAR/settlement-prices?tradeDate=02-16-2015 http://www.cmegroup.com/trading/agricultural/grain-and-oilseed/wheat_quotes_settlements_futures.html http://data.tradingcharts.com/futures/quotes/RS.html In the page I want ...
  • Fixed-Price – Est. Budget: $600.00 Posted
    We currently use Xenu Link Slueth to scrape seed domains in search of expired domains. The software becomes unstable over 900k urls crawled. We are looking to have a custom crawler built that can crawl, output, run api calls to url metric tools such as Majestic and Moz and then output the domains with specific metrics into downloadable files. Here is an example http://104.131.112.117/#/dashboard The crawler needs to be able to use seed domains that ...
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    We are looking for a software developer to build a custom tool to gather publicly available data from websites containing USA criminal records at the county level. Each county's record system is different from each other. The tool will initially be written for just one county. PLEASE NOTE, we DO NOT collect data from any sites that expressly prohibit this practice. Once the tool is delivered, we will run and test the tool in-house. If the tools is completed ...
loading