Scrapy Jobs

79 were found based on your criteria

  • Fixed-Price – Est. Budget: $200.00 Posted
    i need a scraper made that will go do news stories and find the authors (reporters). The program will do the following. 1- enter a search term into google. (like Economy) 2- click the link for NEWS 3- find the reporters name. UNFORTUNATELY The names are in different locations on each story. https://www.google.com/?gws_rd=ssl#q=ECONOMY&tbm=nws Then i need a google search on each author to find the email address. skype, facebook, twitter, linked ...
  • Fixed-Price – Est. Budget: $100.00 Posted
    Mine upcoming events from two web directories for the year of 2015 and give the resulting program to perform this. It should store objects in memory, and export them to a csv when finished. Code should be well-commented and readable for future tweaks or integrations. Preferred Frameworks: Python2.7/Scrapy Estimated time to complete project is 6-10 hours. Query urls and a very detailed description with html attributes/data are available upon inquiry. Queries return paginated results in a html ...
  • Fixed-Price – Est. Budget: $300.00 Posted
    I need a Scrapy Crawler that imports about 100 Start-URLs / Domains and crawler each of them. The list of domains are attached. The crawler should handle filter files. One file for allowed URL-Pattern(regex) and another for forbidden URL-Patterns(regex). If the filter matchs the forbidden rules thant this url shouldnt be saved in the reports. The crawler should generate two reports in CSV: Examples are attached. One report should have this columns and get this results: URL / Adress, Status-Code ...
  • Hourly – Less than 1 month – Less than 10 hrs/week – Posted
    Hi. I am looking for someone who likes to write beautiful code. Someone who is passionate about efficiency and performance. I am looking for someone who knows Python inside out and has experience with "scrapy". We already have a project runnig, and want to implement some improvements on the quality of the information that we crawl. In ideal candidate would supply me with the following: Your experience in this field A method of contact like gtalk A link to your ...
  • Fixed-Price – Est. Budget: $85.00 Posted
    I need a scrapy crawl that crawl all domains containing in a csv file. The csv file is attached in this job. The crawler should crawl every url on this domains and try to find a specifc div class The div class is: abstractcomponent openinghours here are some example urls with this div-class: http://www.mercedes-benz-berlin.de/content/deutschland/retail-plz1/berlin/de/desktop/passenger-cars/about-us/locations/location.6150.html http://www.europa.mercedes-benz.be/content/belgium/retail-m-r/mercedes-europa/fr/desktop ...
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    The first project in the pipe is to record & download locally live video streaming at 24x7. The URL's will be provided and should be straight forward. We are looking to engage with a firm/consultant on contractual basis to help us with writing amazing scripts that scrape the web for us and fetch critical data for our business & tech stack. We are LensBricks - a technology startup founded by stalwarts fromt MIT and Nokia. We amplify the power of sensing ...
  • Fixed-Price – Est. Budget: $250.00 Posted
    I am looking for someone who to write a script that will grab all the data from the website "diy solyent" (https://diy.soylent.me), and put them into data files (text files, CSV, etc) that can be read by common statistical programs (Stata, SAS, etc). I can work with you to construct the data structure (variable fields, unique rows, and tables) to be produced or I can provide it explicitly. Its not a complicated website, however.
  • Fixed-Price – Est. Budget: $250.00 Posted
    I need someone who can build a web crawler in scrapy and export files to csv. I would like to scrape multiple pages with multiple fields required such as: name, position, location, time, price...
loading