Scrapy Jobs

13 were found based on your criteria

  • Hourly – 1 to 3 months – Less than 10 hrs/week – Posted
    Cultr is a project at the University of Alberta. Cultr aims build a set of online tools that can be used by academic researchers to explore data and insights on popular culture on the web. One of the tools we are looking to create is a Web Scraper that would be used by researchers to gather data on specific topics from websites of their choice. We would currently like the help of a Developer with great scraping experience. You like ...
  • Fixed-Price – Est. Budget: $200.00 Posted
    i need a scraper made that will go do news stories and find the authors (reporters). The program will do the following. 1- enter a search term into google. (like Economy) 2- click the link for NEWS 3- find the reporters name. UNFORTUNATELY The names are in different locations on each story. https://www.google.com/?gws_rd=ssl#q=ECONOMY&tbm=nws Then i need a google search on each author to find the email address. skype, facebook, twitter, linked ...
  • Fixed-Price – Est. Budget: $100.00 Posted
    Mine upcoming events from two web directories for the year of 2015 and give the resulting program to perform this. It should store objects in memory, and export them to a csv when finished. Code should be well-commented and readable for future tweaks or integrations. Preferred Frameworks: Python2.7/Scrapy Estimated time to complete project is 6-10 hours. Query urls and a very detailed description with html attributes/data are available upon inquiry. Queries return paginated results in a html ...
  • Fixed-Price – Est. Budget: $300.00 Posted
    I need a Scrapy Crawler that imports about 100 Start-URLs / Domains and crawler each of them. The list of domains are attached. The crawler should handle filter files. One file for allowed URL-Pattern(regex) and another for forbidden URL-Patterns(regex). If the filter matchs the forbidden rules thant this url shouldnt be saved in the reports. The crawler should generate two reports in CSV: Examples are attached. One report should have this columns and get this results: URL / Adress, Status-Code ...
  • Hourly – Less than 1 month – Less than 10 hrs/week – Posted
    Hi. I am looking for someone who likes to write beautiful code. Someone who is passionate about efficiency and performance. I am looking for someone who knows Python inside out and has experience with "scrapy". We already have a project runnig, and want to implement some improvements on the quality of the information that we crawl. In ideal candidate would supply me with the following: Your experience in this field A method of contact like gtalk A link to your ...
  • Fixed-Price – Est. Budget: $800.00 Posted
    Build a dynamic crawling script that can crawl multi-pages without breaking down, will be tested extensively. The super crawler will be configurable such that it can be used for multiple websites with just changing i.e. the URL, the regex pattern input format (input fields), the proxy and output format and with other relevant specifications. Most of these sites have data arranged in categories. Also note that output should be arranged by entity and the properties of the entity. For ...
  • Fixed-Price – Est. Budget: $250.00 Posted
    I need someone who can build a web crawler in scrapy and export files to csv. I would like to scrape multiple pages with multiple fields required such as: name, position, location, time, price...
  • Fixed-Price – Est. Budget: $100.00 Posted
    I want a software or script that scan some internet video sites and get an URL from video and take a screenshot from it. I need to search on xvideos, youtube, vimeo, xhamster, porntube, etc. For example, I search on xvideos "Kate Perry" and xvideos show 20 results. I need video links and video screenshot from each result.
loading