Scrapy Jobs

6 were found based on your criteria

  • Fixed-Price – Est. Budget: $200.00 Posted
    i need a scraper made that will go do news stories and find the authors (reporters). The program will do the following. 1- enter a search term into google. (like Economy) 2- click the link for NEWS 3- find the reporters name. UNFORTUNATELY The names are in different locations on each story. https://www.google.com/?gws_rd=ssl#q=ECONOMY&tbm=nws Then i need a google search on each author to find the email address. skype, facebook, twitter, linked ...
  • Fixed-Price – Est. Budget: $100.00 Posted
    Mine upcoming events from two web directories for the year of 2015 and give the resulting program to perform this. It should store objects in memory, and export them to a csv when finished. Code should be well-commented and readable for future tweaks or integrations. Preferred Frameworks: Python2.7/Scrapy Estimated time to complete project is 6-10 hours. Query urls and a very detailed description with html attributes/data are available upon inquiry. Queries return paginated results in a html ...
  • Fixed-Price – Est. Budget: $300.00 Posted
    I need a Scrapy Crawler that imports about 100 Start-URLs / Domains and crawler each of them. The list of domains are attached. The crawler should handle filter files. One file for allowed URL-Pattern(regex) and another for forbidden URL-Patterns(regex). If the filter matchs the forbidden rules thant this url shouldnt be saved in the reports. The crawler should generate two reports in CSV: Examples are attached. One report should have this columns and get this results: URL / Adress, Status-Code ...
  • Fixed-Price – Est. Budget: $800.00 Posted
    Build a dynamic crawling script that can crawl multi-pages without breaking down, will be tested extensively. The super crawler will be configurable such that it can be used for multiple websites with just changing i.e. the URL, the regex pattern input format (input fields), the proxy and output format and with other relevant specifications. Most of these sites have data arranged in categories. Also note that output should be arranged by entity and the properties of the entity. For ...
  • Fixed-Price – Est. Budget: $50.00 Posted
    we require someone who understands and has worked with scrapy to setup our target websites into scrapyhub.com which will automate the process, this will be an ongoing project, and would suit someone who has a full time job, but would like to do this in the evenings etc. we have put a cost for the project but this needs a proper discussuin
loading