Web Crawler Jobs

68 were found based on your criteria

  • Hourly – 3 to 6 months – 30+ hrs/week – Posted
    I need a data-mining system that manages documents inside. The following features are required: - Searching documents over internet by certain criteria like keywords, countries etc. - Search providers (Google, Yahoo, maybe more) should be implemented as plugins and should be able to be added at runtime - Refining search results to have relevant sets - Analysing documents with special rules by tags, keywords. - Checking existing database of documents to have the latest versions - Updating database with new documents automatically or moderating manually Application ...
  • Fixed-Price – Est. Budget: $10.00 Posted
    I have a very easy job for the right person. You will create a simple scraper using Import.io (Google it) that will grab posts from Reddit sub reddits. This will include the following: 1. Image 2. Title 3. Tags/Keywords I will need to be able to enter any subreddit I desire. If you have a simple solution in for this task in python I may consider it as well. However, using Import.io to make the crawler/scraper ...
  • Fixed-Price – Est. Budget: $75.00 Posted
    Hello, I need someone who is able to crawl the data from google trends automized. Hint: There are some open source projects on github for this. It is about it's CSV export, I have a list oft 100 Keywords which has to be crawled over different time spans. So the crawler must be able to: 1) Login in into google 2) Download the CSV file for different timespans 3) Do the same with the next CSV file. The major ...
  • Hourly – 1 to 3 months – Less than 10 hrs/week – Posted
    Hello, we want to develop a web crawler to get the latest price information on different e-commerce platforms. We're planning to use Amazon EC2 API as a base for the crawler. http://docs.aws.amazon.com/AWSEC2/latest/APIReference/Welcome.html If you have other suggestions or already experiences with it, please let us know. We're also open-minded for other software. In a first step, the crawler should match through EAN. So you'll get a list with ...
  • Fixed-Price – Est. Budget: $50.00 Posted
    Someone to teach me to scrape online shops with import.io or datatoolbar.com and import data in opencart import.io datatoolbar.com knowledge of this is a must ! This job is for professional who has experience in the field. If you are not experienced no need to apply if you are, then start your text with Hallo 64 so i’ll know you have read the task.
  • Fixed-Price – Est. Budget: $800.00 Posted
    Build a dynamic crawling script that can crawl multi-pages without breaking down, will be tested extensively. The super crawler will be configurable such that it can be used for multiple websites with just changing i.e. the URL, the regex pattern input format (input fields), the proxy and output format and with other relevant specifications. Most of these sites have data arranged in categories. Also note that output should be arranged by entity and the properties of the entity. For ...
  • Fixed-Price – Est. Budget: $100.00 Posted
    Hi there, I am looking for a configurable script for scraping several webshops and comparison websites. The script should create a CSV or XML containing basic product information based on a list of provided EAN-codes. It would be great if it's possible for us to reconfigure or remap the script for different websites. Douwe