Scrapy Jobs

12 were found based on your criteria

  • Fixed-Price – Est. Budget: $200.00 Posted
    Summary: Programmatically get images and text descriptions of 10000 points of geographical interest, e.g., the Heathrow Airport, The Eiffel Tower, Parliament House, etc. Details: We need this data to test and demonstrate an app we’ve been working on. Specifically, we need a short description (text), long description (text), lat-long (numbers), and images (1-10, between 50K and 1Mb in size). Ideally the first image should be in the spirit of a profile image. I would like to have data ...
  • Fixed-Price – Est. Budget: $500.00 Posted
    We are UK Printing company, we are in the process of launching new ecommerce website. We are looking for professional whom are familiar with web scraping prices from websites, we want to scrap prices from our competition and partner websites, all of our partner websites require to login before having access to the correct prices, with the competition websites we can collect price without the need of login. We are looking for someone who is familiar with either ...
  • Fixed-Price – Est. Budget: $50.00 Posted
    we require someone who understands and has worked with scrapy to setup our target websites into which will automate the process, this will be an ongoing project, and would suit someone who has a full time job, but would like to do this in the evenings etc. we have put a cost for the project but this needs a proper discussuin
  • Hourly – Less than 1 week – Less than 10 hrs/week – Posted
    I need an expert for creating a reliable scrpay based crawler. This Crawler should crawl and analyse ALL Pages of a given project. for each found page within the given project different elements should be extracted and collected. e.g - all Links (<a>) on the Page and all data for each link like href, rel, css-class, title, anchortext - all headings - H1- H6 + Text within <h1>...</h1> the crawler should be very reliable in crawling a hughe amount of different websites
  • Fixed-Price – Est. Budget: $200.00 Posted
    We run a small python Scrapy server with a handful of projects. We need to finish configuring the same so that we can utilize scrapyd. The scope of the work is: 1. Review current jobs and scrapy setup 2. Change the setup so that we can run jobs using Scrapyd 3. Document how our scraping jobs are to be deployed & monitored Please note that due to security reasons, the scrapyd web interface cannot be used so we need the setup ...
  • Fixed-Price – Est. Budget: $200.00 Posted
    We would like to create a database of all youtube accounts that have posted videos. The most important element of the database is the email address associated with each account. Some don't list their email address, but many do. A couple of tricky things about youtube: - when account owners list their emails, they put it in the "about" section of their accounts in free form text (here's an example: . . .he has ...
  • Hourly – Less than 1 month – Less than 10 hrs/week – Posted
    Need to be able to pull back reviews for local businesses based on phone # match. Data needs to be stored in a MySQL db. Sites we need data from would be Google, Yelp,, DrOogle, YahooLocal, Houzz, and Data would get pulled down 1 time. Select records should check for new reviews once a month. Also need to be able to pull back new reviews for a specific business on demand from web based CRM.
  • Fixed-Price – Est. Budget: $20.00 Posted
    I need a car dealers website scraped of inventory. I need the following information Condition (new or Used or certified) Year (2013) Make (Honda) Model (Ridgeline) Trim (XL) VIN (vehicle identification number) Price ($33,000) Engine (2.4 V6) Transmission (Automatic) Drive train (4 WD) Miles (123,000) Features / description (text blob of features and vehicle copy) Exterior Color (Midnight Black) Interior Color (Tan) Image URL (fully qualified url) Page URL (dealer website url to vehicle detail page) Dealer name ...
  • Hourly – More than 6 months – 30+ hrs/week – Posted
    Web Scribble Solutions, Inc. is looking to hire a mid-level web-developer to join our international team located wherever you are! That's right, this is a 100% cloud based, remote position! At Web Scribble, we work in a very agile environment, where we strive for short release cycles and are quick to adapt to new requirements and challenges from our clients. Because of this, you must be comfortable working in a dynamic environment and setting your own pace as a ...