Web Site Data Scraper

Closed - This job posting has been filled and work has been completed.

Job Description

I need data scraped from this web site:

https://www.idfpr.com/Applications/ProfessionProfile

I want to be able to provide some search criteria and receive a spreadsheet containing the data from the search results.

The URL above is a search form, and I need the form executed with the following search parameters:

Illinois County: Cook
Illinois Hospital Affiliation: Any
Specialty: Neurosurgery, Orthopaedic Surgery, Pain Management, etc. (this will require the search to be performed multiple times). I will provide additional specialties to search for if you are selected for the project.

The result of the search is a list of doctors, with 10 doctors to a page. I need all the doctors from all the pages.

Some of the information I need is on the page that lists the doctors, but most of the information is available only when you click on the doctor's name. The data I need is:

Name
Practice Location
Certified Specialties
Primary Office Name and Address
Primary Office Phone Number
Primary Office Email Address
Primary Office Web Site

Notice that the links on these pages use Javascript to post the information to the server.

---
Skills: management