Everyday, numerous people are posted on www.thedirty.com
I am looking for someone that can pull/scrape the following information from peoples "profiles"(such as this one http://thedirty.com/2013/09/beware
As you will see there are multiple section to the site(Cities, Colleges, Dirty Celebs, Would You, Dirty Athletes etc.)
I am only interested in pulling/scraping information from two sections:
1. Cities(both in U.S AND Canada)
2. Colleges(All of them)
The following information is needed from each "profile":
a. The title of the post
c. # of views
d. The date of the posting
e. The content of the post(i.e the message about the person)
f. Screenshot of each individual post including the persons picture
Most importantly I need the following:
1. The information above that I request to be scrapped needs to be gathered on a daily basis or in "real time" or as often as possible without duplication. I need this information to be aggregated into an excel spreadsheet that we can access at any time.
2. In addition, I would like the requested information above pulled/scrapped from all previous "profiles" in the College AND Cities sections - that have been posted on the website since it began, and put into an excel document.
Please let me know if you have any questions or need any further information.
Thank you very much,