Directory Scraping Data Collection and Mining
Closed - This job posting has been filled and work has been completed.
Have a service that I use that does not provide an easy to use way to download their directory listings.
Each title of the website in each row is a direct link to their website url.
You can see from the screenshot at the link below that one page will have 25 listings and have hundreds of pages like this.
Each search term that I give will have tens of thousands of results, I need a list scraped of each where the end result is a csv or excel doc of the website url only for each list.
So for search term 'family', the end result should be a csv with 44,316 rows of website url addresses.
The left hand column which I have blurred out here now is an advanced search criteria for each search term that I will stipulate.
All you will do is login to the account, enter in the given search parameters and create a script to scrape the results in the desired output form.
Final results should be outputted as follows as:
I need this work done as fast as possible, best case if someone can start immediately and have it done within a few hours that is the best scenario and I will pay a bonus if the work can be done within 12 hours from posting here now at approx 9:15 est on June 27th.