Less than 1 week –
10-30 hrs/week –
I am looking to crawl about 15-20k sites, all investment funds and investment banks. I would like to gather all their historical transaction data from the news/press release sections of their sites. With this data we would want to create visuals to understand trends and patterns in a variety ways.
Then I would like to scrape these sites daily to start to create a feed of transactions as they are announced.