Est. Budget: $2,000.00
I have a list of ~100 million URLs that I need crawled and the HTML source saved.
Once you begin, I will send you the list of URLs to crawl. For each page, you will crawl it and then save the HTML source to Amazon S3.