Est. Budget: $250.00
We would like a simple Task system, written in Python that will load 50 million domain names into a Google Push Queue.
Once in the queue, we want you to request each homepage, of every domain. Any that return a response we need to store:
- Title Tag
- Meta Description
- Outbound Links
- Full HTML of Page
This data needs to be stored in Google's Datastore service:
Coder must be thoroughly experienced with ...