GitHub, StackExchange scraping with Python and API
Closed - This job posting has been filled.
This job requires you to do 2 major things:
1) take over the existing code written in python for pulling data from the GitHub and improve it by adding various filters and optimizations, while also increasing the amount of data pulled
2) Write stackoverflow questions scraper, details about that part available during the interview
After you pull the data - its to be stored in MongoDB.
While writing cover letters - outline how you would ensure that scraping process is fast and efficient.