I am looking for an expert in web crawling who can develop a website to scrape data off various sites. Data should be retrieved on a scheduled basis and inserted into a SQL database. After that, it can be queried by a public-facing web site.
Your code should be efficient and very well documented. I want to be trained on how your code works as I will be maintaining and extending at a later time. This is only the beginning of this project, there is much more work potentially after this point.
More details to follow after meeting.
Looking forward to working with you!