Scraping html pages into a database
Closed - This job posting has been filled and work has been completed.
I'll get down right to the core of the project.
I need a script, preferable written in Python. PHP will also be fine.
This script will be put on a timer using curl or something similar.
The script will access a gmail account. Read all the new emails. Extract a link from each new email and then follow each link to a page.
The link will lead to a listing that looks like this https://www.dropbox.com/s/pw9pk817
The script will scrape the listing into a database with 2 tables.
That's it. There are more specifications such as the table schema, but the main idea has been presented above.