PROBLEM
STATEMENT
Our client, minervaai.io/, needed to get the official financial records and other details of Canadian mayors. They were finding it hard to continuously keep up with this information. Data Prism was tasked to devise a smart technique that could check the current mayor of all the cities of Canada on an on-going basis. The biggest challenge with this was that there was no single or well-formatted source of this information on the web.
SOLUTION
We designed a web scraping algorithm to get the data from Wikipedia and some other sources. The extracted information was stored in MongoDB in a specific format (mentioned by the client) for further analysis.
Input
Required details for the mayors of Canada.
Output
MongoDB files containing details of all incumbent mayors of Canada.
Tools &
Technologies
Node.js (Cheerio, Wiki.js, Compromise, Objects-to-CSV)
