Challenge Overview
This is the fifth challenge in the series for cloudHub, where we are building a process to map HTML emails and parse the data. This is an exploratory challenge, and we are looking for suggestions on how to best execute our idea. We are looking for another source for software billing details and want to be able to grab this data via email. For now we are going to work with 4 different sample HTML emails. Since the examples are unique, we don’t expect this to be capable without user interaction. The vision is that there would be an admin panel to map an email template for each application, and a separate job to process these emails on demand. The end goal of this challenge is to allow a user to map data for date, price, invoice number, and other fields. In future challenges we will work on saving the data back to mongodb.
We are looking for a functional solution, and won’t be judging based on the quality of the user interface. A similar solution for scraping web data is available at http://webscraper.io/, but our parsing process needs to run without a browser.
Requirements
- NodeJS with Express
- Ability to run scraping logic without user interaction once template or setup is complete.
- Script that will process the 4 example HTML emails and parse out price, invoice number, and date where applicable.
Final Submission Guidelines
- Deploy your solution to Heroku and make sure to include your working Heroku instance URL as part of your documentation.
- Provide your code and documentation in a single zip file. Make sure you include steps to deploy to Heroku.
- The bulk of your documentation should be in the Readme.md and you should assume that this will be open source so make sure you cover all the steps to set up, If you have specific information that should not be included in a public readme (like your heroku link or links to your video) put them in a file called submission.txt and they will be omitted from the project if it is open sourced.
- Provide a quick video of your solution in action (feel free to annotate your video if you are not comfortable with spoken English or don’t like the sound of your own voice).