HP Haven Twitter Analysis Tutorial Challenge

Background

The HP Haven Big Data platform harnesses 100% of your data—structured and unstructured—to inform every decision and help you capitalize on opportunities and solve problems. Available on-premise or in the cloud, Haven offers Big Data analytics and next gen applications at unmatched speed and scale.

Through a mix of fun and real world challenges, HP is inviting the TopCoder community to learn how to build the next generation of Big Data and analytics apps using the Haven OnDemand platform. We hope that this series will be interesting, challenging, and rewarding for developers of all levels that are looking to gain valuable new skills and experience.  You can find the latest Topcoder challenges related to the HP Haven Big Data Platform here:

http://hphaven.wpengine.com/

More information about the complete HP Haven offering can be found at the HP Haven web site:

http://www8.hp.com/us/en/software-solutions/big-data-platform-haven/

HP Haven Twitter Analysis Tutorial Challenge

This is part of a series of challenges for Topcoder members to engage with the Vertica database and analytics platform. 

In a previous challenge, we installed a local version of the Vertica Analytics platform. Now, we’re going to build on that by asking members to create a tutorial-type application which analyzes Twitter data using IDOL OnDemand’s Sentiment Analysis functionality and then saves the data to Vertica for further analysis.  The installation instructions from the previous challenge are attached to this competition.

Challenge Instructions/Requirements

Here are the steps to participate in the HP Haven Twitter Analysis Tutorial challenge:

1. You’ll be creating a Java application which accesses Twitter data for the Hewlett Packard stock symbol tag “$HPQ”, performs sentiment analysis on this data, and loads the raw social feed and sentiment data into the Vertica database.  The application should also display some kind of visualization about how sentiment is changing over time or by topic.  The application should extract enough Tweets that the Sentiment Analysis shows some depth/variation – at least 1000 Tweets, but more would even be better.
2. You have creative license about what kind of application to create.  You may create a mobile, web, or desktop app.
3. Your application should connect to the IDOL OnDemand platform to perform the Sentiment Analysis on the Twitter data related to the tag $HPQ.  The Sentiment Analysis results should be stored in your locally configured version of Vertica.  Sample Java code to connect to IDOL OnDemand is attached to the challenge.  Sample code can also be found on the IDOL OnDemand Community site.
4. This is a tutorial challenge. Your code should be clear and well documented.
5. You should produce a blog post about your application.
6. You should produce a screensharing video which explains your code and how to set up and connect to a Vertica database.
7. There should be some kind of visualization in your app which displays the Sentiment Scores related to a topic and/or time dimension.  
8. We're currently running a Sweepstakes challenge which walks through the Vertica setup on a local VMWare instance.  We're also attaching a Vertica lab manual which describes how to add users, create schemas, and load data into the system.  It assumes, however, that you have the Vertica Virtual Server instance installed and locally available.

Getting started up with IDOL OnDemand

Before you can use the API’s you’ll need to sign up for an IDOL OnDemand developer account:

http://www.idolondemand.com/signup.html

Please indicate that you heard about IDOL OnDemand through [topcoder] in the “How did you hear about IDOL OnDemand?” field:

Once your account has been verified you’ll be assigned a developer account and API Key that will allow you to make API calls.   Complete information about available IDOL OnDemand API’s can be found here: 

https://www.idolondemand.com/developer/apis

You’ll need to register for a developer account with HP in order to get access to additional Try functionality in the API console.  Use of the APIs is free and restricted to non-commercial use at this time. Commercial use and pricing will be announced in the near future.

Before you compete in an IDOL-related challenge on [topcoder] please create a topcoder-specific key in your IDOL OnDemand Account.  You can do this by Clicking on Account->API Keys from the developer home page.

Simply generate a new key and rename it to “topcoder” as shown above.   This should be the key that you use in [topcoder] challenge completion.  This will also give you visibility to Preview API’s which may not yet be in public release.  Employees and direct and indirect subcontractors of Hewlett-Packard Company and its subsidiaries and other affiliates (“HP”), and employees and direct and indirect subcontractors of HP’s partners (including TopCoder and its affiliates) are not eligible to participate in the challenge.

You should be all set!

Final Submission Guidelines

Submission Guidelines

1. In your submission zip file you include the source files for your app in zip, jar, or war format.

2. Your submission zip should also include sql/ddl scripts to create your database structures.  

3. Please a submission.txt file in the root folder of your submission zip with links to your blog post and video tutorial.

4. Please include instructions on how to build and deploy your app along with the necessary ant or maven scripts.

5. You can obtain an IDOL OnDemand license key by following the steps outlined in the "Getting Started with IDOL OnDemand" section above.  There is no cost for a developer account.

Employees and direct and indirect subcontractors of Hewlett-Packard Company and its subsidiaries and other affiliates (“HP”), and employees and direct and indirect subcontractors of HP’s partners (including TopCoder and its affiliates) are not eligible to participate in the challenge.