Topcoder - Upgrade Docker Elasticsearch Feeder

Key Information

Register
Submit
The challenge is finished.

Challenge Overview

Previously, we have worked out the approach to run the elasticsearch feeder locally using docker. But there is some limitation.

1. It is just populating data into the elasticsearch setup in the same docker container.
2. It is using a old version of elasticsearch (1.7).

For this challenge, we'd like to figure out the way to 

1. Upgrade the elasticsearch feeder to work with elasticsearch 2.3.
2. Figure out the way to make elasticsearch feeder to work with external elasticsearch cluster.
2.1 A separate elasticsearch cluster in docker environment
2.2 support of populating data in AWS Elasticsearch Service, there is free tier to play with

3. Currently, the sql statements in shell scripts are just one line, which is hard to read, please help make it format by keeping the functionality working. It will be good for understanding and modification
 

Final Submission Guidelines

- Upgrade the elasticsearch feeder code
- Verification Steps for docker environment with external elasticsearch service
- Setup and Verification steps to populate data in AWS Elasticsearch Service

ELIGIBLE EVENTS:

2017 TopCoder(R) Open

REVIEW STYLE:

Final Review:

Community Review Board

Approval:

User Sign-Off

SHARE:

ID: 30056938