Challenge Overview
Previously, we have separate out the loader (https://github.com/appirio-tech/tcs-loader) which loads data from one informix database (tcs_catalog) to another informix database (tcs_dw).
For this challenge, we'd like to create another loader, which will mimic the same behavior as com.topcoder.utilities.dwload.TCLoadTCS
But it will load the data from informix database (tcs_catalog) to Redshift.
General Requirements
1. Create Reshift tables according to informix database table definitions (https://github.com/appirio-tech/tc-database-scripts/tree/master/tcs_dw)
2. Create another loader class which will duplicate the similar logic as com.topcoder.utilities.dwload.TCLoadTCS, but it will insert records to Redshift
3. Add new configurations in scripts directory for ease of usage.
About Testing
- For Informix, you can use docker to setup local env, see https://github.com/appirio-tech/tcs-loader/blob/master/README.md
- For Redshift, you need to create your own in AWS, there are free tier for new users.
- Schema For Creating Redshift tables
- Sample data for informix to migrate, please cover at least 3 test data for 3 different doLoadXXXX logic, and make sure your implemenation is general for all doLoadXXX methods.
Winner Responsiblity
Winner will be responsible to create PR in github for merge.
For this challenge, we'd like to create another loader, which will mimic the same behavior as com.topcoder.utilities.dwload.TCLoadTCS
But it will load the data from informix database (tcs_catalog) to Redshift.
General Requirements
1. Create Reshift tables according to informix database table definitions (https://github.com/appirio-tech/tc-database-scripts/tree/master/tcs_dw)
2. Create another loader class which will duplicate the similar logic as com.topcoder.utilities.dwload.TCLoadTCS, but it will insert records to Redshift
3. Add new configurations in scripts directory for ease of usage.
About Testing
- For Informix, you can use docker to setup local env, see https://github.com/appirio-tech/tcs-loader/blob/master/README.md
- For Redshift, you need to create your own in AWS, there are free tier for new users.
Final Submission Guidelines
- Code Changes for the new Loader- Schema For Creating Redshift tables
- Sample data for informix to migrate, please cover at least 3 test data for 3 different doLoadXXXX logic, and make sure your implemenation is general for all doLoadXXX methods.
Winner Responsiblity
Winner will be responsible to create PR in github for merge.