Challenge Overview
Challenge Objectives
-
Create a nodejs processor that will listen to a topic in kafka and process the incoming message
Project Background
Our client wants to create an employee management system to determine employees that are no longer working on active projects and to understand their qualifications and expertise for suitability in other projects
Technology Stack
-
Nodejs version 12
-
Kafka version 2.x
-
Amazon S3
Code access
No code to share. This is the first contest on the processor and you are starting from scratch
Individual requirements
The requirement is to create a nodejs based processor that listens to a topic in kafka and processes the incoming message. You are expected to refer to the existing kafka listening processors such as the submission processor (which takes a submission that is uploaded, instructs the anti virus application to scan it and generates a review based on the scan status) and the lookups data processor (which listens to events on the lookup api to insert / update / delete data in Elasticsearch) on how to set up the processor. Each of these processors are identical - in that, they listen to a specific event on kafka and process the incoming message. The bulk record processor (being created as part of this contest) will also follow in the same footsteps.
The bit where the bulk record processor differs from the other processors is how it processes the incoming message. We will share the details in a separate document in the contest forum.
Deployment guide and validation document
Provide a README.md file as your deployment guide. For verification, you can submit another Verification.md file with steps on how to verify.
Important Notes
-
Use standard as your lint tool
-
Use async await pattern
-
Additionally, you need to provide a docker based deployment (Minor Requirement)
-
Tests are not in scope
Final Submission Guidelines
Zip your submission and upload to Topcoder