Topcoder QA Framework - Fix Inconsistent Number of Tests

Key Information

Register
Submit
The challenge is finished.

Challenge Overview

Challenge Objectives

  • Fix inconsistent number of test cases being run.

Project Background

In this series of challenges, we’re creating an E2E testing framework that will help us test different applications within the Topcoder platform.

Currently, we target the Connect app.

Technology Stack

  • Node.js

  • Selenium

  • Webdriver.io

  • AWS S3

  • CircleCI

Code access

Repo: https://github.com/appirio-tech/qa-framework-js

You will find a self-registration link on the challenge forum in case you don’t have access to the repository.

Individual requirements

We’ve noticed a weird issue where in many cases the number of test cases being run is inconsistent.

Sometimes the number of test cases is in the 75-90 range and some other times it’s 1000+.

You need to identify the root of this issues and fix it so all test cases are being run.

Validation video / screencast

You need to provide a video showing that after you changes the framework will run all test cases. The video should be uploaded on YouTube as “unlisted” (not public) or a similar service and the link to the video should be included in your submission. Do not upload the video file in your submission.

Important Notes

Note that the tests will run on CircleCI and not locally.



Final Submission Guidelines

  • Submit a git patch for the latest commit in the develop branch (currently d4080e9de99e03818d350d0546cc85d96cf4a7c1). Make sure to mention the exact commit you used so the reviewers can apply your patch.

  • Link to your validation video.

ELIGIBLE EVENTS:

2018 Topcoder(R) Open

REVIEW STYLE:

Final Review:

Community Review Board

Approval:

User Sign-Off

SHARE:

ID: 30068475