Challenge Overview
Welcome to the NASA Open MCT Notebook project! In this challenge we are looking to close out testing of the notebook features by executing test cases created in a previous challenge.
The first place prize indicated is reflective of the total prize pool. Please read the rule for more information on how prizes are awarded.
Challenge Details
This challenge will be run differently than other Bug Hunt type challenges. Please read the instructions below and follow them closely or you risk not qualifying for payment.
In this challenge each test case will be executed three times, by three different competitors. To manage this process, we are using Github issues to track who owns which deliverables.
To participate:
-
Register and open the challenge forum to download the test cases and test case execution report template.
-
Navigate to the Github repository located here: https://github.com/topcoderinc/mct-test-case-execution/issues/
-
Assign yourself to one unassigned ticket with a prize amount associated to it. A competitor may only assign one ticket at time. Change the label on this ticket to “Assigned”
-
Do not work on a ticket already claimed by another competitor.
-
Execute the test cases associated with your ticket. You have up to 24 hours to complete this task or the ticket will be unassigned from you and another competitor can claim it. Fill out the test case execution report as you with PASS/FAIL results.
-
If you identify any issues of medium or higher severity log them in the repository with the Issue label. It is important to note which test case and on which step the issue occurred.
-
Upon completion of your test cases and logging of issues attached the test case execution report to the issue you assigned yourself. Update the label to “Ready to Review”
-
At this point you may assign yourself another ticket and continue testing.
Continue following these steps until all test case execution issues have been resolved, at which point the challenge ends.
Additional Rules and Payment Details
-
A single participant cannot execute the same test cases multiple times. (EX: You cannot execute test cases 1-10 and then claim another ticket for 1-10 and execute again)
-
You will be awarded the listed prize amount for successfully executing the test cases for that test case. If you successfully complete multiple sets of test cases, you will be awarded a prize for each one completed.
-
If you execute a set of test cases and miss an issue that is found by another competitor executing those test cases you risk losing payment for that set. It pays to be thorough.
-
Only report issues which prevent you from reaching the expected outcome in a test case - there are no prizes for finding bugs outside the scopes of the test cases.
Final Submission Guidelines
Please submit to Topcoder Online Review a zip file containing the following:- A text file with your topcoder handle and your GHithub handle.
- Copies of all Test Execution Summaries which you participated in.