Challenge Overview
NOTE: The url for testing will be shared at 11AM CET 15th Jan.
Please post your github id in the forum so i'll add you in the repositories.
What to Test (Scope)
Tech stack: Typescript, Nodejs 12, Angular 10
Application type: Angular UI and Nest API
URL: Will share in the forum
Repo: https://github.com/tc-wellmark/dev-portal-ui/issues
Accepted types of bugs:
- Bugs in frontend
- Bugs in backend
Heroku url will be provided in the forum, if you only want to hunt bugs in UI, you can use it directly. Please notice, we are using a mock api in the backend. All ADD UPDATE operation won't reflect changes.
If you would like to check backend as well, you need to run UI, presentation api and mock api locally. The repos can be found in the forum. Issues can be created in ui repo.
Browser Requirements
- Desktop: Microsoft Edge and Chrome Browsers (Mac & Windows).
Issue Reporting Guidelines
For each report of a bug, we need the following information:
- Steps to reproduce, including any needed information (Must list all the steps that need to reproduce the bug, DON'T list only the bug without test data)
- Current results before the bug is fixed
- Expected results, after the bug, is fixed
- Attach screenshots, videos (You can attach videos directly on Github, if not use services like www.screencast.com or https://monosnap.com. Don’t use www.youtube.com to host the videos and don't upload zip file) & Crash - Console/Crash Logs and sample payloads (request body / query) that will be helpful to understand the bug.
IMPORTANT NOTE:
- Please DO take a look at the reported bugs, duplicated bugs cost your work time and the reviewer's time.
- Missing or Incorrect details to ANY of the above fields will mark the bug report as INCOMPLETE. For example, Incorrect Steps, Missing Screenshot/Screencast, Incorrect Actual and Expected results etc.
Issue Weights and Scoring
- Scoring will be based on the number of bugs by weight and the weight to your bugs. The copilot has the right to decide a severity at his discretion.
- Only verified issues will be counted. Duplicate issues will be closed and not counted. Log issues according to the guidelines above issues that do not follow these guidelines may reject due to lack of information.
- For challenge scoring, the user with the most points from verified issues will be selected as the winner. If two users submit the same issue, the user that submitted the issue first will receive credit.
- Please focus on functionality testing based on the requirements, all bug reports based on your own assumptions will be rejected.
- Logic bugs (in presentation api) will be considered at least major issue.
In addition to the first and second place prize, we will be awarding the following prize money to all competitors.
- Blocker/ Critical: $10 [10 Points]
- Major: $8 [8 Points]
- Minor: $5 [5 Points]
- Enhancement: $2 [2 Points]
P1 - Blocker: This bug causes the app to fail. No workaround exists. E.g. app crashes, app freezes.
P2 - Critical: This bug causes the app to fail for some specific cases. No workaround exists.
P3 - Major: This bug causes the app to fail, but there’s a workaround to prevent that issue.
P4 - Minor: This is an annoyance, but won’t prevent the app from running normally.
P5 - Enhancement: Something noticed by testers that should be fixed, but isn’t considered a bug.
Important Notice
- Follow the standard topcoder Bug Hunt Rules.
- If you do not properly document your bug reports, they will likely be rejected due to lack of information or documentation.
- DON'T RE-OPEN the issues in the review phase and anyone who RE-OPENS a ticket will be disqualified from the challenge.
- You must not edit the bug report once created, so make sure you enter all the details at the time you create the issue, otherwise, your issue will be moved to the end of the queue. If you really need to edit an issue you must use the comments section for this (i.e. add a comment to describe any changes you want to make to the issue), and we'll decide whether the changes are major enough to move the issue to the end of the queue. You are allowed to add screenshots in the comments section though, assuming your issue report contains all the details when created.
- You must specify the test data you have used in the 'Reproduction Steps', All the issues will be marked as 'Incomplete', if the correct test data is not provided.
- Keep an eye on the issues being submitted by other participants to minimize the time you may be spending on duplicate efforts. Knowing what has already been reported will allow you to better focus your time on finding yet undiscovered issues.
- There will be no appeals phase. The decision of Copilot for validity and severity of each filled issue will be final.
Final Submission Guidelines
Submit all your bugs directly to GitHub. When you are done with your submissions please submit a .txt file using the “Submit” button before the submission phase ends. In this file include:
-
Your Topcoder handle (The one displayed in the top right corner near the Profile picture)
-
Your GitHub handle used to raise the issues.
-
A link to your issue list. For example https://github.com/tc-wellmark/dev-portal-ui/issues/created_by/my_id
-
ALL THE SUBMISSIONS WITHOUT ABOVE INFORMATION WILL BE REJECTED AND WON’T BE PAID.
-
IMPORTANT: Submit the above details before the Submission Phase ends.
-
DON'T use any other link to create new issues OR submit as document, they won't count and won't be paid.