Module Assembly Scorecard Improvement

Unit Testing
Register
Submit a solution
The challenge is finished.

Challenge Overview

1. Project Overview

We plan to do some work on organizing and updating our technology standards and conventions.

It includes following updates:

  • Guideline Update
  • Scorecard Update
  • Standards Update

We have already completed following for Module Assembly

Tutorial: 

Assembly Community Suggestions: https://apps.topcoder.com/bugs/browse/CIBH (reviewed and approved by competition manager)

2. Competition Task Overview

We want to improve the Module Assembly Scorecard in this contest.

Existing Scorecard:

The statistic about the module assembly scorecard question utilization is attached to the contest, you can download it from contest detail page.

For example, Q2.1.1 - Rating 4 - 95% means 95% submissions get Rating 4 on Q2.1.1

For the rarely used questions, we should consider remove them (if it's totally useless), adjust the weight or merge with other questions. Note: unit tests result is also rarely used but it's not included in the analyze.

For the widely used questions (e.g. some reviewers only fill several question of the scorecard), we should consider to split the question to make the score be more accurate.

It's also recommended to calculate the usage by section and adjust the weight of sections.

You should also consider the community suggestions and latest module assembly tutorial in the new scorecard.

You can also refactor the section, questions, add/remove questions, merge duplicate questions, split big questions, etc.

You can also include some "percentage" question. e.g. how many requirements in the ARS are met in the submission. so reviewer could give 15/20, 18/20, etc. to calculate the score more accurate.

Competition Manager and Copilot are watching the contest forums so it's welcome to discuss your idea with us in contest forum.

2.1 Question Category

The module assembly scorecard questions should be splitted to two big categories. (We can still have sub section like the current scorecard).

General Assembly Questions and Module Assembly Questions

The general assembly questions will be used for all assembly types. e.g. Deployment Guide Question

The module assembly questions will only be used for module assembly contest. (We will design the review questions for other assembly types later).

2.2 Winner Selection

The winner will be selected by Competition Manager directly, so we won't use the Content Creation Scorecard.

Standard Content Creation Scorecard will be used in screening phase.

Judging Criteria:

  • If the scorecard include properly questions for General Assembly and Module Assembly.
  • If the scorecard address the accepted community ideas.
  • If the widely used and rarely used questions have been refactored properly.
  • If the introduction document introduce the changes and new ideas of the submission clearly.
  • Scorecard Presentation Quality (spelling mistake, grammer mistake, etc.)

3. Submission Deliverables

Please submit your scorecard design in excel format. Make sure you list the section weight and question weight for ALL sections / questions.

If the question description is not changed, you can just put the question number of existing question in the excel otherwise please write full question description and the requirements of each rating. Please also specific it's a Yes/No question, 1~4 question or 0~3 question.

You can also include a word document to introduce your general idea for the new scorecard.



Final Submission Guidelines

N/A

Review style

Final Review

Community Review Board

Approval

User Sign-Off

ID: 30034679