MPSQAS

Member Problem Submission and Quality Assurance System

Contents:

Introduction:

MPSQAS is a system to help facilitate the submission and testing of problems by TopCoder members. Through MPSQAS, members can propose problems, submit problem solutions, and test problems. Administrators can schedule problems for contests and assign problem testers to contests.
Top

Problem Submission Procedure:

To submit a problem, a problem writer must follow this procedure:

  1. Apply to be a problem writer (if not already).
  2. Submit a problem proposal. This contains some general information about the problem and a rough problem statement.
  3. An admin will review the problem proposal and will approve or disapprove the proposal. If not approved, make changes to the problem proposal and submit it again.
  4. When the problem proposal is approved, submit a full solution to the problem, test cases to the problem, and a clean problem statement.
  5. An admin will review the submission and will approve or disapprove the submission. If not approved, make changes to the submissions and resubmit.
  6. When approved, the problem will be assigned to a contest. Problem testers will be scheduled for the contest, and will submit solutions to the problem and make suggestions about the problem statements.
  7. When admins, problem writer, and problem testers agree the problem is ready, an admin will change the status to Ready, and the problem will be used in the contest.
  8. During the contest, log into MPSQAS and enter the contest room for the contest to discuss any issues that may arise about the problems with admins.

Top

Problem Testing Procedure:

To problem test a problem, a problem tester must follow this procedure:

  1. Apply to be a problem tester (if not already).
  2. An admin will assign the tester to a contest.
  3. Submit solutions to all three problems for the contest.
  4. Add test cases to the problem.
  5. Make suggestions about the problem statement.
  6. When admins, problem writer, and problem testers agree the problems are ready, an admin will change the status of the problems to Ready, and the problems will be used in the contest.
  7. During the contest, log into MPSQAS and enter the contest room for the contest to discuss any issues that may arise about the problems with admins.

Top

Using MPSQAS to Submit a Problem:

If you are not already registered as a problem writer, you must apply to be a writer. Do this by logging into the applet and going to Applications -> Problem Writer Application. An admin will review your application, and approve or disapprove it. An email will be sent to you containing the admin's reply. If your application is rejected, you can reapply at any time. If it is accepted, you can log into the MPSQAS applet and will be a problem writer.

To submit a problem proposal, go to Problems -> Propose Problem and fill out the form. Click Submit and make sure the proposal is submitted (any errors will be displayed in the lower right). Once the problem proposal is submitted, you can edit or view the problem at any time by going to Problems -> Main Problem Room and double clicking the problem. When in the Problem Room for the problem, you can edit the problem statement, and add correspondence about the problem (See MPSQAS Correspondence). After making changes, resubmit the problem by clicking the Submit button.

When your proposal is reviewed by an admin, you will receive an email saying whether or not the proposal was accepted. If not accepted, you can edit the proposal by going to the Problem Room for the problem, making changes, and resubmitting the problem.

If the proposal is approved, you can go to the Problem page for the problem and enter a solution and test cases. You can compile and test your solution and test cases through the applet. When you are completed with the solution and test cases, click Submit to submit the problem. Make sure there are no errors, and, if there are, correct the errors and Submit again.

When your submission is reviewed by an admin, you will receive an email saying whether or not the submission was accepted. If not accepted, you can edit the problem and resubmit it, until the admin approves it.

If the solution is accepted, you can continue to make changes to the problem to polish it for use. You will receive an email when your problem is scheduled for a contest, which will also list the testers assigned to the problems.

As the problem testers submit solutions, you can view and test the solutions by going to the Problem room for the problem and going to the All Solutions tab.

When you, the admin, and the problem testers are satisfied with the problem, the admin will change the status to Ready and the problem will be used.
Top

Using MPSQAS to Test a Problem:

If you are not already registered as a problem tester, you must apply to be a tester. Do this by logging into the applet and going to Applications -> Problem Tester Application. An admin will review your application, and approve or disapprove it. An email will be sent to you containing the admin's reply. If your application is rejected, you can reapply at any time. If it is accepted, you can log into the MPSQAS applet and will be a problem tester.

An admin will schedule you to problem test a contest. When you are scheduled, you will receive an email stating you are scheduled. You can then log into the applet and view contest information about the contest by going to Calendar -> Upcoming Contests. From here, you can chat about the contest with anyone logged in and associated with the contest and you can view the problems for the contest. Also, the problems for the contest will be listed in the Main Problem Room (Problems -> Main Problem Room). You can double click the problem to go to the problem room for the problem. From here, you can submit your solution to the problem, add test cases, and add correspondence (See MPSQAS correspondence). You can also view all the other solutions to the problem, and test them. This includes the writer's solution, and other problem testers' solutions. If you see anything wrong with the other solutions, add correspondence to the problem.

When you, the admin, the problem writer, and any other problem testers are satisfied with the problem, the admin will change that status to Ready and the problem will be used.
Top

MPSQAS Correspondence:

A list of correspondence is included with each problem. All users associated with the problem can view and add correspondence from the birth of the problem through the Correspondence tab in the Problem Room for the problem. Any comments or suggestions about the problem by the admins, testers, and writer should be made using correspondence so there will be a history available for all involved to see.
Top

During a Contest:

The problem writers, testers, and admins should log into the applet, and go the Contest Room for the contest. This way those involved with the production of the problems can discuss in a standardized way, private from competitors.
Top