BONUS: 5‌ CHECKPOINTS AWARDED WORTH ‌$50‌ EACH

Register
Submit a solution
The challenge is finished.

Challenge Summary

Please note that the client will be choosing the winners, so the review phase will be longer than usual.

 

Challenge Objective

Welcome to the Browser Based UI Automation Ideation Challenge! The goal of this challenge is to determine the best tooling and technologies to build automated tests that run in Internet Explorer 11 as the primary target browser, and other popular browsers.

  • Generate ideas on the best set of tools to run automated tests, given requirements below.

  • Focus on IE11 support, but will need to be cross-browser capable.

  • Focus on functional testing, with other levels of testing considered.

 

Round 1

You should submit a solution to describe your idea with higher-level details to qualify for the checkpoint prizes. 

Round 2

Please submit your full solution. 

Technical Requirements

The following are requirements for the automation strategy:

  1. IE11 is the most important browser.

  2. Chrome, and Safari are additional target browsers. 

  3. Tests would ideally be written once and work for all supported browsers with minimal browser-specific code.

  4. Must support functional testing at a minimum. 

  5. Preference will be given to solutions that make recommendations for unit testing, E2E testing, performance testing, and load testing.

  6. Browser to device connection

    1. REST API and WebSocket

    2. CGI scripts

  7. Stability is critical (Reduce flaky tests.)

  8. Soft assertions

  9. Parallel execution preferred.

  10. Screenshot/video capture preferred.

  11. Support for Test Design Patterns (Page Objects Pattern, Screenplay Pattern, etc.).

 

Framework Requirements

We are looking for tools that satisfy the following requirements:

  1. Low amount of Framework maintenance

  2. Preference is given to industry-standard tools and tools that have robust community support

  3. Licensing - we are open to recommendations. For licenses with a cost, we’d prefer a per-seat model as opposed to a named model.

 

Important Notes

  • Our User Interface is hosted by a small embedded device. While the UI can be run from anywhere, the data served to it will always come from one of these small local devices (typically on our local network which is firewalled-off from the outside world). An online sample of our UI can be provided.

  • The app is web-based (Chrome, IE11, Safari) and built upon React, Material-io, and Redux via Google Material.

  • We are not opposed to Cloud-based tooling if it is the absolute best, but something onsite might better support our needs.  

Format

Submit a document that has these major sections. There are no minimum or maximum length requirements, but please be comprehensive in your analysis. 

  • Summary: Briefly describe the overall approach to solving the problem. For instance, did you find a single tool, or will we need to use multiple? 

  • Tool analysis: describe the tools you are recommending and why. Please note which automation requirements and tool requirements they satisfy and the ones they dot. 

  • Architecture: If we need to integrate multiple tools, how do you recommend we do this? 

  • Overall Analysis: How will this support cross-browser testing needs, and the concerns provided in the “Important Notes” Section?

 

Winner Selection

  • There will be no appeal phase, and the winner selection is purely up to the client. 

 

What to Submit

We are looking for a written description which will layout the proposed solution that meets the requirements of the project (no code will be developed). 

  • Markdown and PDF submissions are preferred, but we will accept .TXT and Word/Google docs as well.

  • You are also encouraged to accompany your ideas with code snippets, links or anything else that may help us understand your idea(s).

  • It should be written in English

Please read the challenge specification carefully and watch the forums for any questions or feedback concerning this challenge. It is important that you monitor any updates provided by the client or Studio Admins in the forums. Please post any questions you might have for the client in the forums.

Stock Photography

Stock photography is not allowed in this challenge. All submitted elements must be designed solely by you. See this page for more details.

How To Submit

  • New to Studio? ‌Learn how to compete here
  • Upload your submission in three parts (Learn more here). Your design should be finalized and should contain only a single design concept (do not include multiple designs in a single submission).
  • If your submission wins, your source files must be correct and “Final Fixes” (if applicable) must be completed before payment can be released.
  • You may submit as many times as you'd like during the submission phase, but only the number of files listed above in the Submission Limit that you rank the highest will be considered. You can change the order of your submissions at any time during the submission phase. If you make revisions to your design, please delete submissions you are replacing.

Winner Selection

Submissions are viewable to the client as they are entered into the challenge. Winners are selected by the client and are chosen solely at the client's discretion.

Challenge links

Screening Scorecard

Submission format

Your Design Files:

  1. Look for instructions in this challenge regarding what files to provide.
  2. Place your submission files into a "Submission.zip" file.
  3. Place all of your source files into a "Source.zip" file.
  4. Declare your fonts, stock photos, and icons in a "Declaration.txt" file.
  5. Create a JPG preview file.
  6. Place the 4 files you just created into a single zip file. This will be what you upload.

Trouble formatting your submission or want to learn more? ‌Read the FAQ.

Fonts, Stock Photos, and Icons:

All fonts, stock photos, and icons within your design must be declared when you submit. DO NOT include any 3rd party files in your submission or source files. Read about the policy.

Screening:

All submissions are screened for eligibility before the challenge holder picks winners. Don't let your hard work go to waste. Learn more about how to  pass screening.

Challenge links

Questions? ‌Ask in the Challenge Discussion Forums.

Source files

  • Document

You must include all source files with your submission.

Submission limit

5 submissions

ID: 30111946