Challenge Overview
Challenge Objective
-
Compare a set of available testing automation tools for API testing.
Project Background
We are in the process of building a framework that will be used to automatically generate E2E tests for a given API from its Swagger specification.
Detailed Requirements
We are exploring the available solutions that can be utilized to automate the process of generating and executing E2E test cases for APIs based on their Swagger specification.
The key points for the solutions we’re looking at are:
-
Ability to bulk import API test data via CSV file(s).
-
Ability to export results into CSV file(s).
-
Support for multiple APIs (it should be easily pluggable/usable in multiple APIs)
-
Ease of use. Remember, the primary reason for building this framework is to make it easier to generate test cases, not to spend more time doing that.
-
The framework should be as flexible as possible.
-
The framework should be able to re-generate existing tests with minimal effort.
-
Ideally, we need this to be part of our deployment process (eg within CircleCI).
We have created a PoC for Tricentis TOSCA that you can find attached to the challenge forum (discussions).
As part of this challenge, you need to:
-
Create a PoC for all of the following alternative solutions:
-
Create a document explaining the pros and cons of each solution (including Tricentis TOSCA) and suggesting the best solution.
You may also suggest your own alternative solution if you feel it’s better than the suggested ones.
For this challenge, we’re targeting the following API as an example API to test:
Repo: https://github.com/topcoder-platform/resources-api
Branch: develop
Live Swagger: http://api.topcoder-dev.com/v5/resources/docs/
Should you have any doubts, please feel free to ask any questions on the challenge forum.
Final Submission Guidelines
Submit a zip file that includes:
-
The PoCs that you have created
-
The provided PoC
-
The comparison document you have created
-
Any other documents or files you may think can be helpful