No search results found

Test Plan Executions

Test Plan Overview

A test plan is a set of test suites. When a test plan is executed, the test suites and their corresponding test cases are executed, either serially or parallelly, as configured.

This article guides the user to prepare and execute test plans in Testsigma platform. For demonstrative purposes we will discuss the execution of a test plan that has one test suite and one test case associated with the test suite.

Prerequisites

You should know how to create a test case..
You should know how to create a test suite.

Steps to Create and Execute Test Plan

Create a test case with all the necessary steps.
Create a test suite and add the test case created in step 1 to this test suite.
Create a test plan and add the test suite we just created to this test plan.
Click on the Run Now to start the test plan execution.

NOTE:

Whitelisting of Testsigma IP addresses is necessary to ensure that the Testsigma servers and lab environments can securely interact with your applications and systems for testing activities. For more information, refer to whitelisting Testsigma IP addresses

Partial Test Runs

There are instances when you need to execute your test plan only partially instead of executing the complete one. With Testsigma, you can do that. You can filter the tests based on some attributes or select the test suites you'd like to include or exclude for test execution and then only execute the selected test cases.

Lets see how we can do that:

Go to the test plan that you want to execute partially and open the dropdown and click on Partial Run.
On Partial Test Plan Run overlay, configure the options according to how you want to select the test cases for your partial test run:

Below are the options you see:

Include or Exclude test suites : You can include or exclude the test suites from the partial test run by selecting the radio button Include or Exclude.
Test Suites to Include: Specify the test suites that should be included from the dropdown.
Test Case Filters: You can identify the test cases to be included in the test suites using the below filters:
- Labels: Filter the test cases according to the labels assigned to them.
- Type: Filter the test cases according to the type of test cases there are.
- Requirement: Filter the test cases according to the requirements assigned to them.
- Requirement Type: Filter the test cases according to the requirement types assigned to them.
- Priority: Filter the test cases according to priority.
- Created by: Filter the test cases according to their creators.
- Assignee: Filter the test cases according to their assignees.
- Reviewer: Filter the test cases according to their reviewers.

Once you have applied the filters, you can:

View filtered test cases by clicking on the View Filtered Test Cases button.
Save the configuration as a favourite for later use by clicking on the Save As Favorite button.
Start the execution of the filtered test cases by clicking on the Run Now button.

NOTE:

The Runtime variables during the initial run of the test will be stored and available for future runs. In case of a test failure and the need to re-run the test, the runtime variables from the initial run will automatically apply.
If you enter a variable name without storing the value, you will see the following error in the run report. Make sure to always store the value into a variable before using it.

Error Message:

No data available for runtime test data variable %s. Refer previous Test Steps in this Test Case or Test Steps in other Test Cases to know the variable names saved by using store(naturalText) action Test Steps. Go to https://testsigma.com/docs/test-data/types/runtime/ to know more about runtime test data.