Ad-hoc Run

Testsigma's Ad-hoc Run feature allows you to run your test cases without impacting the real test outcomes. You can use this functionality to verify if your test cases are set up accurately and performing as intended before proceeding with full-scale testing.

This documentation will guide you through setting up Test Labs and Test Machines, selecting the App Source, adjusting Additional Settings, and configuring Desired Capabilities.

Prerequisites:

Before using the Ad-hoc Run, you must understand specific concepts such as creating Projects and Test Cases, understanding Test Labs, setting up Local Devices with Testsigma Agent, Environments, Headless Tests, and Desired Capabilities for all applications. You should also be familiar with Uploads, Camera Image Injection and Network Logs for Android and iOS applications.

Ad-hoc Run in Test Case

1. Create a Test Case with a list of the test steps and then click Run in the top right of the Test Case Details page to initiate an Ad-hoc Run overlay.
2. Configure the ad-hoc run in the Ad-hoc Run overlay based on the application type in the below section.
3. Click Save Configuration in the screen's bottom right corner to save the Ad-hoc Run setups configuration. Then, enter a Name for the configuration in the pop-up window that appears and click Save.
4. Click on Saved Configs at the top of the screen to reuse the saved configuration, and a drop-down list will appear. Select the Saved Config from this list.
5. The Ad-hoc Run overlay will be automatically pre-filled with the saved configuration for your next runs when selected.
6. In the Test Case Details page, click Ad-Hoc Runs in the right Navigation Bar to open the right sidebar. This will enable you to view the history and details of Ad-Hoc Run results for the Test Case.

Web Application

In the Ad-hoc run layover, provide the following configuration settings for a web application:

1. Test Lab: Select the test lab to run the test case. You can run the tests on Testsigma Cloud Lab, your Local Devices or other vendor platforms, including SauceLabs, BrowserStack, Lamba Test, etc.

2. Test Machine: Select the appropriate test machines and provide the following configuration details:

   1. OS & Version
   2. Browser & Version
   3. Resolution
3. Headless Test: Click the toggle button for Headless Test to enable headless testing for a test case.

4. Additional Settings: Provide the following details under additional settings:

   1. Environment: Select the test environment.
   2. Screenshot Capture: Select when the screenshots need to be taken, for All Steps or Failed Steps alone.
   3. Page Timeout: Duration for which the test should wait for the page to load.
   4. Element Timeout: Duration for which the test should wait for the element to load.
5. Desired Capabilities: Provide Key, Data Type and Value under Desired Capabilities.
6. Click on Run Now.

Mobile Web Application

In the Ad-hoc run layover, provide the following configuration settings for a mobile web application:

1. Test Lab: Select the test lab to run the test case. You can run the tests on Testsigma Cloud Lab, your Local Devices or other vendor platforms, including SauceLabs, BrowserStack, Lamba Test, etc.

2. Test Machine: Select the appropriate test machines and provide the following configuration details:

   1. OS & Version
   2. Device
   3. Browser

3. Additional Settings: Provide the following details under additional settings:

   1. Environment: Select the test environment.
   2. Screenshot Capture: Select when the screenshots need to be taken, for All Steps or Failed Steps alone.
   3. Page Timeout: Duration for which the test should wait for the page to load.
   4. Element Timeout: Duration for which the test should wait for the element to load.
4. Camera Image Injection: Click the toggle button for Camera Image Injection to enable camera image injection for a test case.
5. Network Logs: Click the toggle button for Network Logs to enable network logs for a test case.
6. Desired Capabilities: Provide Key, Data Type and Value under Desired Capabilities.
7. Click on Run Now.

Android Application

In the Ad-hoc run layover, provide the following configuration settings for an Android application:

1. Test Lab: Select the test lab to run the test case. You can run the tests on Testsigma Cloud Lab, your Local Devices or other vendor platforms, including SauceLabs, BrowserStack, Lamba Test, etc.

2. Test Machine: Select the appropriate test machines and provide the following configuration details:

   1. OS & Version
   2. Browser & Version

3. App Source: Select either one of the following options for an app source:

   1. External Path: Provide the publicly accessible URL of the application.
   2. Uploaded Apps: Select the application from uploaded apps in Testsigma.

4. Additional Settings: Provide the following details under additional settings:

   1. Environment: Select the test environment.
   2. Screenshot Capture: Select when the screenshots need to be taken, for All Steps or Failed Steps alone.
   3. Page Timeout: Duration for which the test should wait for the page to load.
   4. Element Timeout: Duration for which the test should wait for the element to load.
5. Camera Image Injection: Click the toggle button for Camera Image Injection to enable camera image injection for a test case.
6. Network Logs: Click the toggle button for Network Logs to enable network logs for a test case.
7. Desired Capabilities: Provide Key, Data Type and Value under Desired Capabilities.
8. Click on Run Now.

iOS Application

In the Ad-hoc run layover, provide the following configuration settings for an iOS application:

1. Test Lab: Select the test lab to run the test case. You can run the tests on Testsigma Cloud Lab, your Local Devices or other vendor platforms, including SauceLabs, BrowserStack, Lamba Test, etc.

2. Test Machine: Select the appropriate test machines and provide the following configuration details:

   1. OS & Version
   2. Browser & Version

3. App Source: Select either one of the following options for an app source:

   1. External Path: Provide the publicly accessible URL of the application.
   2. Uploaded Apps: Select the application from uploaded apps in Testsigma.

4. Additional Settings: Provide the following details under additional settings:

   1. Environment: Select the test environment.
   2. Screenshot Capture: Select when the screenshots need to be taken, for All Steps or Failed Steps alone.
   3. Page Timeout: Duration for which the test should wait for the page to load.
   4. Element Timeout: Duration for which the test should wait for the element to load.
5. Camera Image Injection: Click the toggle button for Camera Image Injection to enable camera image injection for a test case.
6. Network Logs: Click the toggle button for Network Logs to enable network logs for a test case.
7. Desired Capabilities: Provide Key, Data Type and Value under Desired Capabilities.
8. Click on Run Now.

Desktop Windows

In the Ad-hoc run layover, provide the following configuration settings for a Desktop application:

1. Test Lab: Select the test lab as Local Devices to run the test case.
2. Test Machine: Select the registered active agent as Test Machine to run the test case.
3. Desktop App Location: Provide the Local URL for the application path.
4. Environment: Select the test environment.
5. Desired Capabilities: Provide Key, Data Type and Value under Desired Capabilities.
6. Click on Run Now.

Rest API Application

In the Ad-hoc run layover, provide the following configuration settings for a Rest API:

1. Test Lab: Select the test lab, either Testsigma Cloud Lab or Local Devices, to run the test case.
2. Environment: Select the test environment.
3. Desired Capabilities: Provide Key, Data Type and Value under Desired Capabilities.
4. Click on Run Now.