Running Multiple Tests via the Scenarios Feature

Introduction

Performance Test Scenarios are commonly used when setting up all the parameters for running a scenario of several tests, including integrations with monitoring and APM.
Apica now supports up to 30 tests in each scenario and will extend our capacity up to 120 tests.

Process

Screenshot

Process

Screenshot

Setting up a new Performance Test Scenario Start by navigating to LoadTest → Create & Run Scenarios from the top menu.

Scenario Settings
Enter the name of the new Scenario, the Project Name related to the Scenario, and the Instance Name where the test result will be saved.
Optional add tags and a Comment to the new Scenario.

Continue by selecting the Subscription that will be used if you have more than one.

Scripts
Click Next to get to the Scripts section and click Add Scripts to add scripts/tests to the Scenario.
Scripts can be selected from already uploaded Scripts or you can upload new Scripts.

Set the run-time parameters for each Script like VU, Duration, Ramp-up, and optional Offset Time.
The User Count Projection will show a graph of the concurrent projection.
Tests can run simultaneous or in a sequence with a three-minute delay in between.

Click on the first Script to Set the Parameters for each Script.

Script Parameters
In this view, users can set a limit on the number of Script Loops, Request Timeout, and Additional Options.
Select an existing ZT Agent Cluster or create a new by selecting locations and save the selected locations to a Scenario.

Continue with the optional settings agent type and for limiting the bandwidth.
Add a Client-Side Monitor URL or Selenium Scenario to monitor the Client-side response times.
Finally, there is an option to use a custom DNS host file, custom DNS host, and a DNS Translation File.
DNS Lookup when executing the Scripts can be set to resolve the DNS names on every iteration of the Script.
Repeat the settings for all Scripts in the Scenario by clicking on each Script in the side-bar.

Click Next to get to the Test Options

 

Test Options
Test Options has settings used by the Scenario common for all Scripts.
Enter an email address/s for a status email for each Scenario Run.
Default Custom Percentiles are set to 90%, 95%, and 99% and can be changed as needed.
Next select Apica Performance Monitor Agents (if used)

Select an Integration with AppDynamics or DynaTrace, note that the configuration for APM products needs to be set up from the Setup Menu.
Finally, Select how you want to run the Scenario, the options are Immediately, every day, Specific day of the week, or a specific date.

Before initiating the Performance Test Scenario Click Save Scenario to save all setups.
Next time you want to use the same Scenario all settings is ready to be used again.

 

Cannot find what you're looking for? Send an E-mail to support@apica.io.