ALT Release 6.3

Release date: [February] 26th, 2018

Predefined Report Templates

Open

• Creating performance test reports is an important part of performance testing and we are now providing predefined reports to save time.

• Creating a Report using the new predefined template

• The predefined template allows you to quickly create a report for a specific project, instance, and test run. Example:

  Open

  

   

  The report will contain the most common metrics.

  The generated report will have the following sections (examples from the above Template, Project, Test Instance, and Test Result)

  • Test Summary:

     

  • Executive Summary

  • Non-Functionality Requirements

  • Test Scenario Description

  • Page Response Time Summary :

     

  • HTTP/S Error status codes

     

  • Running Virtual Users

     

  • Page Response Time vs Concurrent Users

     

  • Transaction Response Time vs Concurrent Users

  • Successful URL Requests per second (HTTP/S hits/sec)

     

  • Completed Script Iterations per minute

     

  • Script Iteration Time

     

  • Network Throughput

     

  • Outstanding Request

  • Page Response Time vs Concurrent Users and the Page Response time Percentile

     

  • Transaction Response Time vs Concurrent Users and the Transaction Response time

  • Percentile

  • Page Breakdown Details (Table)

     

  • Error Summary (Table)

     

  • Errors Over Time

     

  • Error Details (Table)

     

  Platform Monitoring

  • CPU Utilization

     

  • Server Memory Usage

     

  • Server Network Usage

  • Appendix

   

• Customizing the report

  • The generated report can be modified by removing sections and adding comments. The changed template can then be saved as a custom template and be used for other test results.

• Managing Predefined Reports

  • The predefined template can be named or deleted.

  • Predefined reports can be exported to PDF and shared as a link directly to the report on Apica Load Test Portal.

BUGS Fixed Improvements in this Release

Settings Used

With the Settings Used view, you can see which parts of integrations that are used in a particular test.

For AppDynamics, the display includes the name of the AppDynamics controller, the application name, and the number of metrics used in the test.

For DynaTrace, the Server and Dashboard used for metrics used in the test are shown.

AppDynamics Improvements

Metric Update: With the AppDynamics integration, you get access to a wide range of metrics. The set of available metrics can change and grow and new metrics become available while the test is running.

The metric update feature allows you to refresh the view of available metrics while the test is running in live view.

This means the newly available metrics can be included in the test on the fly.

Fixes

• TLS 1.2 is now supported for generating scripts from URLs

• Throughput metrics in Live View could show wrong value depending on agent data updates

• Network Connect average Time calculation could in some cases show the wrong value