ALT Release 6.3

Release date: [February] 26th, 2018

Predefined Report Templates

Open

• Creating performance test reports is an important part of performance testing and we are now providing predefined reports to save time.

• Creating a Report using the new predefined template

• The predefined template allows you to quickly create a report for a specific project, instance, and test run. Example:

  Open

  

   

  The report will contain the most common metrics.

  The generated report will have the following sections (examples from the above Template, Project, Test Instance, and Test Result)

  • Test Summary:

    Open

    

     

  • Executive Summary

  • Non-Functionality Requirements

  • Test Scenario Description

  • Page Response Time Summary :

    Open

    

     

  • HTTP/S Error status codes

    Open

    

     

  • Running Virtual Users

    Open

    

     

  • Page Response Time vs Concurrent Users

    Open

    

     

  • Transaction Response Time vs Concurrent Users

  • Successful URL Requests per second (HTTP/S hits/sec)

    Open

    

     

  • Completed Script Iterations per minute

    Open

    

     

  • Script Iteration Time

    Open

    

     

  • Network Throughput

    Open

    

     

  • Outstanding Request

    Open

    

  • Page Response Time vs Concurrent Users and the Page Response time Percentile

    Open

    
    Open

    

     

  • Transaction Response Time vs Concurrent Users and the Transaction Response time

  • Percentile

  • Page Breakdown Details (Table)

    Open

    

     

  • Error Summary (Table)

    Open

    

     

  • Errors Over Time

    Open

    

     

  • Error Details (Table)

    Open

    

     

  Platform Monitoring

  • CPU Utilization

    Open

    

     

  • Server Memory Usage

    Open

    

     

  • Server Network Usage

  • Appendix

   

• Customizing the report

  • The generated report can be modified by removing sections and adding comments. The changed template can then be saved as a custom template and be used for other test results.

• Managing Predefined Reports

  • The predefined template can be named or deleted.

  • Predefined reports can be exported to PDF and shared as a link directly to the report on Apica Load Test Portal.

BUGS Fixed Improvements in this Release

Settings Used

With the Settings Used view, you can see which parts of integrations that are used in a particular test.

For AppDynamics, the display includes the name of the AppDynamics controller, the application name, and the number of metrics used in the test.

For DynaTrace, the Server and Dashboard used for metrics used in the test are shown.

Open

AppDynamics Improvements

Metric Update: With the AppDynamics integration, you get access to a wide range of metrics. The set of available metrics can change and grow and new metrics become available while the test is running.

The metric update feature allows you to refresh the view of available metrics while the test is running in live view.

This means the newly available metrics can be included in the test on the fly.

Open

Fixes

• TLS 1.2 is now supported for generating scripts from URLs

• Throughput metrics in Live View could show wrong value depending on agent data updates

• Network Connect average Time calculation could in some cases show the wrong value