Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Introduction

This Guide describes how the OnDemand Agents work for Apica LoadTest (ALT) , and tips not to not overload them.

Info

The typical subscription for an ALT customer is “OnDemand”“OnDemand.

Locations

Location Map

OnDemand Agent Locations

When you set up a load test, you choose from a set of locations , from where you want to run your load test:

Each location has a number of several available OnDemand Agents.

...

OnDemand Agents

On the following link, you can find up-to-date information about locations and agents:

...

Each of these conditions calls for More/Higher CPUs:

  • The number of calls per “page”“page.”

    • Higher calls

  • If calls are made in “parallel” or “serial”“serial.”

    • Parallel Calls

  • The think time (pause) between each “page”“page.”

    • Shorter Think Times

  • The response times of the called resources

    • Shorter Response Time

Note

When an Agent is overloaded (e.g., CPU > 90%), it will limit the throughput, and the returned performance data will be wrong (too low).

...

1. Compare Response Times

(blue star) Loop Time > Page Times = Agent Overload

The typical symptom of an overloaded Agent is that the total duration of a test iteration (“loop time”) is clearly longer than the sum of the “page times”times.

This is because not all execution time is included in the page times. For instance, SSL handshakes, HTTP handshakes, and garbage collection.

  • When the Agent's CPU of the Agent is overused, these additional processes may take significant time for the agent to process so that they will be added to the Loop time but NOT the Page Time.

Example:

On the test “Overview” tab

...

, check the

Average Response time Per Loop

Compare the Loop Response time to the

Page Summary Total

Image Added

Note: Session Time included Think Times

Compare to this:

...

...

Image Added

There was no difference; the Loop included each of the 5-page response times, so the Agent worked fine!

Note

If we saw Loop Response Time > Page Times, the Agent is overloaded.

Looking

...

at the detailed result file

Once a job is finished, you can download the detailed result file and analyze it. In the “Jobs” view, click the download icon for the job you’re interested in.

...

Image Added

This will get you an xxx.prxres file.

Put

...

that file in the ZebraTester/MyTests folder.

Open the file in the ZebraTester UI/Project Navigator:

...

Image Added

Then click the magnifying glass next to the Load Test name:

...

Image Added

Then select the Diagram: Load Generator Performance:

...

Image Added

Finally, look at the CPU Usage graph:

...

Image Added

In this example, the usage is very low, so we’re fine! (thumbs up)

2. Leverage SSL Cache Efficiencies

More SSL Cache Hits Help Agent CPU

Check SSL Cache Efficiency and Percent time Spent on SSL.

You can check for this in the result file (see the previous section)

...

by selecting Diagram: SSL Cache Efficiency.

...

The example below

...

shows that a new SSL handshake was performed for

...

every request. This can be CPU intensive, so keep the SSL Cache-hits as high as possible; Offloading this to the cache keeps the Agent CPU lower.

...

Image Added

Also, look at the Results per Page | URL (Details) view. Compare the numbers in the Av SSL/TLS column with the Av Time column. In the example below, about 10% of the time is spent on SSL.

...

Image Added

Tip

Tips to Avoid Overloading Agents

  1. Use longer think time between pages.

  2. Use more locations.

    1. This will spread the load over several Agents.

  3. Re-use the SSL connections as much as possible.