API docs
Release notes
Community
Analytics Dashboard
>
Filtering Dashboards and Widgets
>
Filtering Results by Element Status
CloudTest
Overview of CloudTest
Architecture
Massively Multi-threaded Maestro Test Engine
Distributed Web Services Architecture
Multiple Maestros for High Volume Testing<
Reuseable Test Clips
Ajax-based User Interface
CloudTest Supported Browsers and Resolution
Browser Support in CloudTest 57 series releases
Resolution Requirement for CloudTest Platform
GPU Hardware Requirement for Globe Dashboard(s)
Browser Support in Earlier Builds
Export and Import CloudTest Objects
Export and Import CloudTest Objects
Exporting/Importing Best Practices - Folder Structure, Naming, Clips & Results
Home Page
How To Turn Off Home Page
User Interface
Central
Resources Page Navigation
Toolbar
Editor Specific Toolbar Buttons
Tabs in the Workspace
Play Modes
Scopes
CloudTest Glossary
CloudTest Components
CloudTest Terminology
Message
Targets, Target Types, and Target Options
Create a New Target
Editing Target Info
Target Info - General - General Info
Target Info - General - Authentication
Target Info - General - Image
Adding an Image to the Repository
Target Info - General - Connection Options
Target Info - SSL Options
Target Info - General - Content Options
Setting International Characters in a Target
Target Info - General - DNS Options
Setting International Characters in a Target
Target Info - General - Advanced Settings
Split by HTTP protocol
Editing Target Info (WebUI/Ajax)
Editing SOAP WSDL Target Fields
Editing WebUI/Ajax Targets
Setting Scope on Targets in Test Clips
Editing Native/Mobile App Targets
Test Clip
Test Composition
Time Delay
Create a New Time Delay
Accounts
Switching Tenants and Using Tenant Folders (Tenant Admin Only)
Automatic CloudTest and CloudTest Lite Updates
Updating a CloudTest or CloudTest Lite Build
Check disk space on CloudTest servers
CloudTest and CTM AWS Rights
CloudTest Appliance Administration (ctadmin)
Login to the Admin Console
Setting Up a Static IP
Database Management
Backup the CloudTest Databases
Restore from a Backup
Bootup and Shutdown
Downloading Server Logs
Setting System Time
Concurrent Logins
To Enable Concurrent Logins
How do I retrieve a VMWare log?
Multi-Tenant Support
Configuring Tenants For Users
Non-Automated Upgrades While Using Cloud Instances
Non-Automated Upgrades While Using CloudTest Appliances
Non-Automated Upgrades While Using CloudTest Lite
Download and Install the SOASTA 54 version of CloudTest Lite
Upgrade to CloudTest Lite 54 on Mac OS X
Upgrade to CloudTest Lite 54 on Windows
Upgrade to CloudTest Lite 54 on Mac OS X (Command-Line Instructions)
Password Complexity
Set Password Rules in Tenant Editor
Timestamp in User Editor
Resetting a Password
Single Sign-On (SSO)
Single Sign-On Settings
API Token Creation
User Initiates Single Sign-On
Integrating With Okta
Site Administration
CloudTest Version Control FAQ
Q1: If I version a folder, does it version everything in it?
Q2: Does CloudTest version the permissions for the folder?
Q3: If I change the filters of a widget on a dashboard or the widgets on a dashboard that is open, will that get versioned?
Q4: How is seed data stored in Git?
Q5: Baseline is stored with composition, so would restore change baseline?
Q6: What happens if I import something into the path that is under version control?
Q7: What happens if I duplicate versioned objects?
Q8: What happens if I delete an objects under versioning?
Q9: When I clone a Git repository, what kind of URLs it supports?
Q10: Do I have any action item if I update the URL in my repository information?
Q11: How can I find out whether I am up to date between the local and remote repository?
Q12: Can I interact with the Git repository by using a command line?
Q13: If I have multiple Git repositories that are pointing to the same URL, does it mean that Git will have one branch for each repository?
Q14: What is the workflow for a scenario where two users want to update two different assets of the same repository?
Q15: How are multiple branches within Version Control supported?
Timezone Support
Configuring Timezones and Locales in Company Settings
Configuring Timezones and Locales in My Settings
Version Control
Icons
Version Control Options
Clone a Git Repository
Create a Local Repository
Add
Commit
Reset
Checkout Revision
Pull
Push
Resolve Conflict
Update Repository Information
Workflow for Creating a New Repository
Multiple Branch Support within Version Control
FAQ
Cloud Provider Account Support for Amazon EC2
Setup a Cloud Provider Account for Amazon EC2
Access Control Configuration
Cloud Provider Account Support for EC2 China
Setup a Cloud Provider Account for EC2 China
Cloud Provider Account Support for GoGrid
Setup GoGrid as a Cloud Provider
Access Control Configuration
Cloud Provider Account Support for Microsoft Azure
Prerequisites
To add a new application in Microsoft Azure using OAuth authentication
To add a Microsoft Azure application as a Cloud Provider Account using OAuth authentication
Using Azure Service Principal Authentication
Create Azure Service Principal
Switching over the CPA
Creating A New Azure RM CPA with Service Principal Authentication
Removing Azure Service Principal
Cloud Provider Account Support for Qingcloud
Setup QingCloud as a Cloud Provider
QingCloud Server Instance Types
Launching Test Servers using QingCloud
Creating a Grid using QingCloud
Cloud Provider Account Support for Rackspace (OpenStack)
Setup Rackspace or Rackspace (OpenStack) as a Cloud Provider
Access Control Configuration
Cloud Service Provider Status
Configuring an Amazon EC2 Account to Use CloudTest
CloudTest Health Settings
Load Generation
Results Service
Errors
How do I increase VMWare system memory for CloudTest Lite?
Primary Load Generator / Server
Results Databases
Create a New Results Database
Deploying a Results Database
Server Classes
Service Settings
Server Instances - Summary
Server Instances
Launch New Server
Terminate, Reboot, and Replace Server Instances
Orphaned Servers
Using Locations
Creating a New Location
CloudTest Services
Manage an Existing Location
CloudTest Objects
composition
currentBand
currentTrack
currentClip
currentChain
currentMessage
currentBrowserAction
currentCheckpoint
currentScript
currentTarget
currentDelay
Result Object
Edit a Linked Script in Clip Editor, List view
Script
Revising a Script in the Clip Editor
Script Basics
Script Prerequisites
Regular Expression Support in CloudTest
Setting Properties
Query a Property
Set a Custom Property
Set a Global Property from a Clip Property
Construct Custom Values
Data Generation Scripts
Data Seeding Scripts
Dynamic HTTP Redirection (HTTP 302) Using a Script
Error Detection and Handling Scripts
Extract a SessionID
Miscellaneous Scripts
Replace a String
Send Hello, World! to a Result
Stop a Composition from a Script
Target/Hostname Modification Scripts
Traverse the Object Hierarchy
Using Dynamic Data
Track Counter
Array File
Seed Data (from a flat file)
Web Service Call to a Database
Global Properties
Asynchronous updates
Validation Scripts
Band, Track, Chain, Checkpoint, and Script Objects
Browser Action Object
Clip Object
Composition Object
Context ($context)
Custom Properties ($prop)
Delay Object
Delay Properties
Delay Methods
getChild Method
getItemViaPath Method
clearRepeat Method
setRepeat Method
Global Properties ($globalprop)
Group Object
If Object
In Situ Substitution Expressions
References to System and Custom Properties
Property-type field
Item-type field
Property-path field
References to Global Custom Properties
Property-type field
Property-path field
Counters
Message-Level Counters
Encoding in ISSE substitution
Execution of an Expression In A Script
Expression-indicator field
Expression-text field
Some examples
Message Object
Page Object
PropertyList Object
Result Object
Result Properties
Result Methods
postMessage Method
Switch Object
Switch Object
Switch Properties
Switch Methods
getChild Method
getItemViaPath Method
clearRepeat Method
setRepeat Method
end Method
endRepeat Method
System Properties ($sysprop)
System Property Methods
System Properties
System Utilities ($util)
SystemPropertyList Object
Target Object
Transaction Object
Changing CloudTest Conductor
Chrome Extension for HTTP Recordings
Chrome Extension Version
Prerequisites
HTTP Recording Wizard
Creating a Packet-Level Recording
Creating an HTTPS Recording
How to install the Certificate Authority manually - Windows
Symptoms
Diagnosis
Solution
Installing CloudTest Conductor
Downloading CloudTest Conductor
Installing CloudTest Conductor on Mac OS X and Linux
Installing Conductor on Windows
Run the Conductor Application
Installing CloudTest Conductor from the Command Line
Recording with Client-Side Certificates
Set Up a Client-Side Certificate from the Clip Editor
Set Up a Client-Side Certificate from the Recording Editor
Using the Recording Editor
Icon Colors for Content-Type
Icon Colors for Packet Type
Recording Editor List View Enhancements
Recording Editor Detail Views
Detail View For Requests
Detail View For Responses
Packet Details
Action Message Format (AMF) Testing
Create the HTTP(S) Recording
Convert the AMF-based Recording to a Test Clip
Editing and Playing an AMF-based Message in the Clip Editor
Adobe HTTP Dynamic Streaming (HDS) Recording
Create the HDS-based Target
Record and Convert an HDS session to a Clip
Editing an HDS-based Message in the Clip Editor
Conductor Troubleshooting (Windows)
HTTP(S) Recording using AMF Externalizable Types
oAUth Testing
OAuth Options in the Target Editor
OAuth System Properties
Record HTTP Traffic from a WebUI Test
Further Steps
Retrieving the Conductor Log for Support
CloudTest Conductor Capabilities
CloudTest Conductor Capabilities
Enable/Disable WebUI/Ajax
Enable/Disable Monitoring
Enable/Disable External Data Connectivity
Automatically Configure Proxies setting
Using Firefox Profiles
To specify a Firefox profile during Conductor installation:
CloudTest Conductor Connectivity Options
Configuring a SOCKS or HTTP Proxy
Discovering the HTTP Proxy Listener Port
CloudTest Conductor Troubleshooting
Unknown Host Exception
Getting the Conductor Log for Support
Anti-virus programs interfering with Conductor installation
Windows Conductor gets "The VM cound not be started" Error
Using a Conductor as a Proxy
Conductor proxy configuration on an iPhone
Conductor proxy configuration (using bogus proxy settings)
Why doesn't my CloudTest Conductor show interfaces?
Windows
Linux
Mac OS X
Windows Communication Foundation (WCF) Testing
Creating a New Clip
Using the Record Button
Manually Create a New HTTP(S) Test Clip
Prerequisites – Recording(s), Target(s), Script(s)
Automatic HTTP(S) Test Clip Creation
Manual Test Clip Creation
Using the Clip Editor
Add Menu
Clip Editor Icon View
Clip Editor List View
Column Headings
Repeats in List View
Adding a Clip Element Control
Control Parameters
Dragging/Clicking from Clip Builder
Duplicating Existing
Changing Message Timing (for Manually Timed Test Clips)
Further Steps
Changing Order of Test Clip Elements
Changing Target and Action of a Mobile or WebUI Action
Changing Target and Operation of a Message
Further Steps
Checkpoint
Create a New Checkpoint
Copy and Paste between Test Clips
Copying a Page to Another Test Clip
Copying a Message to Another Test Clip
Disable/Enable Clip Elements
Edit Random Delays in Clip Editor
Lower Panel + Icon Mode
Inilne Editor
Embedded Scripts in the Clip Editor
How to Add an Embedded Script in the Clip Editor
Playing Messages
Further Steps
Property sets using Substring and XPath
Renaming Checkpoints
Saving Test Clips
Setting and Using Message Scope
To set a clip element's scope
Using a message with local scope
Clear the Response of a Message
Setting Delays (Clip, Track, Composition)
Changing a Single Delay Offset in a Test Clip
Setting Individual Delays in a Clip
Setting Delays for a Clip
Setting Delays for a Track
Setting Delays for a Composition
Setting Property Paths
About Paths in CloudTest
Setting Scope on Targets and Clips
Using Content Badges
Using Line Breaks
Inserting a Line Break
Removing Line Breaks
Cache Dynamic Resources (Clip, Track, or Composition)
Cache Dynamic Resources (Clip Level)
Enable or Disable Dynamic Caching at the Clip Level
Cache Dynamic Resources (Track or Composition)
Enable or Disable Dynamic Caching at the Track Level
Enable or Disable Dynamic Caching at the Composition Level
Chaining Clip Elements
Changing Individual Page Resources
Changing Individual Page Resource Settings
Include/Exclude Resources by Expression
Creating Groups
Group Restrictions by Clip Type
Creating If-Then-Else
About If-Then-Else
Creating an If-Then-Else Statement in Icon View
Creating an If-Then-Else Statement in List View
If-Then-Else in Result Details
If-Then-Else in Basic Widgets
If-Then-Else in Charts
Creating Pages Manually
Page Restrictions
Overriding Page Resource Retrieval
Creating Switch
Creating Transactions
Graphical If-Then-Else Comparisons
Comparison Data Types
Comparison Predicates
If using a Constant
If using a Property
If using a Linked Script
If using an Embedded script
If using an Accessor
Page Resource Filtering (Clip, Track, or Composition)
Page Resource Loading (Clip, Track, or Composition)
Page Resource Settings Tab (in Clip Editor Properties)
Page Resource Loading at the Clip Level
Changing Page Resource Loading at the Clip Level
Page Resource Settings Tab (for Track and Composition Properties)
Page Resource Loading at the Composition Level
Page Resource Loading at the Track Level
Removing Clip Elements from Containers
Remove Clip Elements from Page
Removing Clip Elements from Chains, Groups, Transactions, If-Then-Else, and Switch Containers
Viewing Collections
Collections and Collection Types
Collections in the Clip Editor
Chains
Groups
Pages
Dynamic vs. Static Resources in Pages
Viewing Expanded Collections
Collection Scrolling
Applying Session Templates and Packages
Apply a Session Template Package from Session Templates List
Adding a Session Template to a New Package
Removing Session Template from a Package
Applying a Session Template from the Session Templates List
Highlight Applied Session Templates
Session Template Packages
Include Options
Exclude Options
Parsing a SubString
Creating a Regular Expression Using the SubString Parser
Editing an XPath
Creating a New Script
Use an Existing Script
Session Templates
Creating a New Session Template from a Selection
Viewing Session Templates and Packages
Clip-Level Custom Properties
Message-Level Property Paths and Property Sets
Testing the Property Set
Testing the Recorded Response for a Property Set
Testing the Played Response for a Property Set
Seed Data in Clip Properties
Seed Data in Container, Message, or Action Properties
Seed Data in Track Properties
Create a Custom Track Property using Seed Data: Repository Object
Create a Custom Track Property using Seed Data: URL
Seed Data Wizard
Setting Advanced Seed Data Options
Tying Seed Data to a Virtual User(s)
Server Allocation (Allocation Section)
Defining Separate Slice Distribution
Defining Single Slice Distribution
Data Section
Column and Row Count
Row Traversal Types
EOF Action
Row Representation
How do I create validation that compares the response of one Message or Browser Action to another?
Introduction
General methodology
Step 1
Step 2
Step 3
Key Scripting topics
Navigating the Test Composition object hierarchy.
Accessing Messages and Browser Actions
Custom, System, and Global Properties
Accessing external data
Parameterization
Posting messages to the Result
Aborting or stopping the Test Composition
How do I validate the response time of a Message?
How do I validate the total response time of several Messages?
How do I write my own custom validation that uses data outside of CloudTest?
How do I write my own custom validation?
How do I parse a JSON response for validation or to extract a value?
How do I parse an HTML response for validation or to extract a value?
How do I automatically stop a composition at a specified length of time?
How do I cause the Messages, Browser Actions, or Scripts in a Test Clip to use different values when the Test Clip is used in different Test Compositions, or in different places in the same Test Composition?
How do I generate unique values in Messages or Browser Actions?
How do I override the value of the HTTP “Host” header in requests?
How do I pass a value from one Test Composition to another?
A Method for simulating Load from different Desktop Browser Types
Additional HTTP Headers for Dynamic Resources
Akamai Pragma Header
Before and After Property Sets in the Clip Editor
Pass & Return Values from a Container
Property Sets Before
Property Sets After
Value Type Icons in the Property Set Tab(s)
Using the Other Property Sets list
Setting a System Property in a Container
Changing Clip Element Names recursively using JavaScript
Changing Names of Embedded Test Clips
Defining Message Property Sets
Property Set via Start and End Markers
Property Set Retrieved using Xpath
Property Set Retrieved using Global Expression
Property Set Retrieved using Regular Expression
How does CloudTest map virtual users to SSL connections? Does each virtual user get an SSL connection and keeps it open for a collection?
List View Mode
Manual Redirection using a Property Set
Pass & Return Values from a Container
Property Sets Before
Property Sets After
Value Type Icons in the Property Set Tab(s)
Using the Other Property Sets list
Setting a System Property in a Container
Multi-Part HTTP Messages
Working with Automatically Created Multi-Part Messages
Creating a New Multi-Part POST Message
Multi-Part Messages in Result Details
Permissions on Objects and Folders
Permissions on Objects and Folders
Setting the Timing of a Test Clip
Specifying Repeats on Clip Elements
Using ISSEs in Validations
Validation Success Message
Validation Failure Message
Validation Exact Match value
Validation Glob Match Value
Validation Regular Expression Match Value
Using Mass Target Change
Prerequisites
Adding Test Clips to Test Compositions
Adjusting Clip Timing
Moving a Clip to a New Track
Changing Test Clip Start Offset
Changing Test Clip Duration
Change Band Timing Type
Changing Monitoring
Database Monitoring Widgets
Creating New Compositions
Editing Test Compositions
Setting Scopes in Test Compositions
Extracting Property Value from a Container after Play
Network Emulation
Prerequisite for Azure Users
Creating a Network Emulation Profile
Network Emulation Upstream/Downstream Parameters
Built-in Network Emulation Profiles
Setting Network Emulation Profiles in the Composition Editor
Test Results
Network Emulation for JMeter
Configuring a Network Emulation Profile in a JMeter Composition
Prerequisites - Clip(s)
Property Sets in the Composition Editor
Setting a Container Property Value before Play
Status Log Access from Status Indicator
Advanced Repeat Options (Pacing and Inter-Repeat Delays)
Repeat Methods
Advanced Repeat Options
Paced
Inter-repeat Delays
Inter-repeat Delay with Serial Repeats
Inter-Repeat Delay with Parallel Repeat Renewal
Dynamic Ramp Adjustment (Virtual User Ramp Controller)
Virtual User Ramp Controller
Remixing the Ramp Plan
Renew Parallel Repeats
Renew Virtual Users on a Track
Renew Parallel Repeats in Sequenced Clips in a Timed Band
Renew Parallel Repeats in Containers in a Manually Timed Clip
Setting Repeats On Tracks and Test Clips
Defining Virtual Users on Tracks
Allocate Virtual Users to Track Using Percentages
Setting Track Repeats on the Track’s Surface (Timed Band)
Setting Track Repeats from the Repeat tab
Defining Repeats on Test Clips
Serial vs. Parallel Repeats on Test Clips (in Timed Compositions)
Setting Infinite Repeats on the Clip’s Surface (Sequenced Band):
Setting Infinite Repeats from the Repeat tab
Repeats: For each, While, and By Property can be set from the Repeat tab in the lower panel.
For Each
While
To define repeat properties on a track or test clip using Repeat By, For Each, or While)
Setting Repeats Using for Each
Use "Property: For Each" with an Array of Values from a Response
Use Property: For Each with an Array of Values from a Script
Setting Repeats using Repeat By Property
Setting Repeats using a Global Property List
Setting Repeats from a Message Response
Setting Repeats using While
Repeat using While - Repeat until stopped
Repeat using While - Increasing Responses
Setting Sequential Repeat on Chains and Clips
Repeat a Chain Sequentially for a Set Amount of Time
Repeat a Clip Sequentially for a Set Amount of Time
Creating a New Grid
Creating a New Grid
Grid Advanced Settings
EC2 Spot Instance Support
Reminders About EC2 Spot Instances
Configuring EC2 Spot Instances
How to Allow for All Maestros to Be Spot Instances
What if my bid is rejected?
What if my bid is accepted but my instances are torn down?
Managing Grids
Viewing a Grid in the Summary and Deploy/Tear Down Page
Changing Grid Settings
Changing Grid Settings
Results Database Selection for a Composition
CloudTest Server to Cloud Instance Type Map
CloudTest Server-to-Cloud Instance Type Map
CloudTest and Amazon EC2 Instances
CloudTest and Dimension Data Instances (Professional Services Only)
CloudTest and GoGrid Instances
CloudTest and GoGrid Instances
CloudTest and Google Compute Engine Instances
CloudTest and HP Cloud Instances
CloudTest and Rackspace Legacy Cloud Instances
CloudTest and Rackspace (Nova) Cloud Instances
CloudTest and Windows Azure Instances
CloudTest and Windows Azure (IaaS) Instances
Specifying Results Database Selection for a Monitor
Support for AWS Security Groups
Volumes and Snapshots
Create a New Volume
Import a Volume or Snapshot
Create a Snapshot from an Existing Volume
Create a Volume from an Existing Snapshot
Export a Volume
Resize a Volume
Move a Volume between Zones (EC2 Only)
Rollback to Volume or Snapshot
Pause and Resume Ramp
Play Modes and Results Logging
Player Status
Running a Test (Player Controls, Playlists, and Compositions)
Player Control
Status Log Indicator
Play Modes and Warnings
Play or Pause a Test Compostion in Composition Editor
Pause a Test Composition via Player Status – Compositions
Create a New Playlist
Stopping a Composition
Bypass Proxy List for Maestro
Control Virtual Users Per Server - Maestro Settings
Setting Up Maximum Virtual Users
Creating an External Data Source
Custom Modules
Prerequisites
Uploading a Custom Module
Calling a Custom Module from a CloudTest Script
Associate the Custom Module with the Script
Custom Properties
Setting Composition Custom Properties
Setting Track Custom Properties
Setting Clip Custom Properties
Setting Collection Custom Properties
Setting Message or Action Custom Properties
Further Steps
Defining Ramps for a Track or Timed Clip
Defining a Ramp for a Track or Timed Clip
Ramp Settings
Dynatrace Integration for CloudTest
Integrating Dynatrace Data
1. Setup Metric in Dynatrace
Disable Filters
2. Setup External Data Source in CloudTest
3. Setup Dynatrace Widget in CloudTest
Extended Error Logging
Generated Custom Property Values
Generated Value: Date tab
Generated Value: Number Tab
Random Button
Unique Per Virtual User Button
Range Button
Generated Value: String Tab
Integrating Amazon CloudWatch as an External Data Source
Integrating AppDynamics as an External Data Source
Integrating CA Wily Introscope as an External Data Source
Supported Versions
Prerequisites
Additional Prerequisites for 8.2.x
Next Steps
Integrating New Relic as an External Data Source
Specifying Maestro Locations and Play Options
Maestro Server Classes and Their Definitions
Specifying Locations in an HTTP(S) Test
Using Play Options
Play with options from the Composition list
Specify a Proxy for Maestro to Use
Staging a Complex Composition for Play
Load, Unload, or Stop Loading a Composition
Test Clip/Target-level System/Custom Properties
Setting System Properties for the Composition and Its Elements
Setting Composition, Band, or Track Custom Properties:
Using DNS Lookups
DNS Lookup Considerations
Setting DNS Lookups in the Target Editor
Setting DNS Lookups in the Clip Editor
Volumes and Snapshots
Create a New Volume
Import a Volume or Snapshot
Create a Snapshot from an Existing Volume
Create a Volume from an Existing Snapshot
Export a Volume
Resize a Volume
Move a Volume between Zones (EC2 Only)
Rollback to Volume or Snapshot
Debugging a Test
Introduction to Debugging
CloudTest Jenkins Plugin
Installing the SOASTA CloudTest Jenkins Plugin
Configuring the SOASTA CloudTest Jenkins Plugin
Deploying Environments using the CloudTest Jenkins Plugin
Playing a Composition
Starting and Tearing Down a Test Environment
Starting and Tearing Down a Grid
Starting a Grid
Tearing Down a Grid
Starting and Tearing Down a Results Database (RSDB)
Starting a RSDB
Tearing Down a RSDB
How do I incorporate CloudTest into an automated build?
Section 1: Apache Ant
Reporting Results using Apache Ant
Section 2: Using the Jenkins/Hudson Plugin
Downloading the Plugin
Installing the Plugin
Configuring the Jenkins Job(s)
Displaying CloudTest Dashboards in Jenkins Build Reports
Section 3: Other automated build tools
SCommand Reference
Introduction
Installing the CloudTest Command Line Client (scommand)
Common Uses for the Command-Line Client
SCommand Syntax
SCommand Reference
Available Commands
Common parameters (used by all commands):
Delete Command
Delete Options
Drain Command
Drain Options
Export Command
Export Options
Import Command
Import Options
List Command
List Options
Play Command
Play Options
Transaction Threshold Metrics
Start Command
Start Options
Status Command
Status Options
Stop Command
Status Options
Setting the number of Virtual Users using SCommand
Setting Transaction Thresholds in Jenkins
Using Transaction Thresholds in Jenkins
Transaction Threshold Metrics
Using SCommand to Deploy and Manage Grids
Common Options
Grids
Results Database
Test Environment
How do I cause a Test Composition to stop or abort based upon my own custom logic or criterion?
How do I conditionally change whether an item in my Test Composition or Test Clip plays?
How do I create validation whose behavior or comparison values can be changed before the Test Composition is played?
How do I dynamically or programmatically substitute a value into a Message or Browser Action before it is sent or played?
How do I parameterize a Test Composition (or its components) so that I can change the behavior each time I play it without having to edit it each time?
How do I programmatically change how many times an item in my Test Composition or Test Clip plays?
Analytics Dashboard
Adding an External Data Chart to a Dashboard
Replacing a Widget in a Dashboard by Selection
Adding a Monitor Container to a Dashboard
Adding a Dashboard Container to a Dashboard
Analysis Widget Sorting
Analytics
Further Steps
Analytics Segmented by Ramp
System Generated Annotations
Viewing Annotation Comparisons
Changing Widgets and Dashboards
Add or Remove Dashboards
Move or Remove Widgets
Edit Widget or Dashboard Options
Viewing or Changing a Dashboard’s Settings
Viewing or Changing a Widget’s Settings
General Widget Options
Additional Chart Widget Options
Viewing or Changing Contained Widget Settings
Chart Axis: Primary/Secondary
Changing Chart Types
Maximize, Restore, and Pop-Out a Widget
Correlate a Monitor with a Monitor
Creating a New Dashboard
Steps
Adding Widgets
Specifying Results to Use in a Dashboard
Specifying Dashboard-Level Results
Creating a New Widget Library
Dashboard Localization
To change your Dashboard language
Dashboard/Widget Selection Panel
Widget Selection Panel Sections
Dashboard Data
Widget Data
Monitors
Aggregation Level
Widget Type
Description
DPM Annotation
Viewing System Generated Annotations
Filtering Collection Widgets
Setting the Collections Rate Filter
Setting the Collection Type and/or Collection Name Filter
Filtering Dashboards and Widgets
Getting Started using Dashboard Filters
Filtering Results by Clip
Filtering Results by Collection
Filtering Results by Collection Name
Filtering Results by Container
Filtering Results by Date/Time
Filtering Results by Distribution
Filtering Results by Domain
Filtering Results by Duration Timespan
Filtering Results by Element Status
Filtering Results by Element Type
Filtering Results by Location
Filtering Results by Operation
Filtering Results by Parent Container
Filtering Results by Property Name
Filtering Results by Property Value
Filtering Results by Series
Filtering Results by Target
Filtering Results by Time
Filtering Results by Time Format
Filtering Results by Time Zone (deprecated)
Filtering Results by Track
Interacting with Charts
Multi-Result Comparison Dashboard
To create a multi-result comparison dashboard
Multiple Default Dashboards
To customize default dashboards at user-level
To customize default dashboards at tenant-level
Percentile and Standard Deviation in Collection Charts
Results Created (Coming soon)
Collection Completion Time Percentile
Collection Completion Time Standard Deviation
Top N Collections by Percentile
Top N Collections by Standard Deviation
Standard Deviation and Percentile Columns in the Collection Analysis Widget
Standard Deviation/Percentile Columns in Exported Collection Aggregate Data
Results Created with CloudTest 57 or Below
Performance Intelligence Dashboards
Combined Charts Dashboard
Send Rate vs. Virtual Users
Virtual Users vs. Error Count
Virtual Users vs. Bytes Sent and Received
Error Count vs. Send Rate
Correlated Charts Dashboard
Send Rate over Virtual Users
Bytes Sent and Received over Virtual Users
Error Count over Virtual Users
Monitoring Combined Charts Dashboard
Monitoring Correlated Charts Dashboard
Event and Status Logs Dashboard
Waterfall Dashboard
Print a Dashboard
Rename Axis Titles for Time Series Charts
Result Details Dashboard
Double Click To Open
Dynamic, Animated Display
Cover Flow
Navigation Tree
Result Detail Sections
General Section
Composition, Band, Track, and Clip Level
Target Level
Message / Action Level
Waits and Validations Section
Custom Properties Section
Inputs Section
Output Section
Target Demographics Section
Events List
Scalable Metrics
Sorting Widget Data
Changing Sort Order in Selected Analysis Widgets
Showing Failed Clips and Collections in Charts
Sorting in Aggregate Widgets
Additional Settings for Top N Widgets
Specifying Results in Dashboards
Specifying Dashboard-Level Results
Specifying Widget-Level Results
Specify a Result for an External Data Chart or Dashboard
Split and Combine by Dimension
Split by Location
Combine by Location
Split by Domain
Combine by Domain
Split by Clip
Combine by Clip
Threshold Settings
Charting.SecondToMinuteAggregationThreshold
Charting.MinuteToHourAggregationThreshold
Understanding Metrics in CloudTest Analytics
Viewing Results
Further Steps
Viewing Widgets Side By Side
Test Results
Creating Report Templates and Reports
Importing a DOCX or HTML Template
Creating a Report from Template
Creating a Report Using Composition Overview
Dashboard Slideshows
Binding a Result to a Dashboard
Creating a Slideshow from One or More Dashboards
Export Multiple Results to CSV or XML Spreadsheet Format
Basic Information (for Actions)
Basic Information (for Messages)
Exporting Results
Export Charts to Excel
Export One or More Results from the Results List
Export Result Tables
Clip Element Details
Event Details
Time Aggregate
Clip Element Aggregate
Clip Details
Collection Details
Clip Aggregate
Collection Aggregate
Track Aggregate
Error Aggregate
URL Aggregate
Page Completions
Page Average Durations
Transaction Completions
Transaction Average Durations
Fundamentals Summary
Basic Info
Clip Element Properties
Composition Element Properties
Introduction to Test Results
Locating Retrieved CSS Resources in Results
Managing Results
Report Template Reference
report Tag Structure
Widget Image Capture
Specifying Widget Settings
Optional Tag structure
Example Single Widget Image Capture Syntax
Single Charts
Example Combined and Correlated Widget Capture
Combined Charts
Correlated Charts
Fundamentals Data Capture
Example Fundamentals Data Capture
General Text Capture
Possible Text Identifiers
User Input Capture
Flow Control
Using no-duplication tags
Adding External Data Source Widgets to a Report Template
Declaring an External Data Source Widget
Result Objects
Results Management - Autodelete
Company Settings
Composition Editor
Results
Service-Level Agreement (SLA)
Creating an SLA
Viewing SLA Results
Create a Report Using Composition Overview
Creating Your Own Dashboard
Service-Level Agreement (SLA) Monitoring
What you need before dashboard setup
Setting Up an SLA Monitoring Dashboard
The Share Feature
How to use the “share” feature
Keep sensitive information private
Test Results FAQ
How do I add my own custom debugging output to a Test Composition?
How do I add my own custom log entries to the Result?
How do I limit response size in a large Test Composition?
What does the Taskpool Capacity Exceeded warning mean?
Property Analytics
Auto Create a Custom Property for Akamai Headers
Auto Create a Custom Property from an HTTP Response
Automatic Creation of a Custom Property
Set a Runtime Custom Property in a Property Set
Property Analytic Widgets
Property Value URL Analysis
Property Value Clip Element Analysis
Property Value Composition Element Analysis
Properties by Value
Property Value Count
Top N Messages by Property Value
Property Analytics
Tracking Custom Property Values in Analytics
Save a Custom Property for Analytics (Messages/Actions)
Save a Custom Property for Analytics (Containers)
Save a Custom Property for Analytics (Clip Custom Properties)
Save a Custom Property for Analytics (Track)
Save a Custom Property for Analytics (Target)
Monitoring
Checking Monitor Service Status
Prerequisites
Checking the status
Correlate a Monitor with a Monitor
Creating Monitoring Server Groups
Custom Commands for Monitoring
Creating a Custom Command Monitor
Default Monitoring of CloudTest Environment
Monitor Data Automatic Purge of Aged Data
Aggregate Tables for Monitors and New Aggregate Monitor Charts
Introduction to Monitoring
What Is Monitoring?
Why monitor with CloudTest?
Does an agent need to be installed on the server to be monitored?
How do I choose whether to use an agent for monitoring or not?
How do I install the agent?
Are different metrics available using an agent for monitoring?
What performance impact does monitoring have on the servers?
What ports need to be open in the firewall to monitor the target servers?
Can the monitored information be encrypted when sent to the CloudTest servers?
What data is sent back to the CloudTest servers? What is the format?
What operating systems and servers can be monitored? What metrics are available?
Can custom monitors be added?
What commands are run on Linux to collect the monitored metrics?
What Linux distributions can be monitored using the agent-less approach via SSH?
What Linux user privileges are required to monitor via SSH?
What happens to the agent once the testing is over?
How does SNMP monitoring work? Is an agent required?
How is a database monitored?
Can I monitor a Java application that is not J2EE-based?
Can I use an RSA keypair instead of a user name and password to monitor via SSH?
Monitoring a Server Behind a Firewall
Monitoring Adobe ColdFusion
Prerequisites
Supported versions
Steps
Next steps
Monitoring AIX
Prerequisites
Steps
Next steps
Monitoring Apache Tomcat
Prerequisites
Supported versions
Steps
Next steps
Monitoring Caucho Resin
Prerequisites
Supported versions
Steps
Next steps
Monitoring JBoss
Prerequisites
Supported versions
Steps
Next steps
Monitoring Linux
Prerequisites
About Memory Utilization on Linux
Steps
Next steps
Monitoring Mac OS X
Prerequisites
Steps
Next steps
Monitoring Microsoft Windows
Prerequisites
Steps
Next steps
Monitoring Mobile Devices
Setting Mobile Monitoring Preferences
Switching a Mobile Monitor between Mobile Apps
Aggregation Duration
Detail Data Retention Period
Monitoring MySQL
Prerequisites
Example;
Supported Versions
Steps
Next steps
Additional Instructions for Monitoring a MySQL Server behind a Firewall
Monitoring Network Devices
Prerequisites
Supported Versions
Steps
Next steps
Monitoring PostgreSQL
Prerequisites
Supported Versions
Steps
Next steps
Monitoring Server Groups
Monitoring Solaris
Prerequisites
Supported Versions
Steps
Next steps
Monitoring the CPU Usage of a Server
Monitoring Using DCOM/WMI
Prerequisites for DCOM/WMI Monitoring
Configuring WMI/DCOM in Windows Server 2008
Configuring a WMI Monitoring Server in CloudTest
Monitors
Starting and Stopping a Monitor
Using the Windows Powershell Script for Remote WMI Access
Database Commits and Rollbacks (Example Use Case)
Use Case: Database Commits/Rollbacks
Steps for Commit and Rollback using If-Then-Else
Database Monitoring
Setting Up Monitoring Server Groups and Monitors for Databases
Database Query Results in Result Details
Database Query Results in Result Details
Examples Query Results using Output Options
Database-Backed Seed Data
Defining a Database Property Set
User-Defined Database Property Sets using Substring
Direct to Database Testing
Database Support
Database Target Type
Creating a Database Target
Creating a Clip for Database Actions
Including Database Target(s) in the Clip Editor Lower Panel
Defining a Database Action
Database Column Data Type Support
Using the SQL Editor
Database Items in Result Details
Firewall Settings of Database Networks
Override Database Settings
Database Action XML and JSON Format Outputs
Summary of XML and JSON Output Formats
Support for Stored Database Procedures
Stored Procedures in the Result Details Dashboard
Troubleshooting Database Connections
User-Defined Database Validations
User-Defined Database Validations using Body
User-Defined Database Validations using Embedded Script
User-Defined Validations for Linked Script
Adding Flex Automation Capability
Adding Flex Recording Capability
Adding Flex Validations
Flex Recording Using External Interface
The Flex code
Adding a Validation to a Browser Action
App Actions
Browser Action
Browser Action Types
Defining Generic Browser Actions
Browser Actions
Creating a New Browser Action Recording
Prerequisites
Additional browser recording prerequisites for HTTPS sites:
Creating Your Recording
Using Browser Recording
Editing a Browser Action
Enabling Cross-Domain Browser Tests
Ensure Conductor Multi-Window Support Is Enabled
Enable Cross-Domain Using a System Property Override
Enable Cross-Domain Using the Target Editor
Installing the Browser Recorder Firefox Extension
Installing the Browser Recorder Extension from the Clip Editor
Installing the Browser Recorder Extension from the Resources Page
Nested Compositions and the Test Suite Dashboard
Create a Report Using Composition Overview
Outputs for Browser or App Actions
Command and Parameters
Adding an Output to an Action
Editing Expanded Outputs
Property Sets in a Browser or App Action
Adding a Property Set to an Action
Editing a Property Set
Running a Browser Action Test on Multiple Browsers
User-Defined Validations for Messages
User-Defined Validations on Response Body
User-Defined Validations on Response Header
User-Defined Validations for Following Script
User-Defined Validations for Existing Script
Using the Locator Tool
Prerequisites
Using the Locator Tool
Accessibility Locators
Validations for Browser or App Actions
Adding a Validation to an Action
Editing a Validation
Waits for Browser or App Actions
Built-in waits
Adding Pre-Waits in List View
Editing Expanded Pre-Waits
Adding a Post-Wait
Editing a Post-Wait
WebUI test playback window is constricted
Notice
Filtering Results by Element Status
For element status, select either
All
or Errors Only.
Search Results
Close