Overview of CloudTest Architecture CloudTest Supported Browsers and Resolution Export and Import CloudTest Objects Exporting/Importing Best Practices - Folder Structure, Naming, Clips & Results Home Page User Interface CloudTest Glossary Message Targets, Target Types, and Target Options Test Clip Test Composition Time Delay Accounts Automatic CloudTest and CloudTest Lite Updates Check disk space on CloudTest servers CloudTest and CTM AWS Rights CloudTest Appliance Administration (ctadmin) Concurrent Logins How do I retrieve a VMWare log? Multi-Tenant Support Non-Automated Upgrades While Using Cloud Instances Non-Automated Upgrades While Using CloudTest Appliances Non-Automated Upgrades While Using CloudTest Lite Password Complexity Single Sign-On (SSO) Site Administration CloudTest Version Control FAQ Q1: If I version a folder, does it version everything in it? Q2: Does CloudTest version the permissions for the folder? Q3: If I change the filters of a widget on a dashboard or the widgets on a dashboard that is open, will that get versioned? Q4: How is seed data stored in Git? Q5: Baseline is stored with composition, so would restore change baseline? Q6: What happens if I import something into the path that is under version control? Q7: What happens if I duplicate versioned objects? Q8: What happens if I delete an objects under versioning? Q9: When I clone a Git repository, what kind of URLs it supports? Q10: Do I have any action item if I update the URL in my repository information? Q11: How can I find out whether I am up to date between the local and remote repository? Q12: Can I interact with the Git repository by using a command line? Q13: If I have multiple Git repositories that are pointing to the same URL, does it mean that Git will have one branch for each repository? Q14: What is the workflow for a scenario where two users want to update two different assets of the same repository? Q15: How are multiple branches within Version Control supported? Timezone Support Version Control Icons Version Control Options Update Repository Information Workflow for Creating a New Repository Multiple Branch Support within Version Control FAQ Cloud Provider Account Support for Amazon EC2 Cloud Provider Account Support for EC2 China Cloud Provider Account Support for GoGrid Cloud Provider Account Support for Microsoft Azure Cloud Provider Account Support for Qingcloud Cloud Provider Account Support for Rackspace (OpenStack) Cloud Service Provider Status Configuring an Amazon EC2 Account to Use CloudTest CloudTest Health Settings How do I increase VMWare system memory for CloudTest Lite? Primary Load Generator / Server Results Databases Server Classes Server Instances - Summary Server Instances Using Locations CloudTest Objects Edit a Linked Script in Clip Editor, List view Script Script Basics Script Prerequisites Setting Properties Construct Custom Values Data Generation Scripts Data Seeding Scripts Dynamic HTTP Redirection (HTTP 302) Using a Script Error Detection and Handling Scripts Extract a SessionID Miscellaneous Scripts Replace a String Send Hello, World! to a Result Stop a Composition from a Script Target/Hostname Modification Scripts Traverse the Object Hierarchy Using Dynamic Data Validation Scripts Band, Track, Chain, Checkpoint, and Script Objects Browser Action Object Clip Object Composition Object Context ($context) Custom Properties ($prop) Delay Object Global Properties ($globalprop) Group Object If Object In Situ Substitution Expressions Message Object Page Object PropertyList Object Result Object Switch Object System Properties ($sysprop) System Utilities ($util) SystemPropertyList Object Target Object Transaction Object Changing CloudTest Conductor Chrome Extension for HTTP Recordings Creating a Packet-Level Recording Creating an HTTPS Recording How to install the Certificate Authority manually - Windows Installing CloudTest Conductor Installing CloudTest Conductor from the Command Line Recording with Client-Side Certificates Using the Recording Editor Action Message Format (AMF) Testing Adobe HTTP Dynamic Streaming (HDS) Recording Conductor Troubleshooting (Windows) HTTP(S) Recording using AMF Externalizable Types oAUth Testing Record HTTP Traffic from a WebUI Test Retrieving the Conductor Log for Support CloudTest Conductor Capabilities CloudTest Conductor Connectivity Options CloudTest Conductor Troubleshooting Using a Conductor as a Proxy Why doesn't my CloudTest Conductor show interfaces? Windows Communication Foundation (WCF) Testing Creating a New Clip Prerequisites – Recording(s), Target(s), Script(s) Using the Clip Editor Adding a Clip Element Control Dragging/Clicking from Clip Builder Duplicating Existing Changing Message Timing (for Manually Timed Test Clips) Changing Order of Test Clip Elements Changing Target and Action of a Mobile or WebUI Action Changing Target and Operation of a Message Checkpoint Copy and Paste between Test Clips Disable/Enable Clip Elements Edit Random Delays in Clip Editor Embedded Scripts in the Clip Editor Playing Messages Property sets using Substring and XPath Renaming Checkpoints Saving Test Clips Setting and Using Message Scope Setting Delays (Clip, Track, Composition) Setting Property Paths Setting Scope on Targets and Clips Using Content Badges Using Line Breaks Cache Dynamic Resources (Clip, Track, or Composition) Chaining Clip Elements Changing Individual Page Resources Creating Groups Creating If-Then-Else Creating Pages Manually Creating Switch Creating Transactions Graphical If-Then-Else Comparisons Page Resource Filtering (Clip, Track, or Composition) Page Resource Loading (Clip, Track, or Composition) Removing Clip Elements from Containers Viewing Collections Applying Session Templates and Packages Session Template Packages Session Templates Viewing Session Templates and Packages Seed Data in Clip Properties Seed Data in Container, Message, or Action Properties Seed Data in Track Properties Seed Data Wizard Setting Advanced Seed Data Options How do I create validation that compares the response of one Message or Browser Action to another? How do I validate the response time of a Message? How do I validate the total response time of several Messages? How do I write my own custom validation that uses data outside of CloudTest? How do I write my own custom validation? How do I parse a JSON response for validation or to extract a value? How do I parse an HTML response for validation or to extract a value? How do I automatically stop a composition at a specified length of time? How do I cause the Messages, Browser Actions, or Scripts in a Test Clip to use different values when the Test Clip is used in different Test Compositions, or in different places in the same Test Composition? How do I generate unique values in Messages or Browser Actions? How do I override the value of the HTTP “Host” header in requests? How do I pass a value from one Test Composition to another? A Method for simulating Load from different Desktop Browser Types Additional HTTP Headers for Dynamic Resources Akamai Pragma Header Before and After Property Sets in the Clip Editor Changing Clip Element Names recursively using JavaScript Changing Names of Embedded Test Clips Defining Message Property Sets How does CloudTest map virtual users to SSL connections? Does each virtual user get an SSL connection and keeps it open for a collection? List View Mode Manual Redirection using a Property Set Multi-Part HTTP Messages Permissions on Objects and Folders Setting the Timing of a Test Clip Specifying Repeats on Clip Elements Using ISSEs in Validations Using Mass Target Change Adding Test Clips to Test Compositions Adjusting Clip Timing Change Band Timing Type Changing Monitoring Creating New Compositions Editing Test Compositions Extracting Property Value from a Container after Play Network Emulation Network Emulation for JMeter Prerequisites - Clip(s) Property Sets in the Composition Editor Setting a Container Property Value before Play Status Log Access from Status Indicator Advanced Repeat Options (Pacing and Inter-Repeat Delays) Dynamic Ramp Adjustment (Virtual User Ramp Controller) Renew Parallel Repeats Setting Repeats On Tracks and Test Clips Setting Repeats Using for Each Setting Repeats using Repeat By Property Setting Repeats using While Setting Sequential Repeat on Chains and Clips Creating a New Grid EC2 Spot Instance Support Managing Grids Results Database Selection for a Composition CloudTest Server to Cloud Instance Type Map Specifying Results Database Selection for a Monitor Support for AWS Security Groups Volumes and Snapshots Pause and Resume Ramp Play Modes and Results Logging Player Status Running a Test (Player Controls, Playlists, and Compositions) Stopping a Composition Bypass Proxy List for Maestro Control Virtual Users Per Server - Maestro Settings Creating an External Data Source Custom Modules Custom Properties Defining Ramps for a Track or Timed Clip Dynatrace Integration for CloudTest Extended Error Logging Generated Custom Property Values Integrating Amazon CloudWatch as an External Data Source Integrating AppDynamics as an External Data Source Integrating CA Wily Introscope as an External Data Source Integrating New Relic as an External Data Source Specifying Maestro Locations and Play Options Staging a Complex Composition for Play Test Clip/Target-level System/Custom Properties Using DNS Lookups Volumes and Snapshots Debugging a Test Introduction to Debugging CloudTest Jenkins Plugin How do I incorporate CloudTest into an automated build? SCommand Reference Setting the number of Virtual Users using SCommand Setting Transaction Thresholds in Jenkins Using SCommand to Deploy and Manage Grids How do I cause a Test Composition to stop or abort based upon my own custom logic or criterion? How do I conditionally change whether an item in my Test Composition or Test Clip plays? How do I create validation whose behavior or comparison values can be changed before the Test Composition is played? How do I dynamically or programmatically substitute a value into a Message or Browser Action before it is sent or played? How do I parameterize a Test Composition (or its components) so that I can change the behavior each time I play it without having to edit it each time? How do I programmatically change how many times an item in my Test Composition or Test Clip plays? Analytics Dashboard Test Results Test Results FAQ Property Analytics Monitoring Database Commits and Rollbacks (Example Use Case) Database Monitoring Database Query Results in Result Details Database-Backed Seed Data Defining a Database Property Set Direct to Database Testing Support for Stored Database Procedures Troubleshooting Database Connections User-Defined Database Validations Adding Flex Automation Capability Adding Flex Recording Capability Adding Flex Validations Flex Recording Using External Interface Adding a Validation to a Browser Action App Actions Browser Action Browser Actions Creating a New Browser Action Recording Editing a Browser Action Enabling Cross-Domain Browser Tests Installing the Browser Recorder Firefox Extension Nested Compositions and the Test Suite Dashboard Outputs for Browser or App Actions Property Sets in a Browser or App Action Running a Browser Action Test on Multiple Browsers User-Defined Validations for Messages Using the Locator Tool Validations for Browser or App Actions Waits for Browser or App Actions WebUI test playback window is constricted Notice
CloudTest Components
CloudTest Components - a dynamic web application that combines a Web
Browser UI with distributed web services to support test creation, test grid
deployment, test execution and real-time performance analytics. CloudTest Components
include CloudTest Builder, CloudTest Main, CloudTest Load Server, CloudTest Results
Server, CloudTest Database Server, and CloudTest Conductor. CloudTest Components
also include the TouchTest Device Agent and the TouchTest Server for use on one
Device.
CloudTest Analytics
Dashboard - a display, which works in conjunction with the CloudTest
Results Server to display interactive, real-time streaming analytic
dashboards. The CloudTest Analytics Dashboard correlates multiple data
streams from a distributed load test into a single test result synchronized
and displayed on a synchronized timeline.
CloudTest Builder - a
web application that can be accessed from the following Web browsers:
Internet Explorer 7.0 and later, Firefox 3.0 and later, Safari 4.0 and later
and Chrome. CloudTest Builder includes the visual editors used to build
performance, load, functional and Web UI tests for a modern web
application.
CloudTest Conductor -
an installable multi-purpose software agent. It can be used to records
http(s) message and/or browser actions for test creation, launch browser
instances and plays UI/Ajax/Flex tests on client machines and monitor and
collect performance metrics from CloudTest components and from the
customer's infrastructure for inclusion in the analytics.
CloudTest Database
Server - a persistent data store for Repository’s metadata and the
Results Server’s data. Additional Database Servers may be deployed by
Customer in the Cloud in order to optimize performance and bandwidth
use.
CloudTest Load
Server - a test engine that executes all or parts of a complex test
composition. Multiple Load Servers can be deployed using the CloudTest Grid
Wizard to each execute parts of a load test that can scale out virtual users
(actual scale is dependent on available servers). Load Servers can be
geographically distributed across multiple cloud services, if available, and
single test compositions can run geographically.
CloudTest Main - a
physical or virtual software appliance that contains the CloudTest Web
Application, the CloudTest Repository, CloudTest Results Server and
CloudTest Database Server. The CloudTest Repository stores and retrieves
CloudTest Objects such as Test Compositions, Test Clips, Users, Targets,
Scenario Recordings, and Cloud Account Credentials. The CloudTest Web
Application includes CloudTest Builder, CloudTest Grid Wizard and CloudTest
Analytics Dashboard.
CloudTest Grid Wizard
- a fully automated capability to define, provision, detect and correct
cloud vendor errors, health check and create cross-cloud vendor test server
grids. Test Servers may come from public and private clouds and from
manually provisioned test servers.
CloudTest Results
Server - an in-memory, real-time analytic service (with persistence
to disk) purpose-built to handle very large result sets and analytics from
complex distributed load tests. A Results Server is included with CloudTest
Main. Additional Results Servers are deployed by CloudTest Grid Wizard to
work in concert with the Load Servers to analyze the real time streams of
data as the test runs