Comparative testing concepts
Here are all terms you may encounter when working with the comparative testing.
The concepts are arranged in the same order as you can see them in the Comparative testing tab.
- Test definition
- Test definition is a comparative testing unit. It is an ordered list of
test cases (comparative) with settings common to all included test cases. To run a test
for test definition, it must have test cases associated. See also: Run a test for test definitions
- Hostname
- It’s the website you want to compare your configuration changes with.
- Associated configuration
- It’s the configuration associated to a hostname for which the test definition was created.
- IP versions
- They’re IP versions Test Center uses to make a request while running the test.
- Test cases (comparative)
- A test case in the comparative testing specifies the page to be requested
and the comparisons to be performed for the page and for all the embedded objects and
redirect targets that are requested as a result of the page. It is a part of a test
definition. See also: Create a test definition
- Test request
- Test request is a constituent of a test case (comparative). It is a
combination of a fully qualified URL and request headers for which you want to run a
test.
- URL to test
- Comparative testing, it’s the URL of the resource you want to test. It must be fully qualified and must contain the same hostname as that of the test definition that this test case belongs to. Currently the only supported method is GET.
- Additional settings
- Comparative testing, in test cases, it’s the section where you add, modify, or modify request headers used by Test Center for running the comparative test.
- Comparisons
- Comparisons are constituents of a test case (comparative). They
enable you to select what you want Test Center to compare during the test run.
- Response code
- When selected, Test Center compares the returned HTTP response codes but only their numerical part, not the text that might accompany it. For example, 404 not 404 Not Found.
- Response headers
- When selected, Test Center compares the presence and values of headers in the corresponding HTTP responses. By default, every header in the response is compared (except for a predefined list of headers).
- Response headers to compare or ignore
- When you provide an input, Test Center either compares or ignores the provided response headers.
- CP code
- When selected, Test Center compares CP codes used on specified environments. CP codes are content provider codes and are used by Akamai to identify traffic for billing and reporting purposes.
- Caching option
- When selected, Test Center compares the caching option used on the specified environments.
- Cache key
- When selected, Test Center compares the
cache keys used on the specified environments.Note: If you use a private cache key or an origin response header to control the ability to cache content you may get unreliable results.
- Metadata variables
- When selected, Test Center compares the
presence and values of every metadata variable used in the processing of the
request.
This includes both user-defined and system variables. Hidden variables are only included if specific instructions are included in the hostname’s delivery configuration. Sensitive variables are never included. By default, every variable set is compared when the test response is processed (except for a predefined list of variables).
- Metadata variables to compare or ignore
- When you provide an input, Test Center either compares or ignores the provided metadata variables.
- Origin server
- When selected, Test Center compares the
origin servers used for specified sites and environments. The origin server is
the physical location associated with an IP address that your content is
retrieved from. Note: The specific value compared will be incorrect if
origin-server.dns.name.value
is used to override the hostname that Akamai Edge Servers reference in DNS. - Ignore embedded objects
- When selected, Test Center performs the corresponding comparison for all requests triggered by the test case, ignoring requests for embedded objects and redirect targets. This only works if the objects are on the same hostname as the URL to test.