Use predictive analysis to prioritize performance improvements

The what-if analysis widget is a data science feature that uses predictive analytics to tell you the impact of performance changes on conversions, revenue, and other business metrics.

With version 3.0 of what-if analysis, you have more flexibility in how you interact with the interface. You can choose which timing metric to analyze, which filters to apply, and which dimension to break down the analysis. You’ll be able to see how shifts in a sub population will contribute to the overall revenue increase.

Summary

The summary provides real-time performance results based on the metrics and the time period that you select. The Reality tab is the default view that shows your current performance results along with projected improvements. The Possibility tab shows your projected performance results.

Current performance

This example of the reality view shows the number of visits (1.6 million) recorded and the number of beacons gathered (30.7 million) within a four-day time period. The chart shows the median load time (2.47 seconds) and the median conversion rate (8.72%) during this time period. All of the recorded metrics are listed on the right. The x-axis represents the session load times in milliseconds. Projections on improving your total revenue are calculated for you.

Projected performance

Based on the projections given in the reality view example, this possibility example shows the results of the projected performance improvements. The chart represents how changing the median load time by 419 ms during this time period can improve the median conversion rate by 1.02 points, which in turn improves the daily revenue by $1.6 million dollars. The projected metrics are listed on the right.

How are projections calculated?

Each time a what-if analysis is generated, mPulse calculates the optimal load time to get the highest conversion rate with the least amount of change in load time.

Load Time & Metrics

This view shows an individual chart for each of the business metrics that you want to optimize for.

The metrics are projected based on the real user traffic on your application and reflect predicted behavior based on a given page speed. The circles are your goal metrics. These are the points at which mPulse predicts the best improvement in a metric relative to the improvement of the page speed. The horizontal lines are how mPulse predicts those metrics will change. Your current business metric and load time position are shown under Current. The session load time (page speed) is on the x-axis.

To adjust a metric, enter the value in the field provided under Projected or drag the slider up or down. To adjust the page speed, click the speed until it reaches the desired value. Once you set your goal speed, the other metrics are updated, and you’ll see the new projection in the summary’s possibility view.

Breakdown

The breakdown view shows performance distributions based on the selected Group By filter. In the example below the Group By filter was set to “Country”. The top ten attributes of the dimension are shown in this view, and each can be modified independently. Business metrics and overall site speed are projected based on the individual modifications. Speed can be adjusted by moving the page load time slider under each chart; when released the chart and metrics will update to present the new results.

Filters

Use the filter bar to select your app, timers, metrics, dimensions, and date range to capture performance results, as shown in this example. The Group By filter will enable the Breakdown section of the report, revenue and conversion metrics should be set here if available.
This widget is available from the widget type directory. Just Create a custom dashboard, drag and drop the What-If v3.0 icon on the dashboard, then use the filters to select the time period and metrics for your analysis as shown in this example.