1. Nova Wiki
  2. Social Display

AI Variant Performance Statistics

This AI reporting dashboard delivers comprehensive insights into individual creative performance and lift, showcasing the impact and enhancements achieved through our advanced Optimization and AI features.

The Statistics Tab displays the performance of different variants.

To access the statistics report, simply click on the Variants button on your Creative page or Campaigns page and then select the statistics tab as demonstrated below.

  1. The Statistics tab on the Variant Management page provides a comprehensive reporting dashboard for the Creative.
  2. Data is broken down by Variant and the Performance Lift is quantified.

Explore various objectives and metrics to gain a quick insight into performance.

  1. Optimization Objective

    Indicates the objective that the platform is optimizing for. The strategy is also indicated via icon.
  2. Chart Dataset Selector

    This drop-down menu allows the user to choose the dataset they are viewing in the chart.

  3. Date Range Selector

    Select the date range for the data displayed. Impacts ALL elements on the page.

  4. Download Button

    Download the current data as a CSV.

  5. Header Metrics

    Summary of key metrics for the specified date range.

  6. Data Table

    Tabular view of the current displayed data, by Variant.


Understanding performance metrics

  1. Optimization Objective: Indicates the objective that the platform is optimizing for. The strategy is also indicated via icon.
  2. Total Outbound Clicks: Indicates the total number of outbound clicks for the specified date range.
  3. Total Outbound CTR: Indicates the total outbound CTR for the specified date range.
    (Outbound Clicks divided by Ads Rendered)
  4. Baseline Outbound CTR: Indicates the baseline outbound CTR for the specified date range. (the outbound CTR of the worst performing variant)
  5. Outbound CTR Lift: Indicates the outbound CTR performance lift that was realized.
    (The percentage change of the total outbound CTR vs. the baseline outbound CTR)
  6. Ads Rendered: Indicates the total number of ads rendered (ie. impressions) for the specified date range.

Note: if the "Optimization Objective" set to "Engagement Clicks" instead of "Outbound Clicks," the metrics will display engagement-related data instead.


Data Selector

Screenshot 2024-08-08 at 12.10.14

Chart Dataset Selector

This drop-down menu allows the user to choose the dataset they are viewing in the chart.

Choices:

  • Outbound CTR
  • Outbound Clicks
  • Engagement CTR
  • Engagement Clicks
  • Ads Rendered (“Impressions”)
  • Performance : A stacked view that shows Ads Rendered and the main objective (either Outbound CTR or Engagement CTR).

Variant level insights and control with “Share of” view

  1. Rows: Variant : Each row in the table represents 1 unique variant of the creative.

  2. Series Indicator : The round indicator next to each variant is a randomly selected color. The colors match each series in the chart above. Click on the icon to toggle on/off various series.

  3. “Share Of” Visualization :  The bar next to the Ads rendered and Clicks metrics indicates the proportion of that metrics attributable to each variant.
  4. Variant Status : 

    Use the toggle to enable/disable a particular variant.

    Screenshot 2024-08-13 at 07.38.58

    If the variant is deleted, the toggle will not be present, and a “Deleted” label will be shown instead.

    Screenshot 2024-08-13 at 07.43.48

    Hover the mouse over the eye icon to view a variant preview.

    Screenshot 2024-08-13 at 07.46.56
  5. Columns : The table can be sorted by clicking the arrows next to each column header.

Stacked Performance chart

Performance Chart

Selecting Performance from the Chart Dataset Selector will display a stacked view that shows:

  • Ads Rendered on the top; and
  • the main objective (either Outbound CTR or Engagement CTR) on the bottom.

At a glance, this depicts how traffic was allocated across variants and their relative performance.