Experiment Viewer

The experiment viewer is your window to your website. It's where we collect, aggregate, and visualize all of the data for a particular page or page variations and display them in an easily digestible format. From here, you can view heatmaps, livemaps, hovermap, and scrollmaps, add goals, and make changes to your website for the purpose of A/B and multivariate testing.

To access the experiment viewer, launch the website you are currently working in from the "All Websites" view, expand the "Experiments" menu and click "All Experiments". Select the experiment you would like to view, and then select the "Viewer" tab, which will be open when the experiment loads.

Variations

Variations are versions of the same page in an experiment allowing you to alter text and elements on a particular variation and serve the different versions to different experiment participants for the purpose of testing goal conversions and user engagement.

Variations of an experiment can be seen below the experiment controls with the number of participants who have seen a each particular variation to the right of the variation name. You can navigate between variations be clicking on the variation name.

Control

Your control variation in an experiment is the page you start with. For optimal testing results, we advise that you do not alter your control, but you do have the option to. All other variations are measured against the control as to whether or not there is marked improvement in conversion and user engagement on a particular page.

Adding a Variation

To the right of your variation is the "Add Variation" button allowing you to add as many variations as you'd like up to the amount stipulated by the website's plan. You will be prompted to name the variation and enter a variation weight, which alters the likelihood for individual users to see the particular variation relative other variations.

If your experiment contains many variations such that they overflow, you can use the arrows to the left and right of the variations to navigate.

Duplicating a Variation

You can duplicate variations within Concurra by selecting the drop indicator next to the variation name and participant count and selecting "Duplicate Variation", which will result in a total duplication of the variation including any edits you may have made. You can then make any edits to the duplicated variation that you'd like without affecting the original.

Variation Settings

Variation settings includes the name of the variation, and the weight of the variation. The weight of the variation alters the likelihood for individual users to see the particular variation relative to other variations. You can access the variation settings by clicking the drop indicator next to the variation name and participant count and selecting "Variation Settings".

Click "Save Variation" to save any changes.

Deleting a Variation

You can delete any variation except for your control variation (the first tab in the variations list), by clicking the drop indicator next to the variation name and participant count and selecting "Delete Variation".

Viewer Modes

Viewer modes change the context of the viewer and allow you to interact with your website or view different kinds of data and visualizations.

Editor

The editor mode allows you to interact with your web page adding goals, changing HTML and text, and even remove entire elements toward the goal of tracking user behavior and testing how your visitors respond to changes.

To edit elements in the Editor mode, right click anywhere on the page inside the viewer to open a context menu with what options are available for editing. For an explanation of how these options work and what all is possible, reference the "Using the Editor Mode" section below.

Changes made in experiment viewer editor will not be reflected on your public website until they are saved by clicking "Save Experiment" in the top right corner and the experiment is either already running or made to run by clicking "Save & Run Experiment".

Livemap

Livemaps are an entirely new concept within Concurra to provide a new way of interacting with and display data on your web page. Because of the technical difficulties inherent in display heatmap data on anything other than a static website, we've introduced Livemaps. Livemaps allow you to see click data within elements even if the elements move or are located within dropdowns or other interactive elements.

Livemaps are drawn on the page in various colors. Green meaning a low number of clicks, yellow meaning a moderate number of clicks, and red meaning a high level of clicks. The number of the clicks will be displayed in the center of the livemap box.

Livemaps are drawn on top of elements on your page. Hovering over the elements the livemaps are over increases the fidelity of the data shown. The livemaps will redraw showing clicks over the children of the element showing you increasingly more detailed clicks. This allows you to navigate within elements to view the click values even when they fall within dropdowns and other dynamic elements.

Heatmap

Heatmaps allow you to see precisely where users click on your web page by displaying a colorized information visualization on top the experiment viewer. You'll be able to clearly see concentrations of clicks ranging from dark red and yellow representing high concentrations to blue representing low concentrations.

Hovermap

Hovermaps function exactly like heatmaps, but they pertain only to where people are hovering their mouse. Many people read with their mice or spend time hovering over an element while reading. Hovermaps give you an accurate picture of where people are dedicating their attention on screen in addition to click data. You'll be able to clearly see concentrations of hovers ranging from dark red and yellow representing high concentrations to blue representing low concentrations.

Scrollmap

Scrollmaps paint a clear picture of what items on your web page are most visible and where people are dropping off as they scroll down the page. Scrollmaps progress from red for the most seen portion of your web page to blue for things that are seen the least.

Experiment Viewer Options

On the right hand side of the experiment controls are the experiment viewer options that will allow you to affect how elements are displayed in the experiment viewer.

  1. Show Goals
    The show goals toggle will allow you to toggle the visibility of goals on the page as you view different experiment viewer modes.

Using the Editor Mode

The editor mode is how you make changes to a variation in order to test user engagement, goals, and content changes between different variations of your webpage. Using the editor mode, you can single out any element on your webpage by hovering over it. A purple box will appear around the element indicating that you can edit that element. Right clicking will reveal a context menu with your editing options.

Changes made in experiment viewer editor will not be reflected on your public website until they are saved by clicking "Save Experiment" in the top right corner and the experiment is either already running or made to run by clicking "Save & Run Experiment".

Edit HTML

You can edit the HTML of any element on your web page by selecting the "Edit HTML" option from the edit context menu. Click "Save Changes" when you have completed your edits.

Edit Text

You can edit the text of any element on your web page by selecting the "Edit Text" option from the edit context menu. This is great for quickly editing the text on a page, but if there are any HTML elements contained within the text including inline elements such as strong or em, they will be removed. Click "Save Changes" when you have completed your edits.

Remove Element

You can remove any element on your web page by selecting the "remove" option from the edit context menu.

Add Goal Target

You can make any element on your web page a goal target by selecting the "Add Goal Target" option from the edit context menu. You will be given the choice as to whether or not to add the target to a new goal or an existing goal, and be allowed to define the scope of the goal.

The scope of the goal can either be "Site Wide" meaning it can appear on other pages other than the experiment you are currently editing, or "Experiment" meaning the goal can only be used in the context of this experiment and cannot appear on other pages of your website.

Click "Add Goal" or "Save to Goal" to save your changes.

Edit Goal Target

You can edit existing goal targets on a page in an experiment by right clicking on the goal target and selecting the "Edit Goal Target" option from the edit context menu. Click "Save Changes" to save any changes.

Undo

You can undo any action in the editor by selecting the "Undo" option from th edit context menu. You can undo as many actions as you'd like back to when you first loaded the experiment.

Saving, Running, and Stopping an Experiment

Experiment controls can be found in the top right hand corner. You can save an experiment by clicking "Save Experiment. You can run an experiment by clicking "Save & Run Experiment". Experiments run for an indefinite amount of time until they are manually stopped. Once an experiment is running, you can stop by clicking "Stop Experiment" from the top right hand side of the Concurra interface. This will stop any further data collection for th experiment. any data collection by the experiment.

Once an experiment is stopped, it cannot be edited or run again, and the data is preserved for future reference for the amount of time referenced in the website's plan. Changes in the variations will no longer be visible on your public website.

Filtering

You can filter information on this view by using the filtering options in the top right of the interface. You can filter by:

  1. Date
    Click the date selection dialog in the top right of the interface. The date selection dialog will open revealing two calendars. You can select any date range using the pair of calendars displayed, and you can adjust the months using the arrows to the right and left above the calendars. You can also select from predefined date ranges by selecting the previous "Week", "Month," or "Year" options from the bottom left of the dialog. Once you are finished, click "Apply" to apply your date ranges and reload the data on the graphs.
  2. IP Address Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "IP Address" from the first select. You will then be able to enter an IP address into the value field. This will show only sessions that have originated from that particular IP Address. Click "Apply Filter" to apply the filter and reload the data on the graphs.
  3. Browser
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Browser" from the first select. You will then be able to set the value to a particular browser by selecting the browser you want to target. This will adjust to show visitors only using that particular browser. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  4. Operating System
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Operating System" from the first select. You will then be able to set the value to a particular operating system by selecting the operating system you want to target. This will adjust to show visitors only using that particular operating system. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  5. Page Count Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Page Count" from the first select. You will then be able to set the operator between "Greater Than", "Less Than", "Greater Than or Equal To", or Less than or Equal To". You can then set the number of pages visited. This will filter to show visitors who have only visited the number of pages set in your criteria. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  6. New Visitors
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "New Visitors" from the first select. You will then be able to set the value to "True" or "False". True will show data only for new visitors. False will show data only for those who are not new, and thus returning, visitors.Click "Apply Filter" to apply the filter and reload the data on the graphs.
  7. Device
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Device" from the first select. You will then be able to set the value to "Desktop, "Tablet", or "Mobile," which will adjust to show visitors only on the selected device. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  8. Country
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Country" from the first select. You will then be able to set the value to a particular country which will adjust to show visitors only in that particular country. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  9. Language
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Language" from the first select. You will then be able to set the value to a particular language by selecting the language you would like to see statistics for. This will adjust to show visitors who have their browsers set to that language. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  10. Referrer
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Referrer" from the first select. You will then be able to set the value to a particular referrer by typing in the referrer URI you want to target. This will adjust to show visitors only coming from that particular referrer. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  11. Page
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select "Page" from the first select. You will then be able to set the value to a particular page by typing in the page you want to target or selecting one from the dropdown. This will adjust to show only statistics for people who have visited that page. Click"Apply Filter" to apply the filter and reload the data on the graphs.
  12. URL Parameter
    Click the filter button in the top right of the interface. The filter dialog will open revealing a selection of filters. Select any one of your custom URL parameters which. You will then be able to set the value to a particular parameter value by typing in the parameter value you want to target. This will adjust to show visitors who only arrived at your site using that particular URL parameter value. You can also leave the value blank and retrieve all users that arrived at your site using a particular parameter.