Release Notes – February 2025

In these release notes, we’re excited to announce significant enhancements to our A/B testing feature for websites. While A/B testing has always been part of our custom website personalization offerings, we’ve now refined the experience with all new features, improved UI, enhanced analytics, and various bug fixes. These updates make it easier than ever for your marketing teams to create, manage, and analyze A/B tests directly within our console, ensuring a more seamless and insightful optimization process.

In this update, we’ll walk you through 

• Website A/B test campaign creation process
• Tracking Website A/B test campaign performance through detailed analytics
• Precise goal tracking for A/B tests with page redirection fix
• A/B test for tracking goals on pages outside the A/B test
• Track multiple elements under one A/B test goal

Let’s get started!

1. Website A/B test campaign

The A/B Test Campaign feature in NotifyVisitors allows you to experiment with different versions of your website elements, such as headlines, layouts, call-to-action buttons, or images, to identify which version resonates best with your audience.

To create an A/B test campaign in NotifyVisitors, go to the Onsite Campaign section and select Website A/B Test under the CRO category. Here, you’ll find a list of existing campaigns, and to create a new one, simply click the “Create New A/B Test” button.

The campaign creation process is divided into five simple stages.

In the Settings stage, you need to add the campaign name, page URL, and specify the start and end time for the experiment. You have the option to enable heatmaps to track user interactions on the page. If you want to conduct an A/B test across multiple pages, select the multi-page option, which allows you to add multiple page rules, URL paths, or page URLs for your test.

The next stage is Variation, where you can create multiple versions of your webpage. NotifyVisitors offers a simple drag-and-drop editor that lets you make changes to any variation without the need for coding skills. You can divide the traffic between the variations according to your experiment goals.

In the Targeting Rules stage, you can define the conditions under which your A/B test will run, ensuring it reaches the right audience. NotifyVisitors provides a range of targeting options, allowing you to target users based on visitor type, device type, browser, traffic source, location, and more, making your A/B test highly specific and relevant. Click here to explore all options.

Goals define the metrics that determine the success of your A/B test. In NotifyVisitors, you can track click on an element/link and page visits. For example, tracking CTA button engagement.

Finally, in the Review stage, you can see a complete overview of your campaign settings from the previous four stages on a single page. This step allows you to review all the details before launching the campaign. Once you have verified everything, click the Finish button, and your A/B test campaign will be added to the campaign list. 

To make your campaign live, simply enable the status button, and you are all set to gather valuable insights from your test.

2. Website A/B test analytics

Website A/B Test Analytics helps you compare the performance of different page variations to determine which version achieves your goals more effectively. The analytics are divided into 3 tabs:

A. Experiment summary

This page displays all the settings you’ve implemented in your A/B test campaign. It’s quite similar to the review page we talked about earlier when setting up the campaign.

B. Analytics

This page features trends and probability graphs that allow you to evaluate the performance and success potential of each variation page.

› Date range: Start by selecting a date range to filter your analytics for a specific timeframe.

› Goals: In this section, you can compare various goals of your campaign against one another, as well as each goal with its original and variation pages. The table provides insights into the expected conversion rate, improvement, probability to beat baseline, and unique conversion/visitors.

› Graphs: This section presents trends that allow you to compare the performance of original and variation pages for each goal. You can choose a specific goal from the dropdown menu.

The section includes three different types of graphs:

• Variation converts: The Variation Converts trend lets you compare goals fulfilled on each variation page on a daily, weekly, or monthly basis. You can either compare conversions or conversion rates by selecting an option from the dropdown.

• Density functions: This graph displays the success probability for each variation, helping you understand the likelihood of different outcomes and compare the performance of control and variation pages based on their probability of achieving the set goal.

• Being the best: This graph shows the probability of each variation being the top-performing version, allowing you to quickly assess which variation has the highest likelihood of delivering the best results for the selected goal.

› Visitors: This section shows the trend for comparing the number of visitors between the variations.

C. Heatmaps

If you’ve activated heatmaps for your campaign, you can check out the analytics, including views and clicks for various variations, along with the heatmaps right here.

3. Precise goal tracking for A/B tests with page redirection fix

We have now resolved the challenge of tracking A/B test goals when users are redirected after clicking the defined goal element, link, or page URL.

For example, if a user clicks the “Checkout” button (the goal) on a product page and is redirected to the payment page, the goal will now be tracked accurately. This improvement ensures precise goal tracking and more reliable analytics.

4. A/B test for tracking goals on pages outside the A/B test

A/B test goal tracking now extends to pages other than your created variations, allowing you to gain deeper insights into user behavior. For example, imagine you’ve created two variations of a product page: one with the “Checkout” button on the left and another with it on the right. Both variations redirect users to the same payment page. 

Now, your goal is to track how many users click the “Place Order” button which is on the payment page and determine which product page variation they came from—whether it was the one with the “Checkout” button on the left or the right. This helps you understand which variation drives more users to the payment page and how many of them ultimately convert.

To set this up, simply add the page URL and goal with the element selector of the page which is not part of the A/B test experiment (e.g., `payment page’s URL and place order button in our case).

Our system will then track click on the place order button, and in your campaign analytics, you’ll be able to see which variation drives more users to the payment page and how many of those users complete the order. This streamlined approach provides valuable insights into user behavior and conversion.

In the image above, variation 1 displays Unique Conversions/Visitors ratio of 36 out of 198. This indicates that 198 users visited the variation 1 page, and 36 of them placed the order.

5. Track multiple elements under one A/B test goal

This feature allows you to add multiple elements under a single goal field in your A/B test. For example, if you have two signup buttons on your page, you can monitor both under one goal. 

To set this up, go to the goals page while creating your campaign and select “Click on Element” from the dropdown menu. In the value field, enter the CSS selectors for each element, separating them with a comma (e.g., `#signup-button1,#signup-button2`). 

This way, you can efficiently track interactions with multiple elements as part of the same goal.

Conclusion

This release brings powerful enhancements to NotifyVisitors, making it easier than ever to optimize your website with seamless A/B testing, precise goal tracking, and insightful analytics. We’re committed to continuously improving your experience and providing tools that help drive better results for your business. 

To stay informed about our latest releases and access these features immediately, click the “Allow” button at the top of your screen for push notifications. For inquiries, suggestions, or a demo, reach out to us at support@notifyvisitors.com. Our dedicated team is ready to assist, ensuring you maximize the benefits of these exciting enhancements!

---