Welcome to our A/B testing!
A/B testing is a method where two versions (A and B) of a webpage or element are compared to see which one performs better based on specific goals, helping businesses make data-driven decisions for optimization.
So, what can be tested?
Delivery method names: Express Shipping vs Express Shipping | Get it faster! 💥.
Delivery method description: e.g., Arrives in 1 business day, Get it delivered sooner, Free for orders above $160 or Order before 12/10 to get it for Christmas! 🎄
Shipping rates: Compare between two prices for the same delivery method; (e.g., Ground Shipping would be $3.99 in version A and $4.99 in version B) to see which one drives more sales.
Delivery Promises: Compare variations in delivery promises to understand customer preferences.
Free Shipping Thresholds: Test different free shipping thresholds to see its impact on conversions.
How does it work?
Random Assignment: Visitors are randomly assigned to either version A or B.
Data Collection: PDQ collects data on how each version performs in terms of the chosen goal (e.g., sales).
By analyzing conversion and abandonment rates, PDQ determines which variant is more successful enabling more informed decisions about optimizing your checkout for better performance.
How to create your own A/B tests in PDQ!
Just go to Delivery methods
If there's an active A/B test running, you'll see A/B test under the type of delivery method
where if a delivery method has an A/B test running, you will see an - A/B test - under the type of delivery method. Next, click the three dots at the end of each method and select 'Performance & A/B test' for more insights.
There you can see all of the A/B tests that are completed and the active A/B test (if there are such). If there's no A/B test in progress, click 'Create A/B test' to get started.
There, you will be presented with 2 variants: Control A and Test B.
For instance, if you want to compare two variants of Ground shipping—one priced at $2.99 (Control A) and the other at $3.99 (Test B)—you can input these values accordingly.
You can also compare delivery method names, say ‘’Express Shipping’’ vs ‘’Express Shipping | Get it faster! 💥 Additionally, you can specify whether to display estimated delivery times during checkout (Control A) or to omit the delivery promise entirely (Test B).
Lastly, you can set the 'Number of checkout visits to complete test' metric which becomes the length of the test.
Once you have a clear winner, you can see it as the winner, and it'll become (or stay) the Control A variant for your next test!
Incorporating A/B testing into your strategy allows you to refine things like pricing, delivery promise, and checkout experience. By carefully comparing variants, setting substantial sample sizes, and embracing a data-driven approach, you can unlock valuable insights to optimize your processes, boost conversion rates, and elevate your overall business performance.
So go ahead and get started. Happy testing!