An A/B test compares two experiences side by side to see which performs better. Instead of guessing, you split real customer traffic between versions and let the data decide. PDQ runs the test automatically - set it up, launch it, check the results.
An Extension Groups A/B Test compares two extension groups against each other. An extension group is a collection of multiple extensions that run together on your checkout. Use this to compare entire checkout experiences - for example, an upsell + trust-badge stack against a free-shipping bar alone.
You can also test nothing vs. an extension group - one group sees no extensions, the other sees your chosen group - to measure the true incremental impact of your setup.
Note: Display rules on individual extensions within each group still apply during the test.
Step 1: Create the test
Go to Optimize → A/B Tests. Click New Test and select Extension Groups Test.
Step 2: Fill in the details
Test Name - e.g. "Full Upsell Stack vs Free Shipping Bar Only".
Hypothesis - min. 100 characters: "Showing a full suite of checkout extensions will increase net revenue more than a single free-shipping bar by creating multiple conversion touchpoints."
End Test After X Checkouts - optional.
Goal Metric - Checkout Conversion, Gross Profit, AOV, Shipping Revenue, or Net Revenue.
Click Next.
Step 3: Set rules (optional)
Add conditions to limit who enters the test. Leave empty to run for everyone. Click Next.
Step 4: Allocate traffic
Group vs. Group - pick a Control group and a Test group; set the split (typically 50/50). Click + Add Test Group for a multi-variant test.
Nothing vs. Group - set Control to NULL (no extensions), Test to your chosen group.
Click Create draft test.
Step 5: Connect to Shopify and launch
A Token for Shopify tab appears in the test.
Group vs. Group - paste the test token into the relevant extension blocks so PDQ serves the right group per shopper.
Nothing vs. Group - add the token to the checkout block(s); PDQ serves the group to the Test group and nothing to Control (set a fallback where applicable).
Then find the draft in Drafts → ⋯ → Start Test.
⚠️ Same token gotcha as single extensions: don't place a token in both "Enter desired token" and "AB Test Configuration" on one extension -use AB Test Configuration only.
Managing your test
Editing a draft - Drafts → ⋯ → Edit.
Launching - ⋯ → Start Test.
Monitoring - Running tab; data in Analytics Dashboard the day after launch.
Ending - Running → ⋯ → End Test; results in Analytics Dashboard, or Concluded → ⋯ → Get Analytics. To roll out the winner, see Implementing your winning variant.
Happy testing! Reach out to support@prettydamnquick.com if you need help.