An A/B test compares two experiences side by side to see which performs better. Instead of guessing, you split real customer traffic between versions and let the data decide. PDQ runs the test automatically - set it up, launch it, check the results.
A Shipping Rates A/B Test compares two or more Shipping Rate Groups against each other. Test whether free shipping above $50 converts better than a $5 flat rate, or any rate strategy you can structure into a group. PDQ splits checkout traffic and tracks the results.
Step 1: Create the test
Go to Optimize → A/B Tests. Click the purple New Test button (top-right) and select Shipping Rates Test.
Step 2: Fill in the details
Test Name - short and clear (e.g. "Free Shipping vs Flat Rate").
Hypothesis - what you expect to learn (min. 100 characters): "Offering free shipping above $75 will increase checkout conversion by reducing payment-step drop-off."
End Test After X Checkouts - optional. Leave blank to run until you stop it manually.
Goal Metric - Checkout Conversion, Gross Profit, AOV, Shipping Revenue, or Net Revenue.
Click Next.
Step 3: Set rules (optional)
By default the test runs for everyone. To limit it to a segment (country, cart value, etc.), click + Add rule group. Click Next.
Step 4: Allocate traffic
You'll see your existing Shipping Rate Groups. Check the ones to include and assign each a traffic percentage (all must total 100%).
Standard A/B test - check two groups and split 50/50.
Multi-variant test - check three or more (e.g. 33/33/34). More variants need more checkout volume to reach significance.
Click Create draft test.
Managing your test
Editing a draft - Drafts tab → ⋯ → Edit.
Launching - ⋯ on the draft → Start Test (goes live immediately).
Monitoring - a Running tab appears once a test is active. Data lives in Optimize → Analytics Dashboard, available the day after launch.
Ending - Running tab → ⋯ → End Test → moves to Concluded. View results in the Analytics Dashboard, or Concluded → ⋯ → Get Analytics. To roll out the winner, see Implementing your winning variant.
QA tip: variant assignment is sticky per checkout token - complete an order or clear the cart cookie to see a fresh allocation while testing.
Happy testing! Reach out to support@prettydamnquick.com if you need help interpreting results.