A Checkout Profile A/B Test swaps your entire live checkout profile between a Control and a Variant (for example, 1-page vs 3-page checkout, or a different element placement). Because Shopify has no API to change a live checkout profile on the fly, this runs as a switchback: PDQ rotates between the profiles on a schedule (about hourly) and compares conversion between the windows.
How to run one
Checkout Profile tests are set up and launched by PDQ's automation team, not from the self-serve A/B UI. To start one:
Build the variant checkout profile in Shopify (e.g. your 1-page version) and QA it.
Tell your CSM you want to test it against your current profile - give 1–2 hours' notice so the team can launch it.
PDQ rotates Control vs Variant on a schedule and reports results in the Analytics Dashboard.
Important while it's running
Because the profile switches on a schedule, theme/checkout changes may appear to "disappear" for an hour - that's the switchback rotating, not a bug.
If you need to add anything to the checkout during the test, add it to both the Control and Variant profiles so the experience stays comparable.
Pick a winner with your CSM at the end; traffic then settles on the winning profile.