Shipping Experiences
Find the shipping offer that pays for itself.
Test free shipping thresholds and rates in every shipping zone, from domestic standard to international express. Eraya shows you which offer lifts conversion without eating your margin.
Free shipping threshold test
Shipping test · 3 zones · Day 14
United States
CanadaEuropeSettingControlVariation A
Free shipping over$75.00$50.00
Standard$6.95$4.95
Express$14.95$12.95
Conversion rate
3.02%
2.61% → +15.7%
AOV
$63.10
$68.40 → −7.7%
Profit / visitor
$1.07
$0.94 → +13.8%
How it works
From idea to live shipping test in eight steps.
This is the same flow you'll use in the app. Most merchants finish setup in under ten minutes.
1Step 1 · Name & DescriptionName & DescriptionGive the test a name and a goal, like conversion rate or profit. The goal becomes the primary metric on your results.
Step 1 · Name & DescriptionName & DescriptionGive the test a name and a goal, like conversion rate or profit. The goal becomes the primary metric on your results.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
1Name & Description
2Test Variations
3Shipping Zones
4Variation Settings
5Visual & Extra Changes
6Audience
7Configure Analytics
8Review & Launch
Shipping Test Details
Provide a name and description for your shipping test Read more
Test Name
Free shipping threshold test
Choose a clear, descriptive name for your test27/100
Description (Optional)
Does a $50 free shipping threshold earn more profit than $75?
Add details about your test objectives and hypothesis79/500
Primary Goal
Select the metric that will determine the winner
Conversion rate
Revenue per visitor
Average order value
Add-to-cart rate
Checkout started rate
Profit
PreviousNext
Step 2 · Test VariationsTest VariationsRun your current shipping as the control against up to three variations, and choose how traffic is split.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
2Test Variations
3Shipping Zones
4Variation Settings
5Visual & Extra Changes
6Audience
7Configure Analytics
8Review & Launch
Configure Shipping Test Variations
Set up variation names and traffic allocation for your shipping test Learn more →
A
Name
Control
Traffic
34%
Type
ControlB
Name
Variation A
Traffic
33%
Type
VariationC
Name
Variation B
Traffic
33%
Type
Variation+ Add Variation
Control 34%Variation A 33%Variation B 33%
Traffic is balanced — totals 100%Auto-Distribute
PreviousNext
Step 3 · Shipping ZonesShipping ZonesChoose which Shopify shipping zones the test changes, such as the US, Canada or Europe. Zones you leave out keep their current rates.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
✓Test Variations
3Shipping Zones
4Variation Settings
5Visual & Extra Changes
6Audience
7Configure Analytics
8Review & Launch
Shipping Zones
Select the shipping zones this test should change. Zones you leave out keep their current rates.
United StatesDomestic · 3 rates: Standard, Express, OvernightIn testCanada2 rates: Standard, ExpressIn testEurope27 countries · 2 ratesIn test
United Kingdom2 rates: Standard, ExpressRest of World1 rate: International
3 of 5 zones selected · Zones are synced from your Shopify shipping settings
PreviousNext
Step 4 · Variation SettingsVariation SettingsFor each zone, set a different free shipping threshold and rate for every variation, from standard to overnight.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
✓Test Variations
✓Shipping Zones
4Variation Settings
5Visual & Extra Changes
6Audience
7Configure Analytics
8Review & Launch
Variation Settings
Set the free shipping threshold and rates each variation shows, zone by zone.
uscaEuropeSettingControlVariation AVariation B
Free shipping over$75.00$50.00$100.00
Standard (5–7 days)$6.95$4.95Free
Express (2–3 days)$14.95$12.95$9.95
Overnight$29.00$29.00$24.00
Control shows your current Shopify rates. Leave a cell unchanged to keep the current rate for that variation.
PreviousNext
Step 5 · Visual & Extra ChangesVisual & Extra ChangesOptional. Add a free shipping banner, an offer or a content change to any variation.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
✓Test Variations
✓Shipping Zones
✓Variation Settings
5Visual & Extra Changes
6Audience
7Configure Analytics
8Review & Launch
Visual & extra changes
Optional. Stack extra changes onto a variation — a different template, theme, page, redirect, content edit or offer — on top of what this test already varies.
AControlBVariation A2CVariation B
BVariation AVariant33%
OOfferFree shipping over $75
CContentHero headline and badge under the price
+ Add another change
PreviousNext
Step 6 · AudienceAudienceRun the test for every visitor or only a saved audience, such as first-time buyers.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
✓Test Variations
✓Shipping Zones
✓Variation Settings
✓Visual & Extra Changes
6Audience
7Configure Analytics
8Review & Launch
Audiences
Decide who enters this test: pick a target audience, and set which other tests it should never run alongside. Read more
Selected Audience+ Add Audience
All VisitorsDefault
Everyone who visits your store
Other Audiences
US mobile shoppers
Visitors from the United States on a phone
location is US AND device is mobile
Returning customers
Visitors who have been to the store before
visitor_type is returning
US mobile shoppers will be used for targeting this test.
Mutually Exclusive Tests
Stop a visitor entering this test and another one at the same time, so neither can influence the other's results.
Worth doing whenever two tests could affect the same metric. Necessary when they compete for a change only one can make — the same template, redirect or theme.
Set up exclusion groupPreviousNext
Step 7 · Configure AnalyticsConfigure AnalyticsEraya tracks 30+ metrics on every test, including shipping revenue and profit per order. Choose the ones you want up front.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
✓Test Variations
✓Shipping Zones
✓Variation Settings
✓Visual & Extra Changes
✓Audience
7Configure Analytics
8Review & Launch
Configure Analytics
Eraya records 30+ metrics on every test. Choose the ones you want on the front page of your results and drag them into the order you want them in. Your Primary metric is the goal you picked in Name & Description, and always shows.
Add-to-cart ratePrimary
The goal you picked for this test
Conversion rateAlways shown
Orders divided by sessions
Average order value
Average spend per completed order
Revenue per visitor
Total revenue divided by visitors
Profit
Revenue minus product cost
PreviousNext
Step 8 · Review & LaunchReview & LaunchSee every setting on one page, then preview each variation at checkout. When it looks right, take the test live.
app.erayaai.com/tests/shipping/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Shipping Test
✓Name & Description
✓Test Variations
✓Shipping Zones
✓Variation Settings
✓Visual & Extra Changes
✓Audience
✓Configure Analytics
8Review & Launch
Shipping Test Configuration Preview
Review your shipping test configuration before launching.
Test Details
Test Name
Free shipping threshold test
Description
Does a $50 free shipping threshold earn more profit than $75?
Audience
Selected Audience
US mobile shoppers
Audience Rules
location is USdevice is mobile
Shipping Configuration
AControlControlFree over $75 · $6.9534% traffic
BVariation AFree over $50 · $4.9533% traffic
CVariation BFree over $100 · Free standard33% traffic
PreviousCreate Preview
Built for how Shopify shipping really works.
01
Free shipping thresholds
Find the cart value where free shipping lifts orders without cutting into margin.
02
Rates by zone
Test different rates for each Shopify shipping zone, domestic and international.
03
Every shipping method
Change standard, express and overnight rates side by side.
04
Profit-aware results
See conversion, AOV and profit per visitor, so a cheaper rate has to earn its place.
Merchant reviews
Rated 5.0 by Shopify merchants.
“We have used this tool for multiple tests now and are very happy! Everything is super easy to set up including great documentation and guidance, the analytics are clear, and it all fits seamlessly into our store. If something is unclear or seems not possible, the support is really fast and helpful. Rishabh has helped us out a lot and even implemented quick fixes just for our shop. Thanks, Rishabh!”
KS
the kurzgesagt shopUnited States
the kurzgesagt shopUnited States“This app is really great! We have been using it for pricing testing. The setup is very easy, Rishabh is here to help set everything up properly, even with our very customised setup. Our test ran flawlessly, and we are already planning the next one! Data visualisation is great; you can decide which KPI is the most important to you, and it adapts to your requirements.”
AM
Ava&MayGermany
Ava&MayGermany“This A/B testing app is exceptionally good. It offers more CRO features and analytics than other similar apps that charge 10X the price. Support is super responsive too and makes changes based on feedback.”
F
FreddieUnited States
FreddieUnited States