Theme Tests
Test a whole new theme before you publish it.
Split your traffic between your live theme and any unpublished theme in your store. Eraya serves each visitor one theme for their whole visit and shows which one sells more.
Theme test
Theme Test · 2 variations · Day 9
Live theme
FREE SHIPPING ON ORDERS OVER $75
NOVAShopPacksAboutCart (0)
Built for
the long trail
the long trail
Considered gear for every day outside
SHOP NOW
Dawn
2.84%—
Conversion rate
Variation A
48-HOUR DROP · FREE SHIPPING ON EVERYTHING
NOVA.SHOPNEWSALECART · 2
GEAR UP.
GO FURTHER.
GO FURTHER.
New drops every Friday →
SHOP THE DROP
Horizon — Fall redesign
3.17%+11.6%
Conversion rate
How it works
From idea to live theme test in seven steps.
This is the same flow you'll use in the app. Most merchants finish setup in under ten minutes.
1Step 1 · Name your theme testName your theme testGive the test a name and a goal, like conversion rate or revenue per visitor. The goal becomes the primary metric on your results.
Step 1 · Name your theme testName your theme testGive the test a name and a goal, like conversion rate or revenue per visitor. The goal becomes the primary metric on your results.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
1Name & Description
2Test Variations
3Theme Test
4Visual & Extra Changes
5Audience
6Configure Analytics
7Review & Launch
Theme Test Details
Provide a name and description for your theme test Read more
Test Name
Fall redesign theme test
Choose a clear, descriptive name for your test24/100
Description (Optional)
Does the new Horizon redesign convert better than our current Dawn theme?
Add details about your test objectives and hypothesis73/500
Primary Goal
Select the metric that will determine the winner
Conversion rate
Revenue per visitor
Average order value
Add-to-cart rate
Checkout started rate
Profit
PreviousNext
Step 2 · Split traffic between themesSplit traffic between themesRun your live theme as the control against one or more variations. Split traffic evenly or set your own percentages.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
✓Name & Description
2Test Variations
3Theme Test
4Visual & Extra Changes
5Audience
6Configure Analytics
7Review & Launch
Configure Theme Test Variations
Set up variation names and traffic allocation for your theme test Learn more →
A
Name
Control
Traffic
50%
Type
ControlB
Name
Variation A
Traffic
50%
Type
Variation+ Add Variation
Control 50%Variation A 50%
Traffic is balanced — totals 100%Auto-Distribute
PreviousNext
Step 3 · Pick the themes to comparePick the themes to compareYour published theme is the control. For each variation, pick any unpublished theme from your store, such as a redesign or a theme from the Shopify Theme Store.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
✓Name & Description
✓Test Variations
3Theme Test
4Visual & Extra Changes
5Audience
6Configure Analytics
7Review & Launch
Theme Configuration
Select themes for each variation
AControl
DawnPublished
FREE SHIPPING ON ORDERS OVER $75
NOVAShopPacksAboutCart (0)
Built for
the long trail
the long trail
Considered gear for every day outside
SHOP NOW
Control theme auto-selected from published themes
BVariation A
Horizon — Fall redesignUnpublished
48-HOUR DROP · FREE SHIPPING ON EVERYTHING
NOVA.SHOPNEWSALECART · 2
GEAR UP.
GO FURTHER.
GO FURTHER.
New drops every Friday →
SHOP THE DROP
App embed is activeRecheck Status
PreviousNext
Step 4 · Layer extra changes on topLayer extra changes on topOptional. Add an offer, a content block or a style change to any variation, so you can test the full experience around the new theme.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
✓Name & Description
✓Test Variations
✓Theme Test
4Visual & Extra Changes
5Audience
6Configure Analytics
7Review & Launch
Visual & extra changes
Optional. Stack extra changes onto a variation — a different template, theme, page, redirect, content edit or offer — on top of what this test already varies.
AControlBVariation A2
BVariation AVariant50%
OOfferFree shipping over $75▾
CContentHero headline and badge under the price▾
+ Add another change
PreviousNext
Step 5 · Target the right shoppersTarget the right shoppersRun the test for every visitor or only a saved audience, such as new visitors on mobile.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
✓Name & Description
✓Test Variations
✓Theme Test
✓Visual & Extra Changes
5Audience
6Configure Analytics
7Review & Launch
Audiences
Decide who enters this test: pick a target audience, and set which other tests it should never run alongside. Read more
Selected Audience+ Add Audience
All VisitorsDefault
Everyone who visits your store
Other Audiences
US mobile shoppers
Visitors from the United States on a phone
location is US AND device is mobile
Returning customers
Visitors who have been to the store before
visitor_type is returning
US mobile shoppers will be used for targeting this test.
Mutually Exclusive Tests
Stop a visitor entering this test and another one at the same time, so neither can influence the other's results.
Worth doing whenever two tests could affect the same metric. Necessary when they compete for a change only one can make — the same template, redirect or theme.
Set up exclusion groupPreviousNext
Step 6 · Pick the metrics that matterPick the metrics that matterEraya tracks 30+ metrics on every test. Choose the ones you want up front and drag them into order.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
✓Name & Description
✓Test Variations
✓Theme Test
✓Visual & Extra Changes
✓Audience
6Configure Analytics
7Review & Launch
Configure Analytics
Eraya records 30+ metrics on every test. Choose the ones you want on the front page of your results and drag them into the order you want them in. Your Primary metric is the goal you picked in Name & Description, and always shows.
Conversion ratePrimary
The goal you picked for this test
Revenue per visitorAlways shown
Total revenue divided by visitors
Average order value
Average spend per completed order
Add-to-cart rate
Visitors who add an item to cart
Profit
Revenue minus product cost
PreviousNext
Step 7 · Review, preview and go liveReview, preview and go liveSee every setting on one page, then preview each theme on your live store. When it looks right, take the test live.
app.erayaai.com/tests/theme/create
Nova OutdoorsPRO+ Create New Test
Dashboard
Tests
Test Ideas
Audiences
Integrations
Settings
← BackCreate Theme Test
✓Name & Description
✓Test Variations
✓Theme Test
✓Visual & Extra Changes
✓Audience
✓Configure Analytics
7Review & Launch
Theme Test Configuration Preview
Review your theme test configuration before launching.
Test Details
Test Name
Fall redesign theme test
Description
Does the new Horizon redesign convert better than our current Dawn theme?
Audience
Selected Audience
US mobile shoppers
Audience Rules
location is USdevice is mobile
Theme Configuration
AControlControlDawn · Published50% traffic
BVariation AHorizon — Fall redesign50% traffic
PreviousCreate Preview
Built for testing a whole store redesign.
01
Any theme in your store
Test unpublished themes, theme copies or a theme from the Theme Store against your live one.
02
One theme per visit
Each visitor sees the same theme on every page, so results reflect the full experience.
03
Preview before launch
Open every variation on your real storefront before any shopper sees it.
04
Mutually exclusive tests
Keep a theme test apart from other tests so their results never overlap.
Merchant reviews
Rated 5.0 by Shopify merchants.
“We’ve been collaborating with Eraya to enhance our pricing strategies and improve margin structures. The team has helped us move beyond basic cost plus models to deliver better value for our customers. We’re still early in the process but already seeing promising results — the Eraya team has been instrumental in designing testing strategies and analytics that work with our complex product set.”
FF
Fulton Fish MarketUnited States
Fulton Fish MarketUnited States“Love the App!! It is definitly a hidden gem. Has all the functions of the Big Player, but for a fraction of costs. Would recommend 10/10!”
M
maleup®Germany
maleup®Germany“Awesome app, easy to use and Rishabh is very helpful with anything you need”
LS
LUX SKINShopify App Store review
LUX SKINShopify App Store review