The primary variation's observed conversion rate 3.98% is 1.53% higher than the control's conversion rate 3.92%, based on 329 sessions.
Description / Hypothesis
Adding an inventory button to the HGVC Buy page will help increase buyer ad offers.
Variations
No variations uploaded yet.No variations uploaded yet.
Post-Mortem Analysis
Key Learnings
Buyer Offer CVR
Control: 3.92%
Variant: 3.98%
Lift: +1.4%
Stat Sig? NO — 51% confidence
Search Rate
Control: 35.95%
Variant 49.43%
Lift: +37.5%
Stat sig? YES – 99% confidence
The test did effectively send more users into the search experience, with 49% of sessions in the variant including a search (compared to just 35% for the control). However, this did not correlate to a significant rise in buyer offers (3.92% control vs 3.98% test). Because of the little impact on the bottom line, the result here is inconclusive; we should revisit ways to boost Buyer Offer CVR on this site.