WMTW Step 3 Headline v2

Description / Hypothesis

Repeating a previously successful experiment on the Old SMTN, this test will replace the headline above the final step in the WMTW funnel, encouraging more Market Sell conversions. We will test the most successful variant from the previous experiment to start.


Variations

Original
No variations uploaded yet.

Post-Mortem Analysis

Despite being a win on the old site, this experiment delivered a loss when tested on the new site, with the control outperforming the variant (-35% loss).

If any insight is to be gained from this test, it’s that whatever wins/losses we encountered on the old site can no longer be assumed as such on the new site. The new experience appears to be altering people’s preferences when entering conversion funnels, meaning we may need to rethink copy we previously found optimal or effective.

Other factors could be playing into this experiment’s failure, such as changes in ad copy–this test targeted Paid users, so their experience is already determined partly by whatever ad they click through from.