Pattern #51: Shortcut Buttons
Pattern #51 Tested 7 timesFirst tested by Martin Wong Recently tested by Andrey Prokhorov on Feb 29, 2024
Based on 7 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
?
Progression
(11 tests)
?
Leads
(1 tests)
-
Signups
-
Engagement
?
Sales
(6 tests)
?
Revenue
(1 tests)
-
Retention
-
Referrals
?
ANY PRIMARY
(7 tests)
Leaks
Amazon A/B Tests And Keeps Both Add-To-Cart And Buy Now Buttons
Two months ago I managed to detect that Amazon was actually a/b testing the removal of the second "Buy Now" button on a specific product page. Finally today it looks like the experiment has completed with both buttons still being displayed - like in the old days. View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.