Pattern #6: Customer Star Ratings
Pattern #6 Tested 6 timesFirst tested by 
Someone Recently tested by 
Katharina Lay on Aug 12, 2024
Based on 6 Tests, Members See How Likely Version B Wins Or Loses And By How Much
Measured by the sum of negative and positive tests.
Expected Median Effects Of B
?
Progression
(2 tests)
-
Leads
-
Signups
?
Engagement
(1 tests)
?
Sales
(4 tests)
-
Revenue
-
Retention
-
Referrals
?
ANY PRIMARY
(6 tests)
Leaks
Airbnb A/B Tests And Implements Customer Rating Averages Above Search Results
In this simple experiment, Airbnb tested the display of customer rarings averages on their search results screen. The tested copy was a form of social proof which showed the average rating of the properties for a given city (defined by the search). View Leak
Airbnb Discovers A Better Way To Display Customer Ratings In This A/B Test
In this tiny and well isolated experiment, Airbnb tried a slightly different approach to displaying customer ratings on their property (product) pages. From the observed implementation decision one month later, we learned that using decimal places for customer rating averages seems to be the better approach. :) View Leak
For each pattern, we measure three key data points derived from related tests:
REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.
SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process
DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.