Pattern #94: Visible Search

Pattern #94  Tested 4 timesFirst tested by Kimberly Cheung Recently tested by Jakub Linowski on May 23, 2024

Based on 4 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Visible Search (Variant A) Visible Search (Variant B)

Expected Median Effects Of B

?

Progression

(2 tests)

-

Leads

?

Signups

(1 tests)

-

Engagement

?

Sales

(3 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(4 tests)

Tested on

Tests

Added

Isolated

Test # 218 on Yummly.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Kimberly Cheung    Jan 14, 2019 Test link

Find Out How It Did With 20,122 Visitors

  • Measured by successful signups

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Home & Landing

Hypothesis: Anonymous users can't use global search while on the home promo page. We believe that if we show a global search bar to anonymous users, it presents a higher converting funnel (guided search) and will increase our sign-up rates significantly.

Control (A): Logged out users don't see global search bar.

Variant (B): Logged out users see global search bar. After searching for a keyword, the signup funnel starts with a more personalized reason to continue the signup process.

Get Access To See The Test Results

Replaced

Isolated

Test # 305 on Volders.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Michal Fiech    Jun 30, 2020 Test link

Find Out How It Did With 10,350 Visitors

  • Measured by visits to a company cancellation page

  • Measured by completed cancellations

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Home & Landing

In this experiment, a search input field (to look for companies) along with most popular links (also company names) were displayed on the homepage of a leading contract cancellation service. The control (A) version instead had a button that sent users to a next page where the same selection could be made - only later. The measurable success criteria were the number of paid cancellations - a few steps down the funnel.

Get Access To See The Test Results

Added

Isolated

Test # 432 on Snocks.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Melina Hess    Sep 29, 2022 Test link

Find Out How It Did With 1,175,864 Visitors

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Global

In this experiment, search functionality was added in the variation, globally on mobile. Impact on sales was measured

Get Access To See The Test Results

Replaced

Confounded

Test # 533 May 23, 2024 Test link

Find Out How It Did With 70,933 Visitors

  • Measured by visits any product page

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Global

In this experiment, the presence of a search bar was tested against no search bar altogether. The control had search, and in the variation it was removed. The variation also exposed items from within the "Need Help?" menu, making "My account", "Contact Us" and "FAQ" more prominent.

(Here the AB test is inverted / flipped to match the pattern). 

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.