Pattern #20: Canned Response

Pattern #20  Tested 11 timesFirst tested by Mark Freedle Recently tested by Ardit Veliu on Sep 30, 2022

Based on 11 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Canned Response (Variant A) Canned Response (Variant B)

Expected Median Effects Of B

?

Progression

(3 tests)

?

Leads

(9 tests)

-

Signups

-

Engagement

?

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(11 tests)

Tested on

Tests

Pattern #20: Canned Response
Was Tested On Acousticalsurfaces.com by Nina Bayatti

Added

Isolated

Test # 128 on Acousticalsurfac... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Nina Bayatti    Dec 02, 2017 Test link

Find Out How It Did With 2,951 Visitors

  • Measured by successful form submissions

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 433 on Expertinstitute.... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Ardit Veliu    Sep 30, 2022 Test link

Find Out How It Did With 14,490 Visitors

  • Measured by form submissions

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

In this experiment a dynamic canned response was added to a lead form. The contents of the copy reflected a handful of user choices from other form field selections. Impact on leads / form submissions was measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 409 on Expertinstitute.... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Ardit Veliu    Apr 30, 2022 Test link

Find Out How It Did With 2,831 Visitors

  • Measured by completed forms

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Get Access To See The Test Results

Added

Isolated

Test # 249 on Autoscout24.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Optimizely    Jul 17, 2019 Test link

Find Out How It Did

  • Measured by successful form completions

Zoom In
A
B
Product

AutoScout24 is Europe’s largest online marketplace for new and used cars. As published by Optimizely, they tested a form pre-filled with text that read: ‘Hello. I am interested in your vehicle. Please contact me. Kind regards.’ 

Get Access To See The Test Results

Replaced

Isolated

Test # 248 on Volders.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Alexander Krieger    Jul 16, 2019 Test link

Find Out How It Did With 13,878 Visitors

  • Measured by total contract cancellations

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

In this experiment, an editable contract cancellation letter was tested against a non-editable one. The editable letter first appeared in a text state, which required a click on a link in order for it to be transformed into an editable textarea field.

Get Access To See The Test Results

Added

Isolated

Test # 231 on Glass.net by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Mark Freedle    Mar 14, 2019 Test link

Find Out How It Did With 1,342 Visitors

  • Measured by form submit to next step (validation)

  • Measured by total form leads

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Replaced

Isolated

Test # 147 on Reverb.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Nicholas Evans    Jan 25, 2018 Test link

Find Out How It Did With 40,229 Visitors

  • Measured by offers started

  • Measured by sales from offers & direct buys

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

Added

Isolated

Test # 100 on Vivareal.com.br by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rodrigo Maués    Aug 01, 2017 Test link

Find Out How It Did With 203,704 Visitors

  • Measured by form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

Added

Isolated

Test # 112 on Glass.net by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Mark Freedle    Jul 14, 2017 Test link

Find Out How It Did With 13,197 Visitors

  • Measured by visits to next screen

  • Measured by visits to thank you page

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Added

Isolated

Test # 109 on 3dhubs.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rob Draaijer    Jun 01, 2017 Test link

Find Out How It Did With 4,005 Visitors

  • Measured by placed quotes

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Removed

Isolated

Test # 85 on Vivareal.com.br by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rodrigo Maués    Mar 01, 2017 Test link

Find Out How It Did With 102,331 Visitors

  • Measured by lead form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.