All Latest 534 A/B Tests

In this experiment, a 3 step progress bar was added starting on a checkout funnel (dedicated add-to-cart page, greeting card step and order summary). The progress bar also showed any completed steps as a "checked off" state. More so, users were able to use the progress bar as a navigation item to any previously completed and currently active steps. Impact on sales was measured.

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

The idea of this experiment was at least two fold. 1) the variation attempted to clarify that there is no payment today with the copy "Pay 0€ today" on the collapsed state of the payment amount. 2) clarify the payment terms with exact dates and amounts for future payments.

In this experiment, left column filters (control) were tested against top-aligned and sticky filters (variation). The hypothesis was to increase their visibility. Impact on their use and progression to next step (product/tour detail page) were measured.

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Desktop Only)

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and an add to cart button (add to cart). Impact on sales was measured. (Mobile Only)

In this experiment, free shipping was a/b tested against free shipping with a 30€ purchase or higher. Hence, in the variation, customers needed to reach a cart amount total in order to be eligible for the free shipping. 

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Desktop Only)

A sticky floating navigation bar was tested on product pages. The floating navigation contained: the product name, price and two add to cart buttons (add to cart; pickup in store). Impact on sales was measured. (Mobile only)

In this experiment, a preset coupon code with -15% amount and an easy to "apply" button was shown to new users who have never made a purchase. In the variation, the an empty coupon field was shown. Impact and transactions and revenue was measured.

In this experiment, existing reassurance copy was changed. The control contained copy that focused on splitting payments and paying over time. The variation challenged this and showed a best price guarantee and the ability to earn credits. 

In this experiment, a floating page level navigation was added near the top of the product pages (under the main image). The navigation links included: Overview, Itinerary, What's Included, Operator, Reviews and Availability. Impact on next step progression was measured.

Instead of only displaying sort and filters at the top of a listing page, the variation always had them visible with a sticky/floating interaction. Impact on sales was measured.

In this product landing page experiment, the plan sort order was rearranged. In the control it was sorted from least expensive to most expensive. In the variation, the plans were shown as most expensive first. Impact on sales and revenue was measured.

In this experiment, an inline panel was shown as a product tile. The panel informed customers about a variety of payment options (with detailed information being further presented after a button click). Impact on sales was measured.

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

In this signup flow experiment, form fields on the right hand side (control) were shifted to the left column (variation). Impact on account creations and checkouts was measured.

In this experiment, a modal based message was shown to encourage extra products being added as complementary upsells. In the control, the promotion text appeared at the bottom as red text ("Buy one, get up to two 50% Off"). Whereas in the variation, specific products were shown on the modal (post add-to-cart). Impact on adds-to-cart, sales and average revenue was measured.

In this experiment, a single image carousel gallery was replaced with a grid gallery. In addition the variation also used: taller swatches; a wider size box, added fit (slim, relaxed, straight, wide) options; and used a wider Add to Cart CTA (full width of the column). Impact on sales was measured.

In this experiment, social proof copy was added just below product photos. The copy emphasied that "3 million satisfied customers" and "10 million deliveries since 2003". Impact on sales was measured.