Autoship 2.1 for Thrive Market

ABOUT

The introduction of Autoship, a subscription service option to Thrive Market, had a great impact to the company business. However, its complexity created some pains to the user experience that we needed to address.


Team

  • Lauren Braen: Product Manager

  • James Meeks: Head of Product and Design


My Role

  • Digital Product Designer (2020 - 2021)

  • Usability tests

  • Design for A/B tests


Time and Place

  • June 2021

  • Los Angeles, California

 
 
 

About Autoship

Described as "Costco meets Whole Foods", Thrive Market's business model is designed to simplify the supply chain of healthy and organic foods by eliminating the markup typically applied by brick-and-mortar grocery stores.

Autoship is Thrive Market’s recurring shipment service. Customers can add items to Autoship, deciding on quantity, next ship date and frequency, and then get shipped their subscription boxes accordingly.

During my experience at Thrive Market, Autoship went from being a secondary business unit to the core business for the company. And I was the product designer assigned to it.

 
 
 

The Opportunity: Auto Opt-in

As part of a business strategy decision, new Thrive Market members where automatically opted-in to the recurring deliveries shopping model, which, compared to the Manual Opt-in variant, resulted in:

  • 39% higher engagement in the Autoship program

  • 30% higher Revenue/Member/Day

  • 17% higher drops from the program but with twice of CVR at the long term

This is what we called ‘Autoship 2.1’

 
 

The Challenges

The implementation of Autoship 2.1 in parallel to the regular shopping cart created pains for the experience. Some examples of customer feedback themes:

  • Having two carts (main shopping cart AND next shipment cart) created confusion.

  • Adding items from the cart to the next shipment cart created duplicated items shipped to our customers

  • Uncertainty of when customers would receive their first order

 

One of the common themes of customer feedback was the unexpected duplication of items showing up within both shopping carts.

 
 

IMPROVEMENT Example #1

Navigation Refactor

Something we quickly thought about when trying to reduce the confusion of having two carts was to re-organize the product’s navigation, looking for a possibility to surface Autoship Next Shipment to the top level. Our hypothesis was that if we made it more accessible, customers would understand better the difference between Cart and Next Shipment.

Methodology

Task-driven, unmoderated preference test sessions comparing:

  • Control: current experience (Autoship hidden within My Items)

  • Variant: surfacing Autoship to the main navigation

Target Audience: Autoship active users, n=10

 
 

Control: Cart in top right and Autoship under My Items. To access Autoship, users had to click on My Items.

Variant A: Surfacing Autoship under bottom navigation, instead of ‘Deals’

 
 
 

Results

  • 4/10 did not notice the difference* between Variant A and Control

  • Out of 6/10 who saw the difference, all preferred the Variant A

 
 

Usability Test Takeaways

This usability test gave us confidence that the change had the potential of improving the experience, and that resulting in higher engagement with Autoship, hence higher customer lifecycle value. We proposed an A/B test replicating the experiment but in a quantitative way, and given its proven success, we changed the navigation for all of our customers.

 
 

Improvement example #2

Improved Confirmation Sheet

On the received feedback about customers not being sure about dates in which they would be receiving items added to Autoship, we improved the confirmation sheet, to include besides quantity:

  • The ability to change for which shipment they would like to include it next

  • With which frequency they would like to receive the item

  • The ability delete the item in case they wanted to

As all features in Thrive Market, we soft-launched this improvement through a controlled A/B Test, starting with 5% of traffic, and once verified KPI improvements and stability, we ramped to 100%.

 

General Conclusion and Takeaways

Autoship was a great challenge to be assigned to as a designer. I had the opportunity to work on a key business for the company, a complex experience for customers, and to work arm to arm with different stakeholders such as Product Manager, Developers, Business Planners, and Data Scientists.

The shared above examples, are just a few of all improvements we worked on sprint after sprint.