How to Use Six Sigma for Membership Offer Testing

If your sales are plateauing or losing steam, consider the last time you aggressively tried membership offer testing.

subscription offer testing

“Never stop testing, and your advertising will never stop improving,” said David Ogilvy, known as “The Father of Advertising” and the “Original Mad Man”.

Even our best-performing publishing partners—who publish on multiple platforms, run several premium membership websites, and have helped define our pricing best practices—will see a drop in paid subscriptions or memberships when they stop testing. We told this to a premium content partner who went from having some of the highest conversion rates of our partners to having our worst performing rates, and we believed the culprit was a lack of subscription and membership offer testing with new offers, like a low-priced intro offer.

As Ogilvy made known, when you stop testing offers and creative, they fatigue. It’s that simple.

In response, we launched a high-frequency Six Sigma email program focused on selling more premium memberships. We increased the number of promotional spotlights from the standard 2-3X per week to 5X per week and introduced editorially-driven creative to alternate between offer-driven creative. We saw a 70% increase in their NOPX (new orders per 10K email subscribers) from this program.

The email campaigns are typically planned and measured in one-month cycles, where we identify the best performing spotlights and the worst performing spotlights in a given month-long cycle. We keep the winners and include them in the next month-long email cycle, and we replace the losers with brand new creative.

Meanwhile, we also test the offer. For example, for this particular partner, we ran one offer for one month and we ran a different offer the next month. The reason we do sequential testing is because of the multi-device nature in which our consumers engage with our content.

In sequential testing, there is a control for each odd numbered month of the year and a separate control for each even month of the year where we follow the protocols described.

Split testing is another route, where the offers being tested are run out to two segments of equal size for promotional Spotlight emails. This email-only offer is usually a sale or a survey that is not available to web visitors. It is often offered for a limited time so that urgency can be part of the multi-effort campaign.

While either approach is a significant amount of work, requiring active coordination between editorial and marketing, on-the-spot analytics, great copywriting, and interaction with fulfillment to manage the offers, we strongly recommend all publishers use these methods for offer testing.

Why do we call this Six Sigma and how is Six Sigma applied in membership offer testing? 

Six Sigma is a disciplined, data-driven approach for the continuous improvement of any product, process or service. When applied to email and direct marketing, it seeks to continuously remove the weakest performing campaigns and replace them with better performing campaigns.

In membership website marketing, we adapt this structure to continuously test both offers and creative. Thanks to digital delivery and the power of continuous service, we’re able to get creative with offer testing.

And while it is possible to find the ultimate offer or a selection of 2 or 3 from the many that can be rotated for maximum impact, the bigger emphasis is on the email creative testing that’s happening simultaneously with the offer testing. The high-frequency email spotlight testing described above is the only answer we’ve found to beat the fatigue. We believe the email spotlights are where we are making the most impact on increasing sales.

Another leverage point we get from identifying winning email creative is that we’re able to roll the winning copy out in other channels like web and social.

The least successful membership offer testing results show the full-priced hard offer is a loser

Selling your magazine without a free intro, or low-priced offer can be tough. We’ve seen hard offers work with low intro prices, but at full price, selling these alone can be a tough way to make a living.

Full-priced hard offers typically deliver only 25% of the response that can be generated using low-priced offers, or soft offers such as free trials and free issues. We experience a higher response rate when we test low price offers or trial offers that include incentives such as membership bundles, free special issues, or other digital content available only to premium members.

Before the Internet and email, that 25% could have still been a good strategy because it saved publishers a ton of money in mailing bills and conversion series efforts. In today’s world that advantage has disappeared and so we are more encouraged to offer aggressive introductory offers to build our subscriber base.

With introductory pricing, we recommend using two different prices for new subscribers and renewals. Low introductory prices that are targeted only to non-buyers are powerful tools in the membership marketing toolbox. From the low introductory price, new subscribers pay the full price upon renewal given the economic behaviorism associated with credit card continuous service.

Start thinking about new ways you can begin membership offer testing and how you’re going to leverage your editorial team and their expertise to craft intriguing copy specific to what the consumer will find in the current or archived issue of the magazine you’re promoting. Start coordinating with your fulfillment team to create different offer types to include low price offers and free trials, as well as monthly price points billed quarterly, or bi-monthly, or annually. So many options, let the fun begin!


Leave a Reply