We all have email inboxes littered with subject lines like the headline above. If they inspire any action, it’s usually to hit the Delete key.

Hyperbole and exclamation marks aren’t going to break through the clutter. But thanks to recent advances in statistical methods, modeling and analytics, leading marketers now have a far more powerful and sophisticated technique called experimental design.

The method allows marketers to increase exponentially the variables tested in a single campaign (product offers, messages, incentives, mail formats and so on) and to test multiple offers in the market simultaneously. Marketers learn exactly which variables entice consumers to act. As a result, response rates rise dramatically, the effectiveness of future campaigns improves and overall return on spending increases.

Companies spend huge sums on direct marketing to acquire or retain customers through email, direct mail, catalogs and other tactics. Yet the return on investment (ROI) is often poor because the response rates tend to be very low—usually less than 5% and often less than 0.5%—and rates have been declining.

Many organizations still use the traditional champion-challenger approach, also called A/B testing, to test new offers, because it’s relatively easy to execute and can be scaled up quickly. However, it has severe limitations: Only a few offers can be tested at a time, the variance is low so regression results are not meaningful, and one cannot identify which individual variables cause consumers to respond.

Experimental design offers a better approach. In Bain & Company’s work with clients, we’ve seen experimental design-based multivariate marketing campaigns increase consumer response rates by three to eight times, adding hundreds of millions of dollars to the top and bottom lines.

Download PDF