Holdout groups

Hold a few back, and know what the rest achieved

Hold a few back, and know what the rest achieved

Hold a few back, and know what the rest achieved

Hold a few back, and know what the rest achieved

Hold a few back, and know what the rest achieved

Hold back a share of customers automatically, and know what the rest of the program achieved because of it. Set a percentage for any campaign, journey, or the whole program, and let Leat draw the group and keep the baseline clean. Because the holdout applies across every channel the program touches, nothing contaminates the comparison you're relying on.

01

01

01

A setting on every campaign and journey

A setting on every campaign and journey

A setting on every campaign and journey

Set a holdout percentage when a campaign launches or a journey goes live. Leat draws the group at random from the eligible audience so the two groups match, holds them out for the measurement period, and hands the comparison to incrementality measurement when the period closes. There's no list to build, nothing to remember, and no way to forget who was held out, because the platform did it.

02

02

02

Held out everywhere, and from the engine too

Held out everywhere, and from the engine too

Held out everywhere, and from the engine too

A customer in a campaign's holdout receives nothing from that campaign: no email, no wallet notification, no reward visible at the till, no offer chosen by Decisioning. Because every channel runs from one record, the holdout holds across all of them. A baseline contaminated by a channel that didn't know about the holdout is no baseline, and here there's no such channel.

03

03

03

A standing control group for the whole program

A standing control group for the whole program

A standing control group for the whole program

Beyond individual campaigns, hold back a small share of members from every incentive the program issues. Those customers still earn as members, still see their balance, still get what they're owed; they receive no promotional incentives at all. Their behavior against everyone else's is the incrementality of the program itself: what loyalty spend is worth in total, which is the number finance has never had.

04

04

04

Sized, rotated, and fair

Sized, rotated, and fair

Sized, rotated, and fair

Before launch, Leat shows the minimum holdout size needed for a reliable read on the audience and effect you expect, so the group is large enough to answer and no larger. Holdout membership rotates, so no customer is permanently excluded from offers. Segments you choose, such as VIPs or new members in their first month, can be exempt. Transactional messages and earned benefits are never held back. Every holdout and its members are recorded, so the baseline is auditable.

How teams use holdout groups

How teams use holdout groups

How teams use holdout groups

How teams use holdout groups

Program integrity

Keep stamps, points, and rewards worth what they're meant to be worth

Promotion governance

Hold eligibility, spend, and frequency limits in one place and apply them before any incentive is issued

Seasonal and limited-time campaigns

Launch and retire rewards on schedule without manual upkeep

Lapsed customer recovery

Spot fading visit patterns across locations before a customer quietly stops coming back

Location budget management

Give every site or franchisee an allowance that operates inside the group cap

Frequently asked questions.

Frequently asked questions.

Frequently asked questions.

Frequently asked questions.

Frequently asked questions.

Can’t find the answer you were looking for?

Can’t find the answer you were looking for?

  • What is a holdout group?

  • How large should a holdout be?

  • Can I run a control group?

  • Are the same customers in the holdout group every time?

  • How long are customers in a holdout group for?

  • What is a holdout group?

  • How large should a holdout be?

  • Can I run a control group?

  • Are the same customers in the holdout group every time?

  • How long are customers in a holdout group for?

Start unifying

your loyalty.

Start unifying

your loyalty.

Start unifying your loyalty.

Start unifying

your loyalty.

Start unifying

your loyalty.