Website Logo
Contact Us

Designing an Experimentation North Star with Optimizely

8 January 2026

By: Isabelle Stephen, Account Manager and Optimisation Consultant

Categories: Optimizely

When experimentation runs without a North Star, a single, unifying measure of success, it quickly devolves into disconnected tests, unclear priorities, and “optimise-for-the-sake-of-optimising.” The result? Lots of activity, very little impact. 

A North Star metric transforms experimentation from a tactical activity into a strategic engine. Without it, even the most sophisticated experimentation platform becomes a scattergun of ideas, rather than a disciplined system for accelerated learning.

What makes a strong experimentation North Star?

  • Customer-centric – It must reflect value as the customer experiences it, not internal vanity measures. 
  • Leading, not lagging – Revenue is important, but it lags. Great North Stars are ambassadors for revenue acceleration. 
  • Sensitive to experimentation – Teams need to be able to influence it through tests. If experiments can’t move it, it’s not a North Star. 

Common examples include: 

  • Task completion rate  
  • Activated users  
  • Revenue per active user  

These metrics are close to behaviour, close to value, and highly experiment-responsive. 

A North Star is only powerful when it shapes how experiments are designed, run, and interpreted. It forces teams to think beyond isolated test outcomes and to consider how a change influences the broader user journey.

A team sat round a table discussing user journey

Break the North Star into its controllable components. 

For example:
If your North Star is revenue per user, your decomposed submetrics might be: 

  • Product Page Engagement  
  • Add to Basket Completion  
  • Product Page Views  
  • Basket Page Views  
  • Checkout Form Completion 

Not all uplifts are created equal

The difference between good experimentation programmes and great ones is simple: 

Good programmes deliver small wins, great programmes deliver organisational learning.

A 1% improvement in Checkout Completion often outweighs a 10% improvement in Product Page Views, and a strong experimentation programme understands these leverage points clearly. Mapping sub‑metrics also reveals where hidden bottlenecks occur and helps teams identify where small, targeted experiments can materially shift the North Star.

OMVP-level practitioners help organisations evolve from optimisation to directional transformation, using experimentation to validate strategic leaps, not just microinteractions. 

With a well defined North Star experimentation comes: 

  • A source of truth for product and CX direction 
  • A multiplier for design and content investment 
  • A shared language across marketing, product, and engineering 
  • A way to de-risk innovation while accelerating momentum 

Optimizely provides the infrastructure for experimentation, analytics, feature rollouts, and behavioural insight, but the North Star provides the purpose. 

Go back

Loading contact form...