Planned vs Actual vs Actual Actual Business Value

Let’s start from the basics though. PI (Planning Increment) Objectives are used as a “back briefing” mechanism by Agile Teams on an Agile Release Train to share their plan for the PI and validate that they are indeed focusing on the highest priorities and are planning to deliver objectives that will be valuable for the business.

Business Owners (Business Executive, Product Management, System Architect) circulate between teams during PI Planning and score each PI Objective on a scale of 1..10 based on business value they ASSUME will be delivered in case this PI Objective is accomplished in the PI. This becomes the “Planned Business Value (BV)” for that objective.

Later on, during PI Inspect & Adapt (or earlier during System Demos) the same Business Owners circulate between the teams and score each of these PI Objectives again, this time on “Actual Business Value (BV)”. What does Actual mean here? Well, in most cases the evaluation is based on seeing a demo of a working solution and still making ASSUMPTIONS about what the actual value would be when the solution meeting this objective will be released and available to real users/customers.

Sorry, but while being much closer, that’s still not ACTUAL business value.

ACTUAL business value delivered can be evaluated only AFTER the solution is released. On most Agile Release Trains / SAFe contexts the PI I&A is too early to make this evaluation so you could understand why we’re still making assumptions at that stage.

But if we really care about outcomes and delivering value, we shouldn’t close the books on these PI Objectives and the PI at that point. We should get back to it later on and Inspect and Adapt based on real business value delivered.

If you’re with me, you’re probably asking what can we do about this? What is the right timing to get back and assess the ACTUAL actual Business Value? From a cadence perspective there are two main ways to do this.

The simplest is to take advantage of the Inspect and Adapt PI System Demo to review the ACTUAL business value delivered by the objectives in the PREVIOUS Planning Increment. E.g. if we’re now finishing PI 5, we’re assessing actual business value delivered by the objectives in PI 5 that will be released sometime during PI 6, as well as PI 4 objectives that hopefully got released during PI 5.

For each one of these PI 4 objectives, now should be a reasonable time to talk about things like — Have customers started to use this solution? Are they happy with it? Did it achieve the impact we had in mind for it? Did we stop incurring the cost of delay we had in mind when prioritising this? At this point, the 1..10 score should be data/evidence-driven.

If we AREN’T able to evaluate the actual business value at this point — that means there’s a short-circuit in our empiric feedback loop that we should work on fixing.

If we haven’t released the solution yet, then we should keep the actual score for this objective empty and get back to it in the next PI. This objective should still be “work in progress” from our perspective.

You might guess what’s the next aspect of this. Mentioning Work in Progress should be an obvious clue. The ART Kanban has a role in helping us out here as well. Features on the ART-level Kanban shouldn’t be considered DONE until we collected this feedback and evaluated the ACTUAL actual business value on them. They should hang out on the board — maybe in an area called “Feedback” or whatever you prefer.

I’ve been recommending this sort of ART-level Kanban Board structure for a long time now. Some of my enterprise-level clients have improved their Product Management practices dramatically through the accountability and follow-through that this practice encourages.

Just think about the impact on Product Management, Business Owners, Sales people asking for features, if they know they are accountable to the outcomes from these features after they’re released.

This brings us to an interesting question. Who’s accountable to delivering actual business value? Who’s accountable to delivering ACTUAL actual business value? Is it the Agile Team? Product Management? Business? Sales?

I’ve seen way too many teams frustrated when they deliver the objectives according to what they presented as the plan, and yet the actual business value score is lower than the plan because the Business Owners don’t think as much value will be actually delivered. When we’re moving from assumed actual to actual actual the gap can be even bigger. On one hand, in the spirit of transparency and being focused on value and outcomes rather than output, this is the right way to score the business value. It’s about value delivery rather than tracking to plans. On the other hand, you can probably understand the frustration here.

The way I see it, the only way out of this is to understand that the PI Objective plan vs actual vs ACTUAL isn’t an indication of the individual performance of either one of these roles. It’s an indication of the performance of the whole development value stream including the upstream activities related to choosing and prioritising features and the downstream activities related to selling the solution, convincing users/customers to use it, implementing it in the field, operating/supporting it.

That, together with Lean/Agile Leadership that emphasises principles such as Assuming Variability, Objective evaluation of working delivered systems, and relentless improvement of the whole value delivery cycle, is the key to focusing on learning from these surprises whether they are systemic and repeating or rare exceptions. A relentlessly improving organisation would inspect what’s the trend when it comes to plan vs actual vs actual actual for the whole ART and per specific PI Objectives and try to see what it can learn from when the value gap happens and does it happen for a specific type of objectives or in a specific area of the program/business.

Value is the goal of Lean and the fast delivery of value is the goal of SAFe. If we’re serious about that, We should raise our game when it comes to managing value as a first class citizen in SAFe. Business value on PI objectives is the perfect place for doing exactly that.

So, Next time you have PI Inspect & Adapt, don’t just look at the PI you’re finishing just now, take a look at the objectives from the previous PI as well. And on your ART-level Kanban only consider features done after evaluating actual business value delivered, ideally based on quantifiable metrics.

Connecting OKRs to SAFe portfolio governance is one of the most common integration challenges I help organizations solve. Explore SAFe and OKR advisory or let’s talk.