by Robyn Bolton | Dec 4, 2023 | Innovation, Metrics
“I would argue that it was an innovation success!”
At that moment, I started to deeply empathize with Alice because I felt like I was tumbling down the rabbit hole.
For the previous several minutes, I had been on one of my usual soapboxes – Innovation needs to generate quantifiable, and specifically financial, results; otherwise, it’s theater at best and performative lie at worst. As Alexander Osterwalder says, “ROI is the only thing that matters in innovation.”
That’s when my conversation partner brought up Kickbox.
Way back in 2012, Adobe’s Chief Strategist and VP of Creativity, Mark Randall, packed “everything an employee needs to generate, prototype, and test a new idea” into a little red box to encourage employees to unleash their inner innovator. One thousand Kickboxes were distributed to interested employees in that first year.
In the decade since, Kickbox has been used at thousands of organizations from multi-nationals (3M, Cisco, Caterpillar, MasterCard, Swisscom, P&G, Roche, Implenia, Zurich Insurance) to educational institutions (ETH, UNSW, USC), government agencies (DARPA, United Nations) and non-profits (Peace Corp, Gates Foundation, Kickstart-Innovation, Careum). It is widely regarded as the world’s most “successful” Intrapreneurship program.
But what does “successful” mean?
Widely adopted?
Highly regarded?
The source of:
- New projects (using Kickbox, Swisscom validated 400+ innovation projects in just two years)?
- New revenue?
- Cost savings?
- Higher profit?
Effective at:
- Increasing employee morale?
- Reducing employee turnover?
- Building a culture of innovation?
Something else?
For Kickbox, “success” means increasing employee engagement, creativity, and collaboration.
Let me be clear: this is an AWESOME outcome. Very few programs have even a temporary impact on employee engagement and the organization’s culture of innovation. So, to have a program that makes a measurable and lasting impact is incredible. To have a program that is so effective that other organizations around the world adopt it AND experience similar benefits is almost unbelievable,
But is that enough?
If Kickbox was the ONLY thing Adobe did to encourage innovation, would Kickbox be considered a success?
I don’t think so.
Kickbox was successful because it was part of a holistic approach to innovation. It was part of a portfolio of efforts to encourage employees to be more creative and collaborative and to build and acquire new sources of revenue.
If Kickbox was the only innovation effort Adobe invested in, it would not have lasted even the two years between its 2012 test and 2014 Adobe-wide launch. It would have been like all other hackathons, shark tanks, events, and gimmicks companies use to encourage innovation without thinking about how to carry on after the event.
Speaking of the two years from test to internal launch…
For Kickbox, “success” also means surviving internal scrutiny.
Each Kickbox contained instructions, a pen, two Post-It notepads, two notebooks, a Starbucks gift card, a bar of chocolate, and a $1,000 prepaid gift card that could be spent on anything the employee needed with NO need for approval, justification, or even an expense report.
Think about that for a moment.
The 1,000-box test cost $1M in gift cards PLUS the costs of all the other materials, and that’s before you factor in the costs of design, assembly, and distribution.
If Kickbox was a grassroots effort instead of one championed by the company’s Chief Strategist and VP of Creativity, a highly respected executive who joined Adobe when it acquired the company he led as CEO, would the company have spent $1M+ on the test and an additional two years refining the concept before launching to the rest of the organization?
I don’t think so.
Kickbox was successful because it survived financial scrutiny and organizational skepticism, protected by a senior executive motivated to deliver on a request to teach his skills and approach to innovation to the rest of a giant organization.
“Success” ultimately means money.
After a week of tumbling, I think that I may have reached the bottom of the rabbit hole and a way to reconcile my money-grubbing capitalist view of innovation with my colleague’s extremely true and data-based assertion that success can be something much softer and more intangible.
Yes, and.
Yes, a successful innovation can be something with qualitative benefits, AND those benefits need to translate into quantifiable (financial) benefits, AND it needs a senior executive to shepherd it through the years of scrutiny and skepticism that kill most efforts.
After all, employee engagement, lower turnover, and more ideas have quantifiable and meaningful financial benefits. So, ultimately, it is all about the money.
Or maybe I’m still in Wonderland.
What do you think?
by Robyn Bolton | Aug 21, 2023 | Innovation, Leadership, Metrics, Tips, Tricks, & Tools
You are a rolling stone, and that means you gather no moss! You read the September issue of HBR (and maybe last week’s article), tossed out your innovation portfolio, and wove yourself an innovation basket to “differentiate the concept from finance and avoid the mistake of treating projects like financial securities, where the goal is usually to maximize returns through diversification [and instead] remember that innovation projects are creative acts.”
Then you explained this to your CFO and received side-eye so devastating it would make Sophie Loren proud.
The reality is that the innovation projects you’re working on are investments, and because they’re risky, diversification is the best way to maximize the returns your company needs.
But it’s not the only way we should communicate, evaluate, and treat them.
Different innovation basket views for different customers
When compiling an innovation basket, the highest priority is having a single source of truth. If people in the organization disagree on what is in and out of the basket, how you measure and manage the portfolio doesn’t matter.
But a single source of truth doesn’t mean you can’t look at that truth from multiple angles.
Having multiple views showing the whole basket while being customized to address each of your internal customer’s Jobs to be Done will turbocharge your ability to get support and resources.
The CFO: What returns will we get and when?
The classic core/adjacent/transformational portfolio is your answer. By examining each project based on where to play (markets and customers) and how to win (offerings, profit models, key resources and activities), you can quickly assess each project’s relative riskiness, potential return, time to ROI, and resource requirements.
The CEO: How does this support and accelerate our strategic priorities?
This is where the new innovation basket is most helpful. By starting with the company’s strategic goals and asking, “What needs to change to achieve our strategy?” leadership teams immediately align innovation goals with corporate strategic priorities. When projects and investments are placed at the intersection of the goal they support, and the mechanism of value creation (e.g., product, process, brand), the CEO can quickly see how investments align with strategic priorities and actively engage in reallocation decisions.
You: Will any of these ever see the light of day?
As much as you hope the answer is “Yes!”, you know the answer is “Some. Maybe. Hopefully.” You also know that the “some” that survive might not be the biggest or the best of the basket. They’ll be the most palatable.
Ignoring that fact won’t make it untrue. Instead, acknowledge it and use it to expand stakeholders’ palates.
Start by articulating your organization’s identity, the answers to “who we are” and “what we do.”
Then place each innovation in one of three buckets based on its fit with the organization’s identity:
- Identity-enhancing innovations that enhance or strengthen the identity
- Identity-stretching innovations that “do not fit with the core of an organization’s identity, but are related enough that if the scope of organizational identity were expanded, the innovation would fit.”
- Identity-challenging innovations that are “in direct conflict with the existing organizational identity.”
It probably won’t surprise you that identity-enhancing innovations are far more likely to receive internal support than identity-challenging innovations. But what may surprise you is that core, adjacent, and transformational innovations can all be identity-enhancing.
For example, Luxxotica and Bausch & Lomb are both in the vision correction industry (eyeglasses and contact lenses, respectively) but have very different identities. Luxxotica views itself as “an eyewear company,” while Bausch & Lomb sees itself as an “eye health company” (apologies for the puns).
When laser-vision correction surgery became widely available, Bausch & Lomb was an early investor because, while the technology would be considered a breakthrough innovation, it was also identity-enhancing. A decade later, Bausch & Lomb’s surgical solutions and ophthalmic pharmaceuticals businesses account for 38% of the company’s revenue and one-third of the growth.
One basket. Multiple Views. All the Answers.
Words are powerful, and using a new one, especially in writing, can change your behavior and brain. But calling a portfolio a basket won’t change the results of your innovation efforts. To do that, you need to understand why you have a basket and look at it in all the ways required to maximize creativity, measure results, and avoid stakeholder side-eye.
by Robyn Bolton | Jul 24, 2022 | Customer Centricity, Innovation, Leadership, Metrics, Stories & Examples, Strategy
Many years ago, Clay Christensen visited his firm where I was a partner and told us a story*.
“I imagine the day I die and present myself at the entrance to Heaven,” he said. “The Lord will show me around, and the beauty and majesty will overcome me. Eventually, I will notice that there are no numbers or data in Heaven, and I will ask the Lord why that is.”
“Data lies,” the Lord will respond. “Nothing that lies can be in Heaven. So, if people want data, I tell them to go to Hell.”
We all chuckled at the punchline and at the strength of the language Clay used (if you ever met him, you know that he was an incredibly gentle and soft-spoken man, so using the phrase “go to Hell” was the equivalent of your parents unleashing a five-minute long expletive-laden rant).
“If you want data, go to Hell.”
Clay’s statement seems absolutely blasphemous, especially in a society that views quantitative data as the ultimate source of truth:
- “In God we trust. All others bring data.” W. Edward Deming, founding Father of Total Quality Management (TQM)
- “Above all else, show the data.” – Edward R. Tufte, a pioneer in the field of data visualization
- “What gets measured gets managed” – Peter Drucker, father of modern management studies
But it’s not entirely wrong.
Quantitative Data’s blessing: A sense of safety
As humans, we crave certainty and safety. This was true millennia ago when we needed to know whether the rustling in the leaves was the wind or a hungry predator preparing to leap and tear us limb from lime. And it’s true today when we must make billion-dollar decisions about buying companies, launching products, and expanding into new geographies.
We rely on data about company valuation and cash flow, market size and growth, and competitor size and strategy to make big decisions, trusting that it is accurate and will continue to be true for the foreseeable future.
Quantitative Data’s curse: The past does not predict the future
As leaders navigating an increasingly VUCA world, we know we must prepare for multiple scenarios, operate with agility, and be willing to pivot when change happens.
Yet we rely on data that describes the past.
We can extrapolate it, build forecasts, and create models, but the data will never tell us with certainty what will happen in the future. It can’t even tell us the Why (drivers, causal mechanisms) behind the What it describes.
The Answer: And not Or
Quantitative data Is useful. It gives us the sense of safety we need to operate in a world of uncertainty and a starting point from which to imagine the future(s).
But, it is not enough to give the clarity or confidence we need to make decisions leading to future growth and lasting competitive advantage.
To make those decisions, we need quantitative data AND qualitative insights.
We need numbers and humans.
Qualitative Insight’s blessing: A view into the future
Humans are the source of data. Our beliefs, motivations, aspirations, and actions are tracked and measured, and turned into numbers that describe what we believed, wanted, and did in the past.
By understanding human beliefs, motivations, and aspirations (and capturing them as qualitative insights), we gain insight into why we believed, wanted, and did those things and, as a result, how those beliefs, motivations, aspirations, and actions could change and be changed. With these insights, we can develop strategies and plans to change or maintain beliefs and motivations and anticipate and prepare for events that could accelerate or hinder our goals. And yes, these insights can be quantified.
Qualitative Insight’s curse: We must be brave
When discussing the merit of pursuing or applying qualitative research, it’s not uncommon for someone to trot out the saying (erroneously attributed to Henry Ford), “If I asked people what they wanted, they would have said a horse that goes twice as fast and eats half as much.”
Pushing against that assertion requires you to be brave. To let go of your desire for certainty and safety, take a risk, and be intellectually brave.
Being brave is hard. Staying safe is easy. It’s rational. It’s what any reasonable person would do. But safe, rational, and reasonable people rarely change the world.
One more story
In 1980, McKinsey predicted that the worldwide market for cell phones would max out at 900,000 subscribers. They based this prediction on solid data, analyzed by some of the most intelligent people in business. The data and resulting recommendations made sense when presented to AT&T, McKinsey’s client.
Five years later, there were 340,213 subscribers, and McKinsey looked pretty smart. In 1990, there were 5.3 million subscribers, almost 6x McKinsey’s prediction. In 1994, there were 24.1M subscribers in the US alone (27x McKinsey’s global forecast), and AT&T was forced to pay $12.6B to acquire McCaw Cellular.
Should AT&T have told McKinsey to “go to Hell?” No.
Should AT&T have thanked McKinsey for going to (and through) Hell to get the data, then asked whether they swung by earth to talk to humans and understand their Jobs to be Done around communication? Yes.
Because, as Box founder Aaron Levie reminds us,
“Sizing the market for a disruptor based on an incumbent’s market is like sizing a car industry off how many horses there were in 1910.”
* Except for the last line, these probably (definitely) weren’t his exact words, but they are an accurate representation of what I remember him saying
by Robyn Bolton | Mar 29, 2022 | Innovation, Leadership, Metrics, Strategy
“We need to be more innovative.”
How many times have you said or heard that? It’s how most innovation efforts start. It’s a statement that reflects leaders’ genuine desire to return to the “good ol’ days” when the company routinely created and launched new products and enjoyed the publicity and growth that followed.
But what does it mean to “be more innovative?”
Innovation’s ABCs
A is for Architecture
Architecture includes most of the elements people think of when they start the work to become more innovative – strategy, structure, processes, metrics, governance, and incentives.
Each of these elements answers fundamental questions:
- Strategy: Why is innovation important? How does it contribute to our overall strategy?
- Structure: Who does the work of innovation?
- Process: How is the work done?
- Metrics: How will we know when we’re successful? How will we measure progress?
- Governance: Who makes decisions? How and when are decisions made?
- Incentives: Why should people invest their time, money, and political capital? How will they be rewarded?
When it comes to your business, you can answer all these questions. The same is true if you’re serious about innovation. If you can’t answer the questions, you have work to do. If you don’t want to do the work, then you don’t want to be innovative. You want to look innovative*.
B is for Behavior
Innovation isn’t an idea problem. It’s a leadership problem.
Leaders that talk about innovation, delegate it to subordinates and routinely pull resources from innovation to “shore up” current operations don’t want to be innovative. They want to look innovative.
Leaders who roll up their sleeves and work alongside innovation teams, ask questions and listen with open minds, and invest and protect innovation resources want to be innovative.
To be fair, it’s incredibly challenging to be a great leader of both innovation and operations. It’s the equivalent of writing equally well with your right and left hands. But it is possible. More importantly, it’s essential.
C is for Culture
Culture is invisible, pervasive, and personal. It is also the make-or-break factor for innovation because it surrounds innovation architecture, teams, and leaders.
Culture can expand to encourage and support exploration, creativity, and risk-taking. Or it can constrict, unleashing antibodies that swarm, suffocate, and kill anything that threatens the status quo.
Trying to control or change culture is like trying to hold water in your fist. But if you let go just a bit, create the right conditions, and wait patiently, change is possible.
Easy as 123
The most common mistake executives make in the pursuit of being “more innovative” is that they focus on only A or only B or only C. But, as I always tell my clients, the answer is “and, not or.”
- Start with Architecture because it’s logical, rational, and produces tangible outputs like org charts, process flows, and instruction manuals filled with templates and tools. Architecture is comforting because it helps us know what to do and how.
- Use Architecture to encourage Behavior because the best way to learn something is to do it. With Architecture in place (but well before it’s finished), bring leaders into the work – talking to customers, sharing their ideas, and creating prototypes. When leaders do the work of innovation, they quickly realize what’s possible (and what’s not) and are open to learning how to engage (behave) in a way that supports innovation.
- Leverage Architecture and Behavior to engage Culture by creating the artifacts, rituals, and evidence that innovation can happen in your company, is happening and will continue to happen. As people see “innovation” evolve from a buzzword to a small investment to “the way we do business,” their skepticism will fade, and their support will grow.
Just like the Jackson 5 said
ABC, It’s easy a 123
Architecture, behavior, culture – they’re all essential to enabling an innovation capability that repeatedly creates new revenue.
And while starting with architecture, building new leadership behaviors, and investing until the culture changes isn’t easy, it’s the 123 steps required to “be more innovative.”
by Robyn Bolton | Apr 1, 2021 | Innovation, Metrics
Of all the facets of innovation, innovation metrics may be the most requested, studied, and debated.
This is not surprising given that companies need to justify the billions of dollars they spend every year on “innovation” and the best way to do that is through a sound set of metrics with proven predictive power and relevant benchmarks.
However, despite the need, and decades of work to address it, a satisfying answer to “what innovation metrics should we use?” is as elusive as ever.
The key word there is “satisfying”
Innovation metrics exist. There are probably hundreds of them.
Innovation metrics are in use. Maybe even at your company.
But one universal set of metrics with proven predictive power and relevant benchmarks? Nope, that doesn’t exist.
And it shouldn’t exist.
What innovation is, why it is pursued, and the investment of resources and time required varies from industry to industry and company to company. So, it makes no sense to apply a standard set of metrics to a custom approach and activity.
The trap of “satisfying” metrics
“What gets measured gets managed” is a trap (and also not true and Peter Drucker never said it).
It’s a trap because, as noted by monetary theorist Charles Goodhart noted, “Any statistical regularity will tend to collapse once pressure is placed upon it for control purposes.”
Or as us common folk (and anthropologist Marilyn Strathern) say, “When a measure becomes a target, it ceases to be a good measure.”
It is not satisfying when ideas become cobras
Although Goodhart’s Law was first articulated in 1975, it’s been in action for centuries. Consider the story of the British government’s bounty on cobras back when India was still a colony – to reduce the cobra population, the British government offered to pay people for every dead cobra they brought in. The money was good and eventually, people started raising cobras for the sole purpose of killing them to collect the county.
This is exactly what happens with most innovation metrics.
Because companies are so keen to measure and track progress, they set metrics they can measure. Those measurable metrics quickly become targets.
For example, one of my clients was eager to “fill their innovation funnel” and so they set a metric for the number of new ideas submitted each quarter. It didn’t take long before the innovation team spent most of the last day of each quarter frantically submitting “new ideas” so that they could hit the target.
The next day, they would go into the system and reject all the frantically submitted ideas because the ideas didn’t meet established qualitative criteria for strategic fit, scalability, or business potential.
At the end of the year, management was dumbfounded – despite getting thousands of ideas, the team had yet to pilot an idea, let alone launch a new business and generate revenue.
Metrics aren’t satisfying if they aren’t effective in achieving your ultimate goal
Was killing lots of cobras Britain’s ultimate goal? No.
They wanted to decrease the cobra population.
But killing cobras was a key step in decreasing the population and it was easier and faster to measure and track the number of cobras killed.
Was getting lots of ideas my client’s ultimate goal? No.
They needed to increase revenue by 50% in the next 5 years.
But getting ideas was a key step in creating a new stream of revenue and it was easier and faster to measure and track the number of ideas submitted.
How to Create Effective Innovation Metrics
State the ONE Why.
This is the hardest part of setting metrics because there are lots of reasons to pursue innovation. But we have to remember that innovation is a means to an end and effective metrics focus on the end, not the means.
I like to use the 5 Whys to get to the ultimate goal. Here’s a rough approximation (with completely made-up numbers) of the conversation I had with the client mentioned above:
- ME: Why do you want # of new ideas in the funnel each quarter?
- Client: Because we need that many to get 4 new products to pilot
- Me: Why do you need to pilot 4 new products?
- Client: Because we have a 50% pilot success rate
- Me: OK, so you need to launch 2 new products. Why two?
- Client: Because our new products generate $100M in Yr 1 revenue
- Me: Why do you need $200M in new revenue each year?
- Client: Because we have a $1B gap between what we promised to shareholders and what we’re on track to deliver in 5 years
Their ultimate goal was to close a $1B revenue gap in 5 years, not generate # new ideas per year.
Set interim milestones.
Achieving an ultimate goal takes years of hard work and you may need to pivot or readjust expectations along the way. For that reason, it’s important to set interim milestones, not as decision points but as markers for when to pull your head out of the day-to-day details and assess whether or not you are on track and, if not, what you need to change.
Using the same client as an example, we could have decided that $1B in new revenue in 5 years meant that we needed to generate $200M in new revenue every year. But, as we talked through things, we realized that it would take time to fill the innovation funnel AND build the organizational capability to develop, test, and launch new products. As a result, we should set revenue goals that increased each year, reflecting the organization’s increasing innovation effectiveness.
Explore the MANY Hows.
Innovation may be one way to achieve your ultimate goal but there are lots of others and it’s important to stay open to all of them.
For my client, we quickly realized that it wasn’t reasonable to rely solely on organic innovation to close the $1B revenue gap. Instead, we needed to explore multiple approaches from organic innovation to M&A and everything in between.
In closing…
It’s easy to fall into the trap of “satisfying” metrics that measure activity.
It’s a bit harder to evade the trap by identifying effective metrics that measure progress to an ultimate goal.
But, I can assure you, achieving that ultimate goal is way beyond satisfying.
