Leverage AI for Smarter KPIs

True Purpose of KPIs

Key Performance Indicators (KPIs) are quantifiable and measurable values that reflect your business performance. Tracking KPIs helps you monitor progress towards specific goals and objective and as a business owner you want to maximise every opportunity to increase your profits [1].

By monitoring KPIs you gain insights into business performance, enabling you to improve areas which scored unsatisfactory results in areas such as: competitiveness, profitability or operational efficiency, to name a few [2].

The better the quality of your data, the more valuable your KPIs become, enhancing your evidence-based decision-making. For this reason data must be regarded as a strategic asset by all in the organisation [3] .

What Gets Measured Gets Managed

Not surprisingly, you want to measure the right things – such aspects of your business which are directly linked to its survival and prosperity. This highlights the importance of aligning your KPIs with your business strategy and the strategic objectives.  

Moreover the definition of a KPI and its ultimate objective is of key importance. Imagine a situation where the number of patents in your organisation is expected to indicate the business’ innovativeness. In reality this KPI may encourage your team to go for quantity (large number of “worthless” patents stretching your budget) rather than quality (patents boosting your business’ value: market share, company valuation, revenue, etc.). When creating KPIs consider defining:

  • cause and effect of KPIs
  • KPIs which are SMART (specific, measurable, achievable, relevant, and time bound).


In summary, here are some characteristics of ineffective KPIs:

  • They are vague and too difficult to measure, which can impact employees’ engagement.
  • They are open to interpretation or easy to manipulate e.g. artificially inflating business performance, which prevents identifying the opportunity for improvement. 
  • They are not relevant to your business or industry, leading to wasted cost (data storage), effort (resources, energy) and time (redundancy of data).

Best Intentions Driving Unintended Negative Consequences

Even the best intentions can lead to the creation of KPIs that drive unintended, negative consequences and behaviours. 

Consider the following KPIs’ scenarios and evaluate their likely short- and long-term consequences on business performance:   

  • Number of calls/customers serviced per hour – this may result in rushed customer service, negatively impacting customer satisfaction and retention.
  • Reduction of operational cost – this may lead to a decline in product quality.
  • Number of patients treated in hospitals and practices – this could cause prioritisation of patients with less complex medical condition over those with more complex needs. 
  • Number of safety observations per month – which may drive inadequate quality and repetitiveness of observations raised.
  • Number of issues resolves -which may encourage quick fixes rather thorough root cause analysis to address the issue. 
  • Number of new software features – this could discourage thorough in-depth, leading to dysfunctional software and frustrated users. 


The importance of imagining or foreseeing relationship, both pros and cons, between KPIs and intended objectives cannot be overstated. 

Weakness of Legacy KPIs

Traditionally, executives have designed and defined KPIs based on their life-long experience and past market trends. This might have worked in times of stability, however today in an era marked with of uncertainty (growing inflation, rising energy prices¸ higher loan cost and fluctuating interest rates), KPIs defined in traditional way increasingly fail to deliver the insights leaders need to succeed today. Traditional KPIs fall short in tracking progress, aligning people and processes, prioritising resources, and advancing accountability.

A BCG’s survey reveals that 60% of managers believe that they need to improve their KPIs, with one-third (34%) already using AI to create new KPIs. Nine out of ten managers within that 34% agree or strongly agree that their KPIs have been improved by AI [4]. 

Source: BCG Survey, 2024

AI and SMART KPIs

Can AI make any difference? 

Smart KPIs powered by Artificial Intelligence (AI) have the potential to become a great support, differentiator, challenging and improving business assumptions around performance, profitability, and growth. 

Organisations that invest in algorithmic innovations to make their performance metrics more adaptive and predictive expect KPIs to become a source of strategic differentiation and value creation. Intelligent algorithms based on large data models are much better at “tracking” or imagining future trends, fresh perspectives and previously unimagined metrics.

These AI-powered KPIs are also expected to prevent undesirable outcomes, that may result from a failure to regularly re-examine assumptions underlying legacy KPIs.

Increasingly, companies are embedding governance processes and functions that oversee KPIs development and ensure detailed, accurate, and relevant performance data. The objective – a KPI’s quality is explicitly considered during its design and not as a coincidental afterthought [4].

Since “what gets measured gets managed”, better data drive unique opportunities for strategic differentiation and value creation. 

What is AI?

The third quarter of 2022 marked the moment when one branch of AI the Gen AI  exploded into the public consciousness and by 2023, it began to take root in the business world. АI, however, is a concept that has been with us since the 1950s.

Source: https://blogs.nvidia.com/blog/whats-difference-artificial-intelligence-machine-learning-deep-learning-ai/

AI exhibits the ability to learn on its own and integrate its existing knowledge to develop innovative and unconventional solutions without human involvement or intervention. It is worth noting that we don’t fully understand this process and, consequently, won’t be able to control it.
Machine Learning (ML) is a subset of AI that uses statistical learning algorithms to build systems capable of automatically learning and improving from experience without being programmed, whilst deep learning (a technique within ML technique) is inspired by how human brain filters information

Since the focus in this article is on Generative AI (also called Gen AI) it is worth mentioning that this form of AI is dominating recent discussions due to its perceived impact on increasing productivity for businesses and individuals. Such perception has been exemplified by tools such as ChatGPT, Gemini or LLaMa. 

How does it work? Gen AI relies on large language models (LLM) that access vast amounts of data. When you make a request (a prompt), the AI identified patterns and relationships in the datasets to provide a response. This may include fresh, although not necessarily new in my opinion, content such as text, image, video, audio, or software code [5]. 

Advantages and Weaknesses of Gen AI

In 2024, organisations and industries began rethinking their business processes and the value of human resources, pushing GenAI to the peak of what seems to be an overinflated expectation due to media hype and marketing. AI is yet to demonstrate advantages over human capabilities for complex decision making and problem-solving.

For now be mindful of some challenges with Gen AI: 

  • It can hallucinate and provide incorrect results
  • Quality and accuracy of outputs may be questionable due to poor learning data – the GIGO principle (garbage in, garbage out) 
  • Responses are based on patterns in data rather than a true comprehension of a problem
  • Your confidential business data may becoming part of training data
  • Confidential information inputted into Gen AI models may become publicly available, as already recorded and reported in 2023 [6]

Despite these challenges, AI’s phenomenal and unquestionable advantage is data analytics (especially large datasets) and insights generation. Organisations that create new KPIs using AI are more likely to see more efficiency, stronger alignment, increased collaboration and more accurate forecasts than organisations that do not create new KPIs using AI [4]. Why? Because AI with an access to large datasets has the ability to anticipate market conditions, supply chains, and consumer behaviour with greater precision.

Source: BCG Survey, 2024
Source: BCG Survey, 2024

Smart KPIs Pioneers

Here are a few examples of businesses using AI to generate their KPIs:

Example 1: Pernod Ricard, $10 Billion Global Spirits Business with strong history of mergers and acquisitions, distributing approximately 240 liquor brands in more than 70 countries

This company uses AI to deepen the connection between their profit margins and market share, which in the past were handled in silos – the first one by their finance and the second by the sales function. Today, instead of seeking to maximize each individual KPI, the spirits maker seeks to optimise both KPIs in concert. For instance, they analyse how profit improving commercial and marketing investments (e.g. media or in-store activation) influence market-share objectives. AI helps them better align market share KPIs, margin KPIs and required investment to reach both of them. In an interview with BCG Pierre-Yves Calloc’h, Pernod Ricard’s chief digital officer said: “If you can imagine moving a cursor between market share optimisation objectives and margin optimisation objectives, you need to know how the required investments vary to reach these objectives”. 

Given the sheer number of brands under Pernod Ricard’s umbrella, Calloc’h explains how measuring marketing impact at appropriate scales has long been a challenge for the company. This capability transformed how Pernod Ricard’s leadership allocates capital and balances its aspirations for profitability and market share [4]. 

Example 2: Schneider Electric, $34.2B French based Energy Distribution Company

This company models dynamic KPIs that:

  • compute how volatile weather influences trade-offs among KPIs related to energy costs, distributive load-balancing risks, and carbon footprints, and
  • anticipate market conditions, supply chains, and consumer behaviour with greater precision

Such dynamic KPIs invite businesses to anticipate changing and unpredictable environments and markets earlier and respond to them more effectively.

Whilst their Chief Governance Officer, Hervé Coureil, acknowledges that harnessing data can be costly and time-consuming, he contends this to be strategically necessary. “We want our KPIs to evolve over time because we don’t want to drive our business on legacy or vanity metrics,” he says. To ensure that KPIs develop in accord with changing objectives and new measurement capabilities, Coureil cosponsored a performance management office (PMO) to oversee performance standards. “We looked at performance measurement as one of our transformation drivers,” he says. The PMO helped top management evolve its portfolio of KPIs and align them with the company’s various operating units. It also pushed the businesses to become more data driven and analytically aware of the links between performance improvements, improved metrics, and enhanced outcomes [7].

Example 3: Singapore’s based DSB Bank

The bank leadership created cross-functional groups to improve its customer focus, customer service, and profitability. Departing from a traditional operational approach, where each department owned separate KPIs for its distinct customer touch points, they took three years to create a value map. That map enabled them to manage a “customer journey” that comprises outcomes in four categories: customer experience, employee experience, profitability, and risk. AI offered them fresh perspectives on visible and hidden performance patterns and identified key interdependencies among the performance drivers. According to Sameer Gupta, the group’s Chief Analytics Officer and Managing Director at DBS Bank, identifying interdependencies among drivers and KPIs was a fundamental shift that enabled all group members to see the same data, continually assess the factors driving different outcomes, and agilely respond [4].

Leadership Takeaways

To make AI effective in your efforts to improve performance measurement, you need these in place:

  • Data seen and treated as a strategic asset [3]
  • Strong cross-functional data governance
  • Aligned data governance frameworks and capabilities with specific KPIs, such as customer lifetime value (CLV), new recurring revenue, and employee experience 
  • Data governance identifying and labelling data which describes performance and informs performance measurement
  • Culture of change supporting value creation and empowered decision-making through smart KPIs, particularly when “breaking” historical siloes between functions, processes, and departments
  • Executives acclimated to working with algorithms that complement and augment KPIs’ development and continuous improvement
  • Ability to ask the right questions when crafting novel KPIs when using Gen AI.

Smart KPIs Generated by AI

Here are examples of ChatGPT-4o and Gemini prompted to imagine a brainstorming session where functional business leaders were invited to reimagine smart KPIs. Neither the prompts nor the responses have been modified.

Take a look how these suggestions demonstrate the potential of Gen AI to generate innovative and impactful KPIs that align with business goals and improve overall performance. As generative AI continues to evolve, trained on new data, its influence on KPI design and development is bound to grow stronger. 

Have you used AI to create your business’s performance metrics and seen the value? Please feel free to share your experience.

CASE STUDY 1 – ChatGPT-4o

ChatGPT-4o Prompt 1

ChatGPT-4o Response 1

To propose high-impact Key Performance Indicators (KPIs) for Customer Lifetime Value (CLV) and customer relationship management, it’s crucial to gather comprehensive inputs and guide the brainstorming session with well-defined prompts. While I can’t access real-time data directly, I can suggest a structured approach and key inputs that you can gather and analyze to develop these KPIs. Here’s a detailed plan:

Inputs Required for High-Impact KPIs:

  1. Historical Customer Data:
    • Customer demographics (age, location, etc.)
    • Purchase history and frequency
    • Average purchase value
    • Customer tenure
    • Channel preferences (online, in-store, etc.)
  2. Customer Segmentation:
    • Customer personas
    • Segmentation based on buying behavior, engagement levels, and value
  3. Customer Feedback and Sentiment Analysis:
    • Net Promoter Score (NPS)
    • Customer satisfaction surveys
    • Social media sentiment analysis
  4. Financial Metrics:
    • Revenue per customer
    • Profit margins per customer segment
    • Cost of customer acquisition (CAC)
    • Customer retention costs
  5. Engagement and Interaction Metrics:
    • Frequency and type of interactions (customer service contacts, website visits, app usage)
    • Engagement rates with marketing campaigns
    • Loyalty program participation and rewards redemption rates
  6. Market and Competitive Analysis:
    • Industry benchmarks for CLV
    • Competitive analysis on customer engagement and retention strategies
  7. Predictive Analytics:
    • Churn prediction models
    • Lifetime value prediction models based on current data trends


Prompts for Brainstorming Session:

  1. Understanding the Customer Journey:
    • “How do we currently define and track the customer journey? Are there gaps or opportunities in our data collection?”
    • “What are the key touchpoints where we can significantly impact the customer experience?”
  2. Enhancing Customer Engagement:
    • “What metrics can we use to measure the effectiveness of our engagement strategies?”
    • “How can we quantify the impact of personalized experiences on customer loyalty and lifetime value?”
  3. Optimizing Customer Retention:
    • “What are the leading indicators of customer churn in our data? How can we use these to predict and prevent churn?”
    • “What strategies have been most effective in retaining high-value customers?”
  4. Maximizing Customer Lifetime Value:
    • “How can we better segment our customers to tailor marketing and sales strategies?”
    • “What innovative KPIs can we use to measure the potential future value of customers?”
  5. Integrating Financial and Behavioral Metrics:
    • “How can we align financial metrics like profit margins with behavioral metrics like engagement and satisfaction?”
    • “What role does customer feedback play in refining our financial projections and strategies?”
  6. Leveraging Technology and Analytics:
    • “What new technologies can help us gather more accurate and real-time customer data?”
    • “How can predictive analytics improve our understanding and forecasting of customer behavior and value?”


Real-Time Data Support:

While I can’t directly access real-time data, I recommend setting up a robust data infrastructure that includes:

  • Customer Relationship Management (CRM) Systems: For real-time tracking of customer interactions and sales.
  • Data Analytics Tools: For analyzing trends and predictive modeling.
  • Customer Feedback Platforms: For gathering and analyzing real-time customer feedback and sentiment.

These systems will provide the necessary data to develop, refine, and track high-impact KPIs for CLV and overall customer relationship management.

ChatGPT-4o Prompt 2

ChatGPT-4o Response 2

With access to comprehensive data and information, here are some innovative KPIs that can be brainstormed to measure the potential future value of customers:

  1. Customer Lifetime Value Forecast (CLV-F):
  • Definition: A predictive metric estimating the total value a customer will bring to the company over the entire relationship, based on historical data, current engagement, and future potential.
  • Components:
    • Past purchase behavior
    • Predicted future purchases
    • Customer engagement levels
    • Churn probability
  1. Engagement Score:
  • Definition: A composite score measuring a customer’s interaction frequency and quality across multiple channels (e.g., website, social media, customer support).
  • Components:
    • Interaction frequency (logins, visits, clicks)
    • Duration of interactions
    • Response to marketing campaigns
    • Social media mentions and activity
  1. Customer Growth Potential Index (CGPI):
  • Definition: A metric that evaluates the potential for upselling and cross-selling opportunities based on customer segmentation and buying patterns.
  • Components:
    • Purchase history and patterns
    • Product and service adoption rates
    • Engagement with new product launches or features
    • Responsiveness to upselling and cross-selling efforts
  1. Customer Experience Quality Score (CEQS):
  • Definition: A KPI assessing the overall quality of the customer experience, using a combination of customer satisfaction scores, NPS, and sentiment analysis.
  • Components:
    • Customer satisfaction surveys
    • Net Promoter Score (NPS)
    • Social media sentiment analysis
    • Customer service interaction quality
  1. Predictive Churn Risk (PCR):
  • Definition: A predictive metric indicating the likelihood of a customer discontinuing their relationship with the company within a specific timeframe.
  • Components:
    • Historical churn data
    • Current engagement and purchase frequency
    • Changes in interaction patterns
    • Customer service issue resolution times
  1. Customer Advocacy Potential (CAP):
  • Definition: A KPI that predicts the likelihood of customers becoming brand advocates, based on their satisfaction, engagement, and social media activity.
  • Components:
    • NPS and customer satisfaction scores
    • Frequency and tone of social media mentions
    • Participation in referral programs
    • Engagement with advocacy campaigns
  1. Product Adoption Velocity (PAV):
  • Definition: Measures the speed at which customers adopt new products, services, or features, indicating their openness to innovation and additional value.
  • Components:
    • Time from product launch to adoption
    • Adoption rates by customer segment
    • Feedback on new products/services
    • Correlation with past adoption behavior
  1. Customer Innovation Index (CII):
  • Definition: A metric evaluating a customer’s engagement with innovative aspects of the company’s offerings, such as new technology, features, or services.
  • Components:
    • Participation in beta programs or early access
    • Feedback provided on new features
    • Usage metrics of innovative products/services
    • Correlation with overall spend and engagement
  1. Referral Impact Score (RIS):
  • Definition: Measures the impact of customer referrals on new customer acquisition and their potential future value.
  • Components:
    • Number and quality of referrals
    • Conversion rate of referred customers
    • Average CLV of referred customers
    • Engagement and retention rates of referred customers
  1. Sustainability and Ethical Engagement Index (SEEI):
  • Definition: Evaluates the alignment of customer values with the company’s sustainability and ethical practices, predicting loyalty and long-term engagement.
  • Components:
    • Customer engagement with sustainability initiatives
    • Feedback on ethical practices and transparency
    • Purchase behavior related to sustainable products
    • Social media and public sentiment analysis on ethical practices


These KPIs are designed to go beyond traditional metrics, incorporating predictive analytics, behavioral data, and qualitative insights to provide a comprehensive view of the potential future value of customers. They can help identify high-potential customers, enhance personalized marketing strategies, and optimize customer lifetime value.

CASE STUDY 2 – Gemini

Gemini - Prompt 1

Gemini – Response 1

To effectively guide the brainstorming session and propose high-impact KPIs for customer lifetime value (CLTV), I would need the following inputs:

  1. Deep Understanding of the Business Model:
    1. Core products or services offered
    2. Revenue streams and profit margins
    3. Customer acquisition channels and costs
    4. Customer segmentation (demographics, behaviour, value)
    5. Competitive landscape
  2. Current KPI Framework:
    1. Existing KPIs related to customer acquisition, retention, and revenue
    2. Data availability and quality
    3. Limitations of current measurement systems
  3. Customer Journey Mapping:
    1. Detailed understanding of the customer journey, from awareness to advocacy
    2. Touchpoints and interactions with the brand
    3. Customer pain points and satisfaction levels
  4. Industry Trends and Best Practices:
    1. Emerging technologies and their potential impact on customer relationships
    2. Innovative approaches to measuring customer value
    3. Benchmarking data on CLTV and related metrics
  5. Business Objectives and Goals:
    1. Overall company vision and mission
    2. Financial targets and growth aspirations
    3. Customer-centric goals and initiatives


To encourage innovative thinking and uncover novel KPIs, I would use the following prompts:

  • Future-Focused:
    • “Imagine the customer experience in five years. What metrics would you use to measure success?”
    • “How can we leverage emerging technologies (AI, VR, IoT) to create new value for customers and measure its impact?”
  • Customer-Centric:
    • “What are the key moments of truth in the customer journey, and how can we quantify their impact on CLTV?”
    • “How can we measure customer loyalty beyond traditional metrics like NPS?”
  • Value-Driven:
    • “How can we quantify the intangible value customers bring to our business (e.g., referrals, brand advocacy)?”
    • “What metrics can help us identify and prioritize high-value customer segments?”
  • Data-Informed:
    • “What data sources can we leverage to create more accurate and actionable CLTV models?”
    • “How can we use predictive analytics to identify customers at risk of churn and develop targeted retention strategies?”

 

Access to real-time data would be invaluable for this brainstorming session. It would allow us to:

  • Validate assumptions and hypotheses: By analyzing current data, we can identify trends and patterns that support or contradict our initial ideas.
  • Experiment with different KPI calculations: Real-time data enables rapid testing and iteration of potential KPIs.
  • Identify opportunities for improvement: By comparing actual performance to targets, we can uncover areas where we need to focus our efforts.


Note: The specific data sources and level of real-time access will depend on the company’s IT infrastructure and data management capabilities.

By combining these inputs, prompts, and data access, we can create a dynamic and productive brainstorming session that generates high-impact KPIs for measuring customer lifetime value.

Would you like to explore specific examples of potential KPIs based on a hypothetical business model?

Gemini - Prompt 2

Gemini – Response 2

Innovative KPIs to Measure Future Customer Value

Imagine you run a cool online gaming company. Let’s brainstorm some super-cool ways to measure how awesome your players will be for your business in the future.

Looking Ahead: Future-Focused KPIs

  1. Prediction Power Points: How good are we at guessing which new games players will love? This shows how well we understand our players.
  2. Level Up Loyalty: How many players keep coming back for more levels and challenges? This tells us how much players really enjoy our games.
  3. Treasure Chest Growth: How much extra stuff (like cool skins or power-ups) do players buy over time? This shows how much they value what we offer.
  4. Friend Finder Factor: How many friends do players bring into the game? This measures how much players love sharing the fun.
  5. Superstar Score: How often do our players become famous in the game (like top scores or winning tournaments)? This shows how engaged and skilled our players are.


Beyond the Game: Real-World Impact KPIs

  1. Real-Life Rally: How do our games help players learn new things or make real-life friends? This measures the positive impact of our games.
  2. Creative Corner: How many players create their own cool stuff (like levels, characters, or stories) for the game? This shows how much players love to be creative.
  3. Happy Camper Happiness: How happy are players with our customer service? This tells us how well we take care of our players.


Remember, these are just ideas to get your imagination going. The best KPIs are the ones that help you understand your players better and make your games even more awesome!

Would you like to brainstorm some KPIs for a different kind of business?

References:

Copyright© 2020-2024 Simplarity Limited