marketing measurement

Ten years ago, I called the useful output of marketing data contextual intelligence. The phrase came from a frustration I kept encountering in client work: organizations had more numbers than they knew what to do with, yet the numbers rarely answered the question leadership was actually asking.

That problem has not disappeared. We have simply made it faster.

AI can now summarize customer conversations, classify sentiment, surface anomalies, compare competitors and generate a plausible explanation before a team has finished its first cup of coffee. That is useful. It is also easy to mistake speed for understanding.

AI can find a pattern. It cannot decide, by itself, whether the pattern matters to your business.

The dashboard is not the decision

A dashboard can show that engagement rose. It cannot tell you whether the audience became more qualified, whether the message attracted the wrong expectations or whether the activity moved anyone closer to a consequential decision.

A sentiment model can label a conversation positive. It may not recognize that the praise is sarcastic, that the loudest voices are not representative or that the same words carry different stakes in healthcare, financial services and entertainment.

A generative AI system can produce a confident narrative from incomplete evidence. Confidence is part of the interface. It is not proof that the explanation is correct.

This is why current guidance from the National Institute of Standards and Technology treats trustworthy AI as an organizational risk-management problem, not merely a model-performance problem. The people deploying a system still have to define the context, evaluate the output and decide what consequences they are willing to accept.

Marketing needs the same discipline.

What contextual intelligence actually requires

Contextual intelligence begins before the analysis. It starts with a sharper question.

What decision are we trying to make? A report built to defend last quarter’s activity is different from an analysis designed to determine what should change next.
Whose behavior matters? More attention from an irrelevant audience can make a dashboard look healthier while weakening the business case.
What is the comparison? A rising metric can still represent lost ground if the market, competitor or cost moved faster.
What is missing? Customer-support records, sales objections, referral patterns and frontline observations may explain what platform data cannot.
What would change our mind? If no plausible evidence could alter the recommendation, the analysis may be decoration for a decision already made.

This is the point where professional judgment enters. Judgment does not replace evidence. It determines how evidence should be interpreted when definitions are imperfect, incentives conflict and the consequences are not evenly distributed.

Three places marketing analysis still loses the plot

1. Share of voice without share of relevance

In the original 2016 article, I described using social-listening and competitive-analysis tools to compare share of voice. That work was valuable, but the metric was never sufficient on its own.

A brand can dominate conversation because it is trusted, because it is controversial or because it has become the subject of a joke. The volume is real. The strategic meaning is not contained in the volume.

The useful questions are more specific: Who is talking? What do they believe? Which claims are traveling? Where is the evidence coming from? Does the conversation affect consideration, confidence or action?

2. Influencer reach without decision influence

The same distinction applies to influencer analysis. Follower count and engagement can describe visibility. They do not establish whether the creator changes a decision that matters to the organization.

An influence map should connect the person, the audience, the subject, the stage of the decision and the evidence of movement. Otherwise, it is a popularity map wearing business clothes.

This is the gap I continue to examine through The Influence Project: attention is visible, but the change produced by attention is often harder to see.

3. Crisis signals without operating context

Monitoring systems can surface a spike in negative conversation. They cannot know whether the organization should respond publicly, correct an operational failure, contact a small affected group or wait for an inaccurate story to lose momentum.

The wrong intervention can amplify the very narrative a team hoped to contain. Context includes the source of the claim, the credibility of the people carrying it, the organization’s evidence, the affected stakeholders and the cost of acting too quickly or too slowly.

AI raises the value of judgment

The more efficiently technology produces analysis, the more important it becomes to know what the analysis is for.

That is not an argument against AI. I use AI because it can reduce administrative work, help organize large bodies of material and make patterns easier to inspect. But I do not ask it to assume responsibility for the decision. It has no client history, institutional memory or personal stake in the outcome unless people deliberately provide and govern that context.

The competitive advantage is not simply having more data or a newer model. It is building an organization that can connect evidence to a real decision without losing sight of the people, incentives and risks behind the numbers.

What leaders should ask before accepting an AI-generated answer

What data was included, and what important evidence was unavailable?
Which definitions or proxies are doing the most work in this conclusion?
Is the system describing correlation, or are we treating it as an explanation?
Who could be misread or disadvantaged by this interpretation?
What human observation supports or contradicts the output?
What decision will this answer change?

In 2016, I argued that content without context wastes time and resources. In 2026, the warning applies to intelligence itself.

More output is not more understanding. The work is turning evidence into judgment people can act on.

Sources

NIST, Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile, published July 26, 2024 and updated April 8, 2026.
NIST AI 600-1: Generative Artificial Intelligence Profile.

Originally published February 29, 2016. Materially updated August 31, 2026.

If your dashboards are multiplying but the decisions are not getting clearer, explore Strategic Advisory.

We’ve been trained to equate visibility with success—but most teams are measuring distribution, not decision-making. That gap isn’t a reporting issue. It’s a definition problem.

The Pattern I Can’t Unsee

I keep seeing the same pattern – across companies, clients, and even in how my own students initially define performance. On paper, everything looks strong. That’s exactly where it starts to go wrong. Impressions are up. Engagement is up. Click-through rates are solid – sometimes even impressive. The dashboards tell a clean story. And yet, when you zoom out, something doesn’t quite hold. Pipeline feels inconsistent. Growth is harder to predict than it should be. Revenue doesn’t track cleanly back to the activity everyone is pointing to as “working.” That gap isn’t a fluke. It’s what happens when activity gets mistaken for performance.

What We Quietly Redefined

Somewhere along the way, “performance” stopped meaning business impact and started meaning platform activity. Not intentionally. Gradually. We built systems around what platforms could show us:

what gets distributed
what gets engagement
what’s easy to report

And we started calling that performance. But most of those signals tell us how far something traveled – not what it actually did once it got there.

Quick gut check:

When you say something “performed,” do you mean:

it reached people
it resonated
or it changed behavior

Those are three very different outcomes. Most reporting treats them as interchangeable. They’re not.

Where It Breaks

Visibility, influence, and conversion sit on the same path – but they are not the same thing. Visibility gets you seen. Influence shifts perception. Conversion drives action. Most teams measure the first and assume the rest will follow. They don’t. And the platforms we rely on aren’t built to close that gap. They’re built for distribution efficiency – not decision quality. Which means a lot of what “performs” well… simply aligns with what people already believe. It reinforces. It circulates. It scales. But it doesn’t necessarily move anything forward.

What This Looks Like in Practice

This is usually the moment where things start to feel off internally:

Campaigns look successful – but don’t move pipeline
Teams debate attribution instead of questioning inputs
Leadership asks why growth doesn’t match activity
Reporting becomes more complex, but not more useful

At that point, measurement turns into interpretation. Not strategy. This is the layer I get pulled into most often – when the numbers look right, but the outcomes don’t.

The Question That Changes Everything

Most teams ask: “How did this perform?” A more useful question is: “What changed because of this – and how do we know?” That shift sounds small. It’s not. It forces you to look at:

whether you reached the right audience (not just a large one)
whether credibility actually increased
whether decision-making moved any faster

If nothing changed, it didn’t perform.

Why Smart Teams Still Get Stuck Here

This isn’t a knowledge gap. It’s a comfort gap. Because once you move beyond surface metrics:

influence gets harder to quantify
trust builds unevenly
decision paths stop looking linear

And suddenly, you’re operating without clean answers. Most teams retreat at that point. They double down on what’s measurable – even if it’s incomplete.

The Opportunity Most Teams Miss

The teams that get this right don’t just improve reporting. They change how decisions get made. They:

stop overvaluing noise
align marketing with actual business drivers
build systems that compound trust over time

And they stop mistaking motion for progress.

A Quick Reality Check

If your metrics look strong but growth feels inconsistent, you’re not alone. But it’s rarely a channel problem. It’s rarely a content problem. It’s almost always a definition problem. If you’re in that gap right now – strong visibility, unclear impact – this is exactly the kind of issue I work through with teams. Not by adding more metrics, but by clarifying what performance is actually supposed to measure.

Final Thought

The more complex the influence, the harder it is to measure. That’s true. But that doesn’t make it optional. It makes it the work. And if you’re looking at strong performance metrics and still having to explain uneven growth, there’s usually a point where visibility, influence, and conversion have quietly collapsed into the same thing. Most teams don’t notice it happening. They just feel it.

Put the insight to work

Are the metrics helping leadership make a better decision?

Jennifer works with leaders to separate activity from business impact and decide what the organization should change next.

Explore Strategic Advisory →Explore Fractional Leadership →

AI Can Find the Pattern. It Still Can’t Tell You What Matters.