old newKnow the difference between a Reporting Squirrel and a Analysis Ninja?

One is in the business of providing data.

One is in the business of providing, to use a old fashioned word, information.

This one of the core reasons why most dashboards are "crappy", i.e. they are data pukes that provide little in terms of context and even less in terms of actionable value.

Here are some examples of sub optimal dashboards, sub optimal in my mind from a actionable perspective. . . .

sub optimal dashboard 2

Perhaps the most common type is above. Lots of data, even drill downs included, but you can't look at it and go: "Wow we need to do . . . ". No sirrie bob you can't.

sub optimal dashboard 1

I wanted to point the above out purely because of a common feature of 80% of Web Analytics Dashboards, in excel with a billion tabs to look through. This is not a dashboard, it is the result of a massive sum of money paid to a Consultant who is trying to impress you with his / her excel skills – without actually telling you anything.

sub optimal dashboard 3

You are walking down the street. You look at someone from behind and you think "hmmm she's / he's pretty". So you speed up and overtake them and in the process you sneak a glance at them (yes you are married but looking is still ok :), and you are hugely disappointed. Not pretty. That's the dashboard above. Very sexy and Web 2.0'fied and a ton of data there, but a lot less actionable than you might have hoped.

Why is this so? All the above efforts are well intentioned, took lots of honest work and probably took months to put together. So why?

Here are some hidden (corrosive) reasons why most dashboards tend to stink when it comes to helping the Executive make any decisions:

  1. They leave the interpretation to the Executive (/ customer / requestor / other Squirrels). This is a fatal flaw because most dashboards are highly aggregated views of any KPI and are missing all the nuance and analysis (that only you as Ms. Ninja have, and you don't go with dashboard).

  2. Most Executives actually want insights / action recommendations but they don't trust the Squirrels / Ninjas / VP's / Data Providers. So they ask for numbers. We dutifully cram as many of them on to a A4 size paper in 3 size font and send it along with a magnifying glass.

  3. Most Squirrels / Ninjas live in a silo. Going out to collect enough tribal knowledge to actually know what is going on to then make recommendations from the data is not something that we do, nor are we encouraged by our Executives or our organization structures. This incentivizes data pukeing.

  4. Often dashboard creators tend to be "outsiders" (Consultants, Experts etc) and they often don't have deep practitioner experience that would allow them to understand the human / "below the surface" issues like the above three. That leads non-Practitioners to make the common mistakes like creating the above three dashboards.

If you want your Executives / Customers to take action, you have to give them information and not data. It takes effort to get there, it will take all your charms (though no violation of any HR intimacy policies), and it will take some time.

Step one as always is to become aware of the above three problems.

Step two is to get a possible solution from the Occam's Razor blog. :)

My attempt at solving this problem was to try and attack it from a human psychology perspective: How can I create a "dashboard" that will incent the right behavior from the Squirrels / Ninjas while giving Executives the information they need to make decisions (rather than engaging in a bitchfest which is the typical outcome).

Recommendation #1 was to move to a Critical Few philosophy for Executive reporting: Only report the three or five (at most!) metrics that define success for the whole business. Kill all the ancillary metrics that were nice to know (and my kill I mean let lower levels worry about it).

Recommendation #2 was my humble, admittedly ugly, attempt at a "Action Dashboard":

executive management dashboard

4Q. (Sorry Jonathan! :)

Each quadrant representing a solution to a human problem that lead to crappy dashboards.
(Apologies for having to redact some of the data above, to protect the innocent.)

Let me walk you through it.

First very up top a clear identification of what the Critical Few metric was, who was responsible for that metric from a business perspective (translate into "head on the line") and who was responsible for the analysis.

Also note the little red dot. That here indicated trouble. It can have two other colors, yellow for don't fire anyone yet but get ready and green for send someone a big hug and a box of chocolates. Next. . . .

kpi trend

The first quadrant (the graphic) shows the trend for the metric. Ideally segmented (as is the case here, cart abandonment is illustrated for four key customer segments).

This quadrant is to satiate Executive curiosity that you know what you are doing, it will be glossed over (and that's good!).

insights from analysis 1

The second quadrant (Key Trends & Insights) is to add value by interpreting the trends and adding context. It says there that some things are up or down (in english :), and it also warns which data might be bad etc. You are starting to do your job here.

This quadrant is the one that Executives will read a lot initially, over time they will gain confidence in you, they will love that you share context (hello Ninja!), over time they will gloss over it (a good thing).

action

The third quadrant, clockwise, (Actions / Steps To Take) is force the shy Web Analyst to get out and talk to Marketers, Website Owners, VP's, Whomever it takes to get all the tribal knowledge, identify root cause for the trends in the metric and recommend solid action to take. The Analyst will rarely be able to do this by themselves. It will require human contact with others, it will require conversations, it will mean identifying solutions collaboratively. It is a fantastic opportunity to become smart about the business.

This quadrant is key to driving action. No longer do you leave things to interpretation or let's blame people etc. You are recommending what actually needs to get done. Your Executives will kiss you and over time this is the only quadrant they'll read. It will also mean that monthly meetings will move from bitch fests to deciding who does what. Amen!

impact crater barringer arizona

The fourth quadrant, (Impact on Company/Customer) exists in case it is not clear to the Executives why they need to take action (listen to poor old you the lowly Analyst). I feel it is the key thing missing from any dashboard, they are normally missing the kick in the rear end and this quadrant delivers it. It is the answer to this question: "As a result of this trend (up or down) what was the impact on the company and its customers". It also forces you, Marketer / Analyst, to do hard work to estimate the impact and put it on paper.

This is the killer quadrant, if nothing else drives action this will, knowing exactly how much money was lost, how many customers were pissed, how much opportunity was wasted. Now when they ignore you they do that at their own peril and with their butt on the line. Trust me action you recommend will be taken.

See how simple it is?

You fix the human problems, you address the flaws in the system today and you actually become much smarter about the whole business (thanks to q3 and q4).

Win – win – win.

Over time you'll gain a lot more trust from your Executives and all the crappy dashboards can die and be replaced with one that looks like this one. . . .

executive management dashboard nirvana

Now you are asking your Executives to simply layer their own judgment on the recommendations and help the company take action. Who needs to see the numbers? They pay you and I to deliver actionable insights.

I stress that it won't happen overnight, but shoot for that nirvana state.

May the force be with you.

Ok now your turn. Care to share your own learnings and battle scars? Your success stories? Perhaps critique my "Action Dashboard" (sorry could not think of a better name, do you have suggestions?). Your perspectives are most welcome and would be greatly appreciated. Thank you.

PS:
Couple other related posts you might find interesting:

Social Bookmarks:

  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite
  • services sprite