November 2010


15 Nov 2010 02:19 am

Unravel The goal of my recent post on the Yahoo! Web Analytics blog was to pull us up 10,000 feet to do something we do less than 1% of the time in the web analytics world – look at the bigger business picture.

It was called: Secret To Winning With Web Analytics? Starting Right!

While that was a very strategic post, it got me thinking at a tactical level.

What if I was given the login and password to someone's web analytics data and asked to "find something interesting?" How would I start the process of web data analysis right? Even without any knowledge of the company's goals or help from a stubborn HiPPO or clients who just want data pukes? Can I add any business value?

A real challenge!

It turns out, astonishingly, that even with all those barriers (no objectives or goals or cooperation or business guidance), you can spend a couple hours and do decent enough analysis, sourced from your experience, to deliver some minor data-gasms of insights.

Not quite the real intense ones that you might experience if all the foreplay had been done correctly (see the YWA post above), but still never say no to even minor orgasms right?

Setting The Right Expectations

It is nearly impossible to find earth shattering insights that you can action from your web analytics data in just a couple hours. And yet finding some delightful starting points might be less hard than you might imagine.

Starting points to start valuable analysis from. (What data should I look at first?) Starting points for a customer centric strategy. (What are my customers telling me?) Starting points for gaps in your online marketing efforts. (Where am I wasting money?)

Secret To Winning Web Analytics: 10 Starting Points For A Fabulous Start!

This blog post is a starter guide that outlines the steps I personally undertake most commonly when handed the keys to the data for a website. 

I want to share where in your web analytics data you can find valuable starting points, even without any context about the site / business / priorities. Reports to look at, KPIs to evaluate, inferences to make.

I hope you'll benefit from my humble experience. Let's go!

Step #1: Visit the website. Note objectives, customer experience, suckiness.

My biggest beef with web analysts and consultants is how quick they are to jump into Google Analytics or Omniture or WebTrends. It's as if they have never seen a report with Visits & Conversions before. Jeez!

The very first thing I do, and I recommend you do, is visit the website whose data you are analyzing. See how it looks. Go to the product pages. Go to the donation pages. Go to the B2B dancing monkey video (what!). Go to the add to cart page. Go to the RSS / Email sign up page and sign up. Go read some customer reviews (if a ecommerce site) or visitor comments (if a blog). Go download the white papers. Go use site search.

frys site heuristic analysis

Get a feel for the company's vibe. Get a feel for the information architecture and cross sells and font size and buttons and tab structure and user experience etc. What's hideous? What's awesome?

Bonus points for visiting one competitor's website. Do all of the above.

Take out a note pad and write down your thoughts. What did you like? What did you hate? What frustrated you? What was obviously broken? What's the site trying to do?

At the very minimum your notepad should contain answers to these two questions: What is the macro-conversion? What are two or three micro-conversions? Remember those terms apply to ecommerce and non-ecommerce websites.

The site owner / client did not help you, but you've not got super valuable context. You're ready for data!

.
Step #2: How good is the acquisition strategy? Traffic Sources Report.

This is the very first place I end up because the first thing I want to know is how savvy the company is about online marketing. All other site data comes second because if you stink at online marketing then there is not much of a victory to be had by torturing website data.

No company in the Milky Way has succeeded without having a balanced portfolio of acquisition channels (fancy word for source of traffic). How's yours?
 traffic sources overview google analytics

What to look for:

I am really looking for a balanced portfolio of traffic sources. Search, Referring Sites, Direct, Campaigns. Which one is strong? Which one is missing?

Based on my own humble experience the site on the left is what approximates the kind of "best practice" (note the quotes) you are looking for.

Around 40% to 50% Search is normal. If the number is too big (site on the right) it indicates an overexposure to search rankings and algorithm changes (not good at all). If it is too low you are simply leaving money on the table. And of the search traffic, you want a big portion to be Organic so you are not just "renting" traffic or suck at SEO.

20% or so Direct Traffic. If the web analytics tool is implemented right these are all your existing customers or people from offline campaigns. You want a healthy amount of both. If direct traffic is low, I worry if you are any good at customer service / retention (the latter is so often just an afterthought).

20% to 30% Referring Sites. You can't just rely on search engines or spending money on campaigns. A healthy web strategy includes a robust amount of traffic from other sites that link to your products and services, and praise (or slam!) you, or promote you on Twitter and Facebook and forums and otherwise link to you. Free traffic (usually) and you do want that (for many reasons).

10% Campaigns. Google Analytics (sub optimally) calls this Other. It is email campaigns, display / banner ad campaigns, Facebook display campaigns, social media campaigns etc. You want at least 10% of the traffic to be the ones you invite to your site deliberately, after solid analysis and great targeting. Outside of Paid Search. It's a sign of a healthy business that has a diversified customer acquisition strategy.

Consider the above as broad guidelines, again based on my online marketing experience. YMMV, certainly for esoteric types of businesses.

What to do next:

I'll make note of where the company is overleveraged and make a note to dig deeper with the client / HiPPO. Expose the dangers to them, brainstorm how to diversify.

For each bucket I'll look at least the top ten rows. Additionally, for at least one of the four buckets I'll dig deeper by looking at the standard report for that segment to identify some strengths or weaknesses. Surprising keywords, missing sources of traffic, trends in campaign vs. direct visits etc.

At the end of this you'll understand how sophisticated the client is, where you'll attack acquisition first (if you get the time and money to do more analysis).

Step #3: How strongly do Visitors orbit the website? Visitor Loyalty & Recency.

I have a sense for the site and I have a sense for the client's acquisition savvy. Time to focus on the Visitors!!

Most people create sites just for themselves and with no obvious purpose in mind. Furthermore the content publishing schedules, perceptions of "engagement" are all out of whack.

So what I (and you, dear blog reader) want to do is get a sense for how strongly attached are the Visitors to the site. This is of course crucial for any type of content site, but you'll be surprised at how important it is even for an ecommerce website (retention, support, repeat purchases, yada yada yada).

The report I'll look at is the standard Visitor Loyalty report. It would show how many times in a given time period the same person (persistent cookie actually) visits the website. Or, how tightly the Visitor orbits the site!

All tools have this report, Here is how it looks like in Google Analytics:

website visitor loyalty

What to look for:

For site number one it is clear there are a lot of one night stands (47%). But notice that bottom, an astonishing 40% of the people visit the site more than 9 times a month! You get a sense for content consumption patterns, you get a sense for your next task (segment the 40, learn what's working there, apply to the 47!), you get a sense for whether the site's delivering on its business objectives.

If the data looks more like site two, cry. Ok, most of the time cry. This site simply engages in one night stands, and while I can think of some sites where that can still be the basis of a long term sustainable business model. . .  I can't think of a lot of them.

Not a tight orbit. So what? Remember the notes you took in step one? What's the impact of the loyalty pattern on the objectives you noted? With some solid data you are ready to have a discussion with the client / site owner / HiPPO. Take a tissue.

While I love Loyalty the most, I also take a quick peek at Visitor Recency. This is specific to content sites (newspapers, yellow pages, hospital, "I am the next facebook-killer" sites, etc).

Visitor Recency measures the gap between two visits of the same visitor. Or, When was the last time you saw the same person (cookie really). Here's the report:

website visitor recency google analytics

How amazing is it that 37% of the traffic on the site last visited less than 24 hours ago! Talk about orbit!

Segmenting this data is best (by content, source, campaign, outcomes, etc), but even a cursory review will help you understand how people behave.

What to do next:

I always review two more reports that give me a sense for content consumed. No, no, not the silly reports that show mostly useless metrics like Average Time on Site and Average Pages Per Visitors (averages stink!).

I am talking about Length of Visit and Depth of Visit:

length of visit website engagement

With Loyalty and Recency we measured visitors visiting, but once they are here what are they doing? That's what you are trying to get a sense for with these two reports. [Remember visits with just one page view, bounces, will be in the first bucket 0-10. For why, see: How time on site & time on page are computed]

If you have some time segment out the bigger buckets (beyond 0-10) and analyze the data. If you don't have time just knowing Loyalty, Recency, Length, Depth tells you a lot about how tightly Visitors orbit this site, and understanding customers is precious.

Step #4: What can I find that is broken and quickly fixable? Top Landing Pages.

Understand site? Check! Understand traffic sources? Check! Visitors? Check!

Time to take off the gloves and some clothes and get dirty.

Companies spend lots of money acquiring traffic, often badly, so why not find top places where that money is being wasted and which home pages might possibly be stinky? Visitors refuse to give you a single click? That might be a useful signal. : )

In your web analytics tool this is a standard report. It shows bounce rates, sweetly indexed against site average, for the top entry points to the website:

top landing pages bounce rates

What to look for:  

The red parts! See why I like "indexed against site average" feature? It is easy to know what smells bad.

Three landing pages (entry points to your site) are performing really well. Seven seem to be bouncing at a much higher rate than normal, some spectacularly so. At this point you don't know why.

When you see that a page has a high bounce rate it could mean one of two things:

1. Wrong people are coming to your site (highlighting problems with campaigns, SEO, etc) or

2. The page itself is poorly constructed (missing calls to action etc) or otherwise broken.

At this point you don't know which of the two (or both) is the problem. Since you don't have a lot of time pick two of the biggest losers above. Click on the arrow thingy next to their name in the above report and visit them. Sometimes the problem is obvious. Next click on the link itself in the above report and visit the page level report. There in the drop-down pick Entrance Sources and Entrance Keywords. That segmented view will quickly tell you which sources and / or keywords are contributing huge bounces.

Now, at least for two or three pages of the site you are analyzing you know that they stink and you have decent clues of what the cause(s) might be. Give yourself a pat on the back. Great job!

[An exception: Analyzing bounce rates for a blog, or "bloggish" site? Segment and look at landing pages for New Visitors; for all other sites the method is as above.]

What to do next:

In this case you are in a position to recommend specific fixes. You have looked at the pages and sources of traffic (proxy for customer intent). You can use a heuristic evaluation process to tell the site owner what fixes will help reduce bounce rates.

A clean and handy checklist is here: Qualitative Analytics: Heuristic Evaluations Rock!

I am telling you people are going to love you for being this awesome.

Step #5: What content makes us most money? $Index Value Metric.

Most effort on any given website is spent on content creation, and hence for step five I encourage you to stick with page reports, but flip the funnel from an "input metric," bounce rate, to an "output metric," $Index value.

For an ecommerce (with revenue) or a non-ecommerce website (where goal values have been defined) $ Index value essentially computes "how much revenue" has been earned by a page (more like contributed by a page). It is a great way to gauge the value of a page.

Go to any content report, in this case Content By Title and you'll see the last column:

content index value analytics

What to look for:  

Quite simply the types of content that add most value to an ultimate outcome for your website. In the above screenshot it is pretty clear that even in the top ten the range of value added is from $8.79 to $0.10.

Would your boss / client not die and go to heaven if you told them exactly what types of content they should be writing / pimping more and what less? How about pages of which product / services generate most value?

Or my favorite report to look at: Content by Drilldown.

That report is particularly apt for sites that are organized in clean directory structures (like /products, /videos, /demos, /blog, /whatever else). Now you are able to discern which groups of content is most valuable to the company. Are videos really valuable? How about really heavy painful Silverlight demos? Wish lists work? The answer awaits!

If you don't have clean directory structure you can still use segmentation to group content and do the above.

What to do next:

This takes very little time. Use the Analytics Weighted Sort feature.

index value weighted sort

What I am doing above is answering this question: "Forgetting about top $index value pages and the bottom ones, which currently high value $index pages should I focus on to have the highest impact on my bottom-line?"

That is a very hard question to answer unless your web analytics tool has algorithmic intelligence built in. You click that check box and boom! There's the answer that will endear you to your boss / client for a long time. Hugs might even come into play.

Focus not just on what's causing good stuff today, focus on hidden areas where good stuff might happen in future.

Step #6: How Sophisticated Is Their Search Strategy? Keyword Tag Clouds.

Pages, and valuable bits of content, done. Time to refocus on high value acquisition.

Search.

It is really hard to get a "big impact" understanding of search strategy sophistication just from tables of top ten rows in Google Analytics or Omniture or CoreMetrics. Mostly because I don't want to look at the same lame obvious things.

So I like to yank the data out and create a tag cloud of all 40, 50, 100 thousand rows of data. Export as CSV. All Rows. Paste into www.wordle.net  Magic:

keyword tag cloud lds church

What to look for:  

[All data in examples below was taken from competitive intelligence tools as I don't have access to data for sites used here.]

A tag cloud very quickly shows the story in hundreds of thousands of keywords. In the case above, The Church of Jesus Christ of Latter-day Saints, it becomes quickly apparent that the Mormon Church has done a near magnificent job with search.

The brand dominates (as it should), but what is truly impressive is how many other words are also prominent (the valuable non-brand ones, even the long tail ones). If you know even a little bit about the Church you'll also be impressed that this tag cloud is a validation that the words the LDS church would like to be associated with it are prominent, and ones it does not are not as prominent. An amazing job by them. Pretty easy to see the themes (music, scriptures, family, etc) that you can then take back to your client/boss and validate whether they line up with business goals.

You can easily create these views for Paid Search keywords or Organic and find even more valuable insights.

Tag clouds are great at understanding the big strategic picture and understanding the sophistication, or lack there of, for any brand. Compare the LDS church with. . . something completely different. . . Chase Bank:

keyword tag cloud chase bank

For Chase, walk through the analysis I was doing above for the Church. What do you think?

In Wordle even after I remove the big words (representing massive traffic) from the cloud (say the words Chase and Bank) the story does not get much better.

How about this one:

keyword tag cloud blackberry

See what I mean? Simple data presentation technique, some pretty big insights.

Tag clouds have limits. You don't know what the problem is. Is it people? Is it a lack of sophistication? Is it using too much cruise control? Is it bad SEO? Is it. . . you'll have to dig. But you have 1. A great understanding of the site's search data and 2. Something of incredible value to present to your boss / client.

What to do next:  

I am a big fan of internal site search analysis. Few other sources contain as much direct customer intent as this. Visitors to your site are directly telling you what they are looking for. The challenge, as always, is gathering up all that intent into something understandable.

How about downloading all that and creating a quickie tag cloud?

internal site search tag cloud

I can look over my pages viewed and time spent and Google'd keywords and all that. Or I could analyze the story above and at a glance understand what people are seeking.

Then, based on time available, we could analyze where people start searching, how many of them bounce off the internal search results page, what is the conversion rate / goal values for at least the top x of the above searches, etc etc.

I could even mine data above to see what other topics I could write more about (or in your case. . . what new products you could sell / stock / invent!).

Step #7: Are they making money or making noise? Goals & Goal Values.

With a tiny detour into search (always one of the biggest components of most people's acquisition strategies) we will go back to my first love: Outcomes!  Ok, ok, ok it's customers, but outcomes are close.

I can tell the sophistication of any business (and the HiPPOs) by what I see in this report, Goal Conversions & Goal Values:

website goal conversions goal value

What to look for:  

The first thing to check is if you see anything here.

If you don't see anything here, and the company has been around for some time, then you know you are going to struggle, in case this is a consulting gig, to make any decent money off them or, in case this is your first day in your job, you are going to not get a lot of love in this company as an Analyst. I am not saying quit, I am just saying dig in 'cos it is going to be a soul-searing struggle if this report is empty.

On the other hand if macro and micro conversions are present then get down on your knees and say a silent prayer because this is going to be fun.

Check if the actual goals & conversions are what you had noted in Step 1. If they are not then what are the visitors to the site doing of business value? Anything you noted in Step 1 that is not here (new goals to create?). What do the trends over the last 12 to 16 weeks suggest? What Goals are contributing the most amount of value?

At the end of this little exercise you should be able to confidently speak to your client / boss about how the website is meeting business objectives, and possibly where it is failing. If you did Steps 2 through 6 well then you might even have other actionable recommendations to make.

What to do next:  

If there were some goals you had identified, or your client/boss was expecting, then take a moment to configure those in the web analytics tool.

If they do not have any behavioral goals created (99% of the people don't), then create those, takes just a moment. Refer to your insights from Step 3 to set the threshold values.

If this was an ecommerce website I would typically create one segment as a little bonus for the client. Orders where the total value was 50% higher than the average order value. Essentially the "whales" – people who order way more than normal. My hope is to get particularly valuable insights about where these people come from (geographies, campaigns, keywords, etc), what they do on the site (content consumed etc), and what they buy (shopping cart / basket analysis etc).

You want a lot more of these people. It is good to understand them really well.

Step #8: Can the Marketing Budget be optimized? Campaign Conversions/Outcomes.

Remember the only three outcomes that are important in web analytics? More Revenue. Reduced Cost. Increased Customer Satisfaction.

In this step I focus on the second item, reducing cost. Perhaps it is surprising as this is our very first foray into the web analytics data, we have received limited love from the client / HiPPO, and we don't have all the company business specific knowledge that might be necessary. Yet we can help reduce cost of marketing / customer acquisition.

My favorite report? Goals / Conversions by Campaign:

online marketing campaign analysis

What to look for:  

Campaigns as in Paid Search and Display and Email and Social Media and really anything of value you'd discovered in Step 2.

Start by looking at the horribly named "Other" report in Google Analytics (or perhaps the appropriately named Campaigns report in your web analytics tool). Initially allow yourself to be guided by that column at the end Per Visit Goal Value. It is a measure of efficiency. Notice above you go from $1.02 to $63, it is not hard to guess one campaign is working better than the other.

Then work backwards and see what conversion numbers look like. Then work further back and see which individual goals might be causing that high value to be created.

At the end of this exercise you should have some preliminary recommendations for at least one or two places money is potentially being wasted, or at least inefficiently spent. Killing opportunities (example: More better email campaign, less crappy Facebook pages!). You should also have some sense for where improvement opportunities might exist (I had a bunch above where PVGV was 40 cents).

What to do next:  

Pick one or two major campaign strategies the company is executing and dive deep into ecommerce analysis (if the client is ecommerce). The two screenshots of Paid Search and Yahoo! Display campaigns gives you just a small hint about how much opportunity exists below the surface to dig and understand the deltas between conversion rates and the average order values and the trends for those key metrics.

Far too often in the web analysis world our obsession is with analyzing behavior (visits and time on site, etc.) or with focusing on how to get more visits (spend more money!). If you want serious attention (and love) from your client / boss then you'll focus initially on cost reduction. You've seen that obsession of mine in almost every step here. I have learned this lesson from a lot of painful personal experience. I encourage you to embrace it as well.

Step #9: Are we helping the already convinced buyers? Funnel Visualization.

Ending on cost reduction was a good point. In this step we are going to do one awesomely sweet thing: focus on perhaps the fastest way to increase outcomes for the business!

The poor funnel report is so underappreciated. While unstructured path analysis is the biggest waste of time you could engage in, structured path analysis is literally manna from heaven.

goal funnel visualization

You want people to go through a series of steps (one after another) to meet a goal (for them and you). Credit card applications and ecommerce orders and donations to non-profits and leads to potential email spammers (I kid, I kid, I kid the spammers!). 

The funnel report shows where in your three or four stepped process people leave.

What to look for:  

The red bars. The bigger red bars.

I wish I could write lots and lots about this, but that is all there is to it (if the funnel was correctly created).

Look for where the highest exits exit in the funnel. Go look at the page with your eyes, get your mom and your BFF to look at it as well, identify improvements (heuristic is ok), submit them to your client / boss for fixes. The utterly lame ones you can just kill, the moderately lame to "don't know if this might be an issue" things go into an A/B testing bucket.

Either way, here is the analogy. Someone walked into your supermarket. They filled their cart full of stuff. They line up at a cashier and take out their wallet. They notice the loooong line. They move the cart aside and leave. You don't want them to leave! It was so hard to get them to come and add to cart and line up! Fix anything that stands in the way of the open wallet and you.

What to do next:  

In many cases the above funnel process happens over multiple visits (sessions). In that case your normal Google Analytics (or Adobe Site Catalyst or WebTrends or NetInsight) funnel won't work. Well, it will "work" but show imprecise data.

Switch to something like PadiTrack. It measures pan-session funnel conversion performance. The same Visitor can enter and exit and finally convert across sessions and you'll be able to see that behavior.

Another compelling thing about PadiTrack is that you can view, praise the lord, segmented funnels! Search and Display and Email Visitors convert via different behavior, and finally you'll be able to see this.

PadiTrack is free, works using the free Google Analytics API, and works on historical data! Most web analytics tools, including paid tools, can't do that!

Step #10: What are the unknown unknowns I am blind to? Analytics Intelligence.

Without any help from my boss or marketer or mom I have got through nine steps of web data analysis and found a few concrete and meaningful bits of actionable insights.

But the danger of doing this with no tribal knowledge, or intelligent party at the other end, is that I might miss something I simply don't know because I don't know it.

The unknown unknowns!

So before I close any analysis for a website I go look at the Google Analytics Intelligence reports. There I can count on the fact that the unique intelligent algorithm in GA has done forecasting and applied control limits and statistical significance and much more math to help identify anomalies in the data. I see its soothing embrace:

google analytics intelligence monthly alerts

What to look for:  

Initially I set the Alert Sensitivity to Low (multiple standard deviations away from the mean) and see what automatic alerts show up. These are big events, so most important. Then I move the slider slowly towards the right see what other alerts pop up (see the Traffic Source part in the above image).

I am looking for events and activity, on the site or caused by others externally, that I (and usually even the client / boss) would not be aware of. The unknown unknowns.

Your discoveries here are great way for you to check your own work in the above steps (perhaps some of what you thought did not make sense does make sense now). They are also a great way to impress your client / boss that you somehow, let's just say magically, discovered things that even they, the most data driven of data driven companies, might be unaware of in their own data.

What to do next:  

The hard part with Intelligence (custom or automatic alerts) is to isolate the root cause. Look at the newly released GA Intelligence Major Contributors section. That has the clues about root cause. Leverage the advanced segmentation feature to isolate the activity causing source / behavior / outcome and dig deeper.

[For more checkout the videos on Google Analytics Intelligence.]

And you are done! Does that not feel awesome? And more importantly, doable?

Summary: The Beginner's Guide / Tips / Best Practices For Web Data Analysis

In case you needed a handy checklist, here's what we've learned today:

    Step #1: Visit the website. Note objectives, customer experience, suckiness.

    Step #2: How good is the acquisition strategy? Traffic Sources Report.

    Step #3: How strongly do Visitors orbit the website? Visitor Loyalty & Recency.

    Step #4: What can I find that is broken and quickly fixable? Top Landing Pages.

    Step #5: What content makes us most money? $Index Value Metric.

    Step #6: How Sophisticated Is Their Search Strategy? Keyword Tag Clouds.

    Step #7: Are they making money or making noise? Goals & Goal Values.

    Step #8: Can the Marketing Budget be optimized? Campaign Conversions/Outcomes.

    Step #9: Are we helping the already convinced buyers? Funnel Visualization.

    Step #10: What are the unknown unknowns I am blind to? Analytics Intelligence.

The first time you go through the steps outlined in this guide it might take you more than 120 minutes. But I promise you that with time and experience you'll get better.

I wish just reading this blog post (it probably took you 120 minutes just to read it!) would be enough. It is not. You'll have to go practice it on many many clients. The more you do it the better you'll get as your sense of direction, data, discovery and deduction get better and better and better.

It is optimal to start any web analysis with a clearly defined web analytics measurement model. But if you don't have one then you no longer have an excuse not to provide something small that is incredible and of value from any web analytics tool you have access to, for any website in the world. And know that I am rooting for you!

Ok, your turn now.

When you are thrown into a website's data blind what are the first few things you do? What reports and metrics do you attack first? Over time have your discovered any strategies that work across multiple clients? Do you agree with the order of the steps above? Would you do something differently?

Please share your thoughts / critique / best practices / tips via comments.

Thanks.

01 Nov 2010 03:06 am

Shine Take two months to tag the website with JavaScript code (nine months for "high end" tools). Realize you did some things wrong and in nine months the company now has new needs. Go back, roll up your sleeves and spend more time on re-implementation. Log into the tool. Start spewing forth glorious data. Be sad no one in the team cares. Start creating pretty Excel files. Send. Still no one cares. Start publishing prettier PowerPoint files with pretty Excel screenshots. Still No One Cares. Feel frustrated. Tweet that. Feel better. Still no one cares.

Sounds like your life story as a Web Analyst?

Perhaps not all of it. After all you are unique. :)  But surely parts of it, and most surely the outcome.

Make no mistake. . . we all work really hard with the best of intentions. Yet we end up having negligible impact in terms of creating data driven organizations.

Why?

As a practitioner my root cause analysis (and ishikawa diagram!) indicates that the problem is not data. The problem (in some cases at least) is not employees or consultants. The problem is not that there isn't a need for data.

The problem is that we go about doing all of this the wrong way.

The structure we use is. . . I was going to say wrong. . . but the reality is there is no structured approach.

The process we use (above) is flawed.

dead end

It can't start with data spewing. Or with implementations. Or arguing about which tools to use. Or figuring out how to just make data pretty. Or going to analytics conferences to bitch. Or copy pasting "best practices."

We need a different process to help create data driven organizations.

And we need a structured approach to help guide that process.

The answer to those two golden requirements is very simple to grok, yet so few do it.

In this post I want to build on a secret mission I have been on in the last few months on this blog. I've been sharing real world concrete examples of how you can take a very structured approach and follow a very clean process to maximize the chances that you'll be set up for success when it comes to getting your company to use data to make informed smart decisions.

The "secret mission" I am referring to is a recent series of posts that have touched on non-data challenges Web Analytics faces. The mission highlights unappreciated hidden reasons why online marketing is still a faith based initiative.  It encourages you to answer only business questions by identifying attributes and giving you specific examples (questions before data!!). It provides you with a framework to identify who should own web analytics in your company.

The mission extended to pushing you to consider using the structure and process outlined in the Web Analytics Measurement Model. It dictates ignoring all data, reports, tools, what can be measured, what can't be measured, the political infighting and backstabbing to kick things up to the highest notch.

Here's the model, so simple, as outlined in an email! (Details in blog post above.) 

idea web analytics measurement model

Starting from what's supremely important to the business to setting goals to identifying metrics to identifying success parameters to ensure focus. Actually not just focus, hyper-focus when it comes to our data efforts.

My hope to get us to think differently perhaps peaked with outlining the Clear Line of Sight Model for hyper-focus and prioritization. 

web metrics line of sight framework

No longer will our data be ignored because we are data puking or doing non-contextual or only what we think is important "analysis." Hyper-focus! By having a direct visible line between our Key Performance Indicators and the company's Net Income no one can ignore our work!

[Bonus Reading: In the above post about the web analytics measurement framework please read, digest and action the seven steps outlined in the "Win With Web Metrics" section. It will change your life!]

Notice a common stream in all the "secret mission" posts? Not one of them was about tools or capturing data or stroking your inner JavaScript God man-child.

They were all about radically focusing on the business, strategy, meeting with CMO's and Finance, making love to the Marketers and Sales folks, and understanding everything about what surrounds your work before you say "Hello Omniture. Baby I have missed you. Let's get hook up and get dirty!"

: )

If you agreed with any of that (and come on how could you not!) then you are no doubt chomping at the bit to get going.

You are going to absolutely love what comes next. Trust me.

tutorial

As you know I am the co-founder of Market Motive Inc. We offer certification courses in six internet marketing disciplines, including. . .  wait for it. . . Web Analytics! It's a three month course consisting of structured lessons, quizzes, exams, and meetings. You learn a lot and have to work very hard.

At the end the course you to have submit a dissertation with qualitative and quantitative analysis of two real world websites. One non-profit/non-ecommerce and one ecommerce.  Our goal is simple: John and I want to know if you've absorbed the course material from not only a "here are reports, frameworks and metrics" perspective but also from a "I can now think like a marketing-data hybrid ninja" perspective.

Grading these submissions, and then doing the live, often torturous, Q&A, is a lot of work but also a time of great pride to see the student display awesomeness. Not everyone makes it unfortunately.

One such student who did make it this past quarter was Chessie Little.

She was exemplary on many fronts but I particularly loved her dissertation, specifically the approach she took to doing her analysis. With her permission I want to share it with you here hoping that it will inspire you to apply more structure and follow the optimal process when it comes to your company / non-profit / government entity and data.

[Context:]
Chessie's non-ecommerce website was a real estate website. What made it tougher was that the site was not owned by a builder but rather an entity whose job was to drum up interest from a population wanting to purchase a home in a certain area of a major American city. This site provided information and collected leads which were then funneled to the various builders who were developing the said area. Think of tough sites to do web data analysis for, this is right up there with the hardest nuts.

Note: I could not figure out how to shrink Chessie's submission to fit the width of this blog and ensure clear graphics (due to resizing). Hence I've recreated the pictures you see below in PowerPoint. But that's the only change. All the words and boxes and flow are Chessie's. All credit belongs to her.
[/Context:]

The dissertation opened with the one thing we in the web analytics world very, very rarely do: Identifying the business objectives.

Here's the very first picture we all need to paint. . .

web analytics maturitybusiness objectives

Identifying the business objectives mandates a discussion, multiple discussions, with the senior-most leaders in your company and working with them / sweet-talking their egos with gentle encouragement, to identify why the site exists.

Based on those discussions Chessie identified three objectives: Create awareness, generate leads for the builders and highlight community events.

My recommendation in the past has been that objectives should be DUMB:

    Doable. Understandable. Manageable. Beneficial.

Mission accomplished for Chessie. Her objectives are DUMB! Hurray!!

The second picture she painted was to drill down a bit more into the specifics. Objectives are usually handed down by the Management, you just have to do the aforementioned sweet talking.

Drilling down to identify Website Goals requires just a little bit more work from you, with the majority of critical thinking still coming from Management and Marketers (usually from multiple divisions – you get to know all the stakeholders if you do this!).

My definition: Goals are specific strategies you'll leverage to accomplish the business objectives.

Here's Chessie's effort. . .

web analytics maturitywebsite goals

Clean. Breaks down components of the business objectives. Provides clarity.

To deliver on "Create Awareness" the site needs to support the massive number of offline efforts and have an online relevant traffic acquisition strategy.

"Generating Leads" comprises the twin goals of providing all kinds of information that will help potential home buyers to make their decision and to collect e-newsletter registrations as well as e-requests for an onsite tour of the model home by the builder.

Finally, "Highlight Events" is not for prospective home buyers but for existing residents of the communities. By making them happy with delightful events they can be converted into Net Promoters whose recommendations will attract new prospects organically.

Crystal clear goals that cover ALL the jobs the site is doing, and both key customer constituents – current and prospective.

Now that we know what the Goals are it is time to pick the Key Performance Indicators (data, data, data, finally, data!). The work balance will shift to you as you are the expert here, with Management in a guidance role.

If you follow this structure then you'll end up on this picture from Chessie. . .

web analytics maturityKPIs.png

My rule for web metrics that are identified as KPIs should be:

    Uncomplex, Relevant, Timely and Instantly Useful.

[Bonus Reading: Web Metrics Demystified]

You can see that the KPIs chosen above will help Chessie's client use web metrics to identify how website goals are performing, and that they meet the four rules.

Sweetness.

Many would stop here. That would be wrong. And Chessie did not.

The right thing to do is resist the siren song of Google Analytics or Webtrends. You have not established what success or failure looks like, even if you have all the data.

Time to do what Chessie did: SET TARGETS!

Most often you as an Analyst will play a supporting role here, providing historical performance data etc. The decision-making will be done by your senior leadership and, if the company is big enough, the Finance and Sales teams.

People who are accountable will help you identify targets for each KPI. . . .

web analytics maturitykey performance indicators

Hurray!

Now everyone knows what the company is shooting for. When you crack open CoreMetrics you'll see data and jump with joy or weep when you see the number. You'll instantly know what is good and what is bad.

I wish I could tell you how important it is (it truly prevents data puking).

Done?

Not yet. At least, not Chessie. This last part is one that is particularly meaningful to me.

When you log into Omniture or Google Analytics or IBM Surfaid you are about to be deluged by data and you could go in a million different directions.

Remember the top of the post: We not only wanted focus, we wanted hyper-focus.

Take 10 more minutes from the people around you — the business people, the marketers, your boss — do one more thing.

Have a discussion with them about what are the most important segments to focus on when it comes to each goal.  Not just the super lame New vs. Returning Visitors or Search vs. All or Browser Versions segments!

Chessie's dissertation contained this last picture next. . . (note for visual clarity I have eliminated one KPI you see above). . .

web analytics maturityimportant segments

What group of visitors were important? What behavior was key to winning? What traffic sources was Marketing focused on? Who are we trying to attract? What on our site is important – at least according to us? And more such questions. [See: How To Identify Web Analytics Segments]

You will thank God and your Mother and your Cat and the Chickens and the Moon that you did the above step. Because my dear what you now have is. a structure that will guide your measurement efforts in a way that your insights will be of value and used to drive action.

Hallelujah, praise the lord you are done!

If I had not eliminated the Conversions KPI the Web Analytics Measurement Model would look like this (slightly cramped but still readable). . .

web analytics maturityimportant segmentsall

Shake on this. Meet your management team, or your client, and shake your hands on this "contract." If you can get them to sign it in blood, jump on that chance!

Here's the sexiness: You now know what's important and where to start and what to focus on. Your boss/client knows what success or failure looks like and how to connect Her/His business objectives to your data. Prioritized business focus for relevant data analysis.

How can there not be mutual love and admiration?

Do you see why I was pleased to see Chessie's dissertation?

It displayed a savvy business understanding and an ability to set her measurement effort up for success. Exactly what I want to see in anyone carrying a Market Motive Certification! It is what we so passionately hope to teach.

Punch-line: Always, always, always work with the above "analytics contract" in hand.

Print a copy of it and stick it on your cubicle wall. Make sure it is the first thing you show in any presentations you do. Revise it as needed (test for relevancy at least once a quarter, at least the targets will change if nothing else). Use it to bring a shared vision between all the stakeholders. When there is office politics and backstabbing, and there will be plenty of that, hold this document as the arbitrator of what direction to follow. Use it to break ties.

web analytics models rock

Of course the creating your own Web Analytics Measurement Model is not the end of your Web Analytics Maturity, just the optimal start of the process.

By ignoring your data itch and ensuring this type of deep engagement with your management team and stakeholders, upfront, you have set yourself and your company up for long term success.

Once the Web Analytics Measurement Model is done. . .  it is time to finally begin your Omniture loving and Google Analytics adoration and WebTrends hugging!

The hard, tough, sweaty work you'll do will include, as illustrated by these pictures from Chessie's dissertation, a correlation between the huge $$$ of offline advertising (newspapers, magazines, radio) and the website traffic to see if there is any there there. You'll throw in your online spend (display and PPC) for good measure. . .

offline ad impressions correlated with website traffic

Correlations? Any causality? Makes you wish you had done true test and control right? : )

You've already established in the Web Analytics Measurement Model that a primary objective of your real estate website is to produce and publish relevant content.

Time to see if there is any connection between what you are producing (pimping) and what visitors to your site actually want. Boom! Here it is. . .

document types content consumption

Having already identified your segments for conversion rate and what is dear to you from an acquisition perspective you'll surely spend some time with segmented conversion pictures like these. . .  conversion rate segmented by acquisition channel

The great thing is it will become easier and easier to jump to "what do I have to do next?" A key part of the strategy, as identified by the measurement model, are the tools you have built on the site to convince visitors to submit leads to you after being charmed by your beautiful tools and gorgeous data. So you'll do this. . .

conversion rate by website tools used

And many more such things. Just like Chessie.

In the end, no blow-out preventer in the world will be able to stop your awesomeness from oozing out in the form of a relevant dashboard with key bits of data and insights clearly laid out. . .

web analytics outcomes recommendations dashboard

[Note: In order to preserve anonymity the above dashboard was not Chessie's. The dashboard above is for illustrative purposes. Still. . . it is good, you should copy it!]

A dashboard that came from you following a specific structure, which drove a very specific process, to bring about the gift of Analytics Gods: Relevancy and Hyperfocus.

For you to be successful in web analytics you can't start with random data or random "dashboards" or data puking or this. . .

google analytics dashboard

If you want to be promoted, if you want your company to be successful, if you want your contract with the client to be renewed, if you want to get any kind of satisfaction from your job. . . you are going to have to start with this. . .

A Web Analytics Measurement Model.

web analytics maturityimportant segmentsall

It is not easy (like data puking). It takes relationships and efforts and love. But it is your only path to success.

Good luck!

Ok it's your turn now.

How does your company / client function? Do they take a structured approach and a specific process to focus? Does your approach work? Do you think the above approach will work for you? Why? Why not?

It would be immensely gratifying to get your feedback / critique / perspective.

Thanks.

PS:
Couple other related posts you might find interesting: