Occam's Razor by Avinash Kaushik

Rebel! Refuse Report Requests. Only Answer Business Questions, FTW.

51 User Comments

1. Michael Notté Says:
   October 4th, 2010 at 04:29

   Spot on! Me, standing up from my desk chair and applauding! :-)

   I regularly receive requests like the ones you listed "I want to know how much traffic is coming to our website during…", "how many visits did we got for following product sections…", "I want a path analysis for our visitors" (oh, soooo common).

   While, I don't answer what you are suggesting (should try once for the fun :-)), I always ask "why? What for?" trying to understand the motivation and reason behind a request. Why?

   #1. I am curious :-)
   #2. To understand the context as I want to make sure I will provide the right data that will answer the question
   #3. To provide an answer, not just raw data or a line graph.

   If the person is not trying to solve a problem but just wants figures for the sake of getting figures, I politely explain them where they can find these – (and get them an account).

   I am a Web analyst – not a squirrel. Not anymore, done that for too long.

   It is up to "us" the analyst to adopt the right behavior and your post described it very well.

   Great work!

2. Shailendra Dubey Says:
   October 4th, 2010 at 05:30

   Hi Avinash,

   Your post is really eye opener for me.

   I am getting the lots of request from the customers, in which they are requesting like "how many hits their website recieves"

   I have to then ask customer that there is no hits data available, & again ask whether they want visits or pageviews.

   Some customers ask me that how many peoples visited home page of the website.

3. Joe Teixeira Says:
   October 4th, 2010 at 05:54

   Let's go ahead and add +1 to people standing up from their office chairs and applauding!

   I think everyone who does Web Analytics gets requests from their clients such as the examples you already listed, things like "How many visits did I get" and "What's my bounce rate?". And honestly, it's not the client's fault – they know what they know, but that doesn't mean that they're not willing to at least listen and consider what you have to say (in my experience almost everyone is willing to at least listen).

   It's really the WA's responsibility to ask the business questions and help solve the business problems by asking said questions. Every business man and woman wants to make more $$, so if there's a possibility that this might happen by listening to you, they'll start doing some listening.

   But yeah, it's our responsibility to do so, as WA practitioners. Imagine going to a doctor and asking the doctor "What's my blood pressure?". Do you think that the doctor will just tell you "120 over 80" and collect your $15 co-pay and that's that? You came to the doctor for a reason (to solve your health problem), so the doctor is going to probe and ask questions that are going to help solve your health problem – and not just "puke" out your blood work statistics and send you on your way. And if your doctor does do this, it's time for a new doctor :)

   Thinking like a doctor, asking poignant business questions and solving issues and problems is the best way that we in the WA industry can help businesses everywhere.

   P.S. I wouldn't flat out "refuse" a report request from a client, though, as the title of this post would suggest. That's a fast way of losing a customer right there :). I suggest to give your client exactly what they are asking for, but before they see the data or open the attachment, do make sure that you are asking business-oriented questions in return. Chances are that despite your best intentions, your client (who may be a point of contact and not the CEO / owner) is just doing their job and doing their job means asking you for reports because their boss said so.

4. Anthony Centeno Says:
   October 4th, 2010 at 06:25

   Excellent post. I am a big believer in delivering actionable insights and simple data puking does not paint a clear enough picture for HIPPOs to take action.

   Delivering actionable insights connected to real business outcomes is like painting a picture, if I may. Artists use different colors, light, and objects in their paintings that, by themselves, can be beautiful, but when the artist creates relationships between these colors, the use of light, and the objects on the canvas, we receive the gift of a more full experience and insight.

   Much like Web Analytics, it's the relationships between objects, or data points, that bring about greater insight.

   Asking business questions helps us understand what picture a HIPPO is expecting to see. We web analysts then get to go on a great adventure to figure out how to paint that picture. What colors do we use, what COMBINATION of data points address the business question, how much light or a lack of light should we employ, what competitive intelligence can I incorporate?

   Great job Avinash! Keep 'em coming!

5. CJ Says:
   October 4th, 2010 at 06:26

   I was doing some squirrel reporting thinking "there is no way in the world my client can consume this data, there has to be a better way… I wonder what Avinash has to say about crappy reporting" and here you are like a ray of sunshine. What would I do without you reminding me I am not alone, shining some light on a better way?

   I love the ideas you have posted here and I am soooo going to spend tomorrow's Squirrel status meeting asking for business questions.

   +2 for standing on desk & cheering!

6. Rob McLaughlin Says:
   October 4th, 2010 at 06:26

   Hi Avinash,

   Great 'rally cry' of a post!

   I strongly feel it is the analyst's duty to sahpe the questions they are asked – answering bad questions/requests is a road to nowhere.

   In pursuit of actionable insight we have been running an iniative called 'Performance Acceleration' with our clients. We request their business objectives and then focus on tuning, starting or terminating marketing tactics in pursuit of them.

   We try and sit objectively inbetween them and their agencies/providers – ensuring that every tactic, paid or natural, contribute efficiently to achieving the overall objectives.

   By doing this we are super lucky, we only get asked the cool questions – but i guess that is the point of our process, to focus on the important stuff!

   Great post and thanks again,

   Rob.

7. Kevin Says:
   October 4th, 2010 at 07:18

   Well said Avinash.

   I love questions that dig deeper into the WHY than the standard web analytics.

   Since the employer/client/friend is paying you to answer these questions, they should ask them! I can get anyone a log in to the Google Analytics account. That data is all there for them.

   So take advantage of your "web guy"today!. Ask him or her a question that has relevance to the context of where your business sits today.

   Are we better off than we were a year ago? A month ago?

   WHY are potential customers coming to us from Facebook… Not just how many.

   Is it a good thing that our page views are up? What does it mean?

   Those are the questions that a log in can't answer. And those are the ones that need to be asked.

8. John Says:
   October 4th, 2010 at 07:41

   I also have had luck with the questions:

   What decision are you trying to make?
   What happened to make you ask for that data? (Another way to say "why do you want it?")

   And,

   Be humble: "If I understand what you're going for here, you never know, I might notice something interesting when I'm putting together the report."

9. Web Analyst Says:
   October 4th, 2010 at 09:22

   Hey there,

   It's impossible to disagree with this post, or really anything you ever write. The problem I'm having is finding advice that is more directly relevant to me. I'm posting this not b/c I"m a narcissist and want a site that creates content solely for me, but b/c I'm sure there are others out there that feel the same way I do. There are 2 things I find myself constantly saying after reading any blog post:

   1) "I'm not really empowered to do that kind of stuff"
   I only this year began my career in web analytics at a major internet media company. I'm young, so I recognize that I'm still in a learning stage and have to prove myself before people start empowering me to make strategic changes to the company. In no way do I feel anxious or entitled to anything more than what I'm currently tasked with. But being a major company, there are things that have been discovered by people long before I even considered an analytics career and yet still have not been addressed. I constantly will find reasons why bounce rate is high or have suggestions to increase traffic. But what do you do when you don't work at a smaller internet shop? When you feel that your company is too big to make any massive changes in any any sort of realstic time frame? Do you accept it and try to focus on the smaller yet more attainable challenges? Do you have to part ways with the company merely b/c the ship is too large to make any major changes in direction?

   2) "What if the business goal is not to make a sale?"
   I find that a lot of discussion about bounce rates and conversions become more difficult to apply when you are dealing in content driven sites. How do you bring revenue to the company other than the suggestion of "more traffic". In line with the first issue, when a company is very large, how does an analyst provide better reporting when things like product changes, SEO, and marketing strategies are not exactly in your purview. Or are they?

   Maybe the answer is to just shut up and push through, but I feel sometimes a bit restricted on what I can offer even with theh great advice given on this site and in your books as well.

10. John Stansbury Says:
    October 4th, 2010 at 10:04

    Avinash,
    What a great post with which to start the week! Here's an exercise that served a previous employer, myself, and my team very well:

    1. Ask as many of your constituents as possible to print every report they get/need. If it shows up in your inbox regularly, you clearly need it, right? And don't forget all of the emailed reports that are routed into invisibility by inbox rules.

    2. Meet with each constituent and really talk to them about their part of the business. No leading questions about data, just talk. Listen. Learn.

    3. After speaking with them for a while, ask them to go through the stack of reports they printed and highlight each specific data point that she or he uses to make real business decisions. Sit there with them. It takes a long time, yes. The light bulbs go off as people realize how much useless data they're being asked to consume and manage.

    4. After you have numerous reams of paper, sort by report title.

    5. Flip through all of the copies of each report and note which data points were most commonly highlighted.

    6. Compile a dictionary of these metrics and index by business users and purpose.

    7. My bet is that you'll have a handful of metrics that you can use as a foundation for an informational infrastructure.

    8. Get stakeholders (Finance, IT, Product Management, Marketing, etc…) to agree on definitions and sourcing.

    9. The process of agreed-upon definitions will likely organically lead into deeper questions such as those mentioned in today's post. If not, WA practioners have a prime opportunity, and responsibility, to prompt with business questions.

    Cheers,
    John

11. Lars Johansson Says:
    October 4th, 2010 at 10:11

    Less good cop, more bad cop.

    As a consultant the gold at the end of the rainbow is tempting, but if you show some patience that gold will turn into diamonds.

    Resist the fallen fruit that you can pick without reaching higher–it's often rotten! Low hanging fruit is better, and fruit closer to the sun may be even more ripe.

    Coincidentally, I blogged that "your reports suck!" a few days ago. On my Swedish blog webbanalys.nu though, which sucks too for some, I guess. Google Translate may think it's all bork bork bork..

    Beware of both HiPPOs and hogs. Hogs hog reports and want to bring you wuth them when rolling around in dirt.

12. Raghu Kashyap Says:
    October 4th, 2010 at 10:31

    Great post. Lots of these questions are so basic and eye opening that people really forget or take it for granted. I am big fan of the fact that asking questions is always educating both for the person asking it and also the person whom we are asking

13. Mark Kegley Says:
    October 4th, 2010 at 11:07

    Outstanding post, Avinash!

    These questions are perfect for getting to the root of answering true business questions, however..

    Our biggest client (for the agency I work for) is extremely traditional when it comes to advertising which yields many roadblocks. The main one from my prospective is the insane amount of data we are able to collect and gather insight from via web analytics VS yesteryear and the methods of determining ROI. The client cannot step outside of wanting us to give benchmarks and only report on things like: visits, pageviews, bounce rate etc.. (your standard and by default GA dashboard).

    My question to you is, besides giving them the twinkle in my eye, how can I get them to step outside of this metric quicksand just because they think these are the only "important" metrics? I've even tried your method of asking the simple question, why (3 times)? I understand your logic and see great value in obtaining this information from a client, but do you have any recommendations on how to really convince people/clients to define clear business objectives and questions in order to provide them with the appropriate KPIs and metrics that should be reported on?

14. Kalani Says:
    October 4th, 2010 at 11:55

    @ Web Analyst Newbie -

    I'm not Avinash, but having started my own web analyst career in a large difficult-to-change content-based media company, I feel your pain and maybe this might help you.

    1 – Accept the truth. Not all companies are difficult to change and include layers and layers of bureaucracy that prevent anything real from getting done. And if your company is like that (as some companies are) then your focus might not be changing the company (there are too many layers getting in the way) and more focusing on yourself. So hone your skills, listen, and don't get frustrated if you don't see change. Eventually, you will part ways with the company. Be sure that when you do, you have a long list of recommendations, analysis papers you've written, tools that you know about, and business communication skills that you can easily pick up even on the lowest level of the biggest company.

    2 – Do fabulous analysis anyway. For example, still ask all the questions to your immediate higher-ups. They might not know, of course, or care, but it gives you a place to start. If they don't know the answers, make some up and provide analysis that pushes towards those. Then use the answers to do side projects. Chances are that you will get good at rote reporting and busy work after a while– create for yourself some time at work or at home to work on unasked-for analysis. You can push these to your immediate higher-ups and if they like them, they will move up the ladder. Chances are good that even if the VPs all like them, they themselves might not really have the ability to make changes based on them, but if you play your cards right, they will have excellent things to say about you and you will hone your analytics skills.

    3 – Research, research, research. Let's say that your company uses Solution X, which is really lousy for what they want to do. You can make your own blog site to implement and learn Solution Y or Z. You might not be able to implement it on your work media site, but if you have a good argument, do the research, put it in a paper, compare another solution, you can push the professional report with your expert opinion to the Immediate Higher-Up. Even if they throw it away, you now have the skills in both solutions and the experience comparing them.

    4 – Make one-on-one connections. Chances are good, in a big company, there are a lot of disparate people using the data. They might not even be using it properly. But they are all individual chances of showing how useful your analysis can be, and what an expert you are on their data system. These people and their support will be more important to you in the long run as business connections who believe in your power to change their lives.

    I'm sure Avinash has better suggestions, but as a fellow web-analyst, I thought I'd weigh in. Hopefully this at least gives you a place to start.

15. Web Analyst Newbie Says:
    October 4th, 2010 at 12:29

    @Kalani

    Thank you. Really great advice. I agree completely, and I also am trying my hardest on Making my 1:1 connections. There's a lot of smart people here and I want to work with them and learn from them as much as I can.

16. Simon Austin Says:
    October 4th, 2010 at 13:00

    Great article.

    However, I wouldn't always assume that a request for a data point is useless.

    I find that there are two different types of requests that come to us, and we often focus on only one type. The first is best served by answering a business question, which is best served by the method Avinash so eloquently writes about here.

    The second type of request is for a data point that is simply needed for a "sell" presentation. E.g. I'm putting together a presentation and need some impressive numbers to use in order to make my point. Don't underestimate the importance of some good data points for "sell" presentations. The intended audience might not know that your website gets a tremendous amount of traffic so is something that should be invested in vs. say a field marketing program. Ideally the analyst would be brought in to help do a detailed analysis to answer that business question, but sometimes the answer is so painfully obvious your HIPPO just needs some simple data points to present to his HIPPO to make his case (it's HIPPO's all the way up…).

17. Avinash Kaushik Says:
    October 4th, 2010 at 17:21

    Michael: I like your idea of simply giving people access to the data if all they want is data for the sake of having data. They can then go an bathe in data as much as they want without wasting your time. Great recommendation!

    Joe: Both you and Michael mentioned this and I did not. I should have mentioned that to a great extent I do lay the blame for our sorry state on us, Analysts and Practitioners. We keep doing data puking and then we wonder how come no one is data driven. Good point.

    I am glad you see that my call to "rebel!" was more a call to a new mental model and less a job limiting recommendation. It is certainly a gradual process to evolve away from data puking. But if one does not embrace the rebel mental model nothing will change. So… Rebel! :)

    Rob: I love th idea of doing a deliberate and specific "performance acceleration" program with your clients. It provides a structured path out of this. Thanks so much for sharing this idea!

    Web Analyst: Regarding #1: I have never believed that being proactive needs to wait until you are an expert or empowered to be proactive. I realize that you are new and young but you can start to add small amounts of value with proactive questions and proactive providing of 5% extra stuff or right stuff. And then over time you get better. If it company ignores you or won't listen to your insight then it might be that 1. Your (or my) insights are not powerful enough (say not quantifying economic value, just reporting goals) or 2. It is time to move to another company that will appreciate your work (this is not easy in a recession but I would certainly put my resume out there).

    Regarding #2: A vast majority of business goals will have nothing to do with eCommerce or making a sale. This is were lead gen and downloads and voter registrations and rss sign ups and videos watched and…. tons of micro conversions come in. You measure all of those and quantify value. Please see my post on macro and micro conversions for many more specific examples.

    Oh and never shut up. Be the change. If not here then someplace else. Life is too short to shut up.

    [Also please see John Stansbury's nine step process, I think it will work in your case.]

    -Avinash.

18. Avinash Kaushik Says:
    October 4th, 2010 at 17:22

    John: Awesome nine step process to go from data puking to focusing on things that actually add value. Thank you for sharing this much detail and your experience. Thank you very much.

    I can't think of a more worthy cause for killing a small number of trees, they would have died for a good cause!! :)

    Lars: Joe had reflected some reality, that he can't just say no to his clients when they ask for data puking. And that worried me, because he is right and so how do we deal with it.

    I think your wonderful analogy provides a great path forward. Don't just go for the $500 that you can make from the client via data puking (which by the way we all have to do to some extent) but rather internally in our mind we have to extract the business questions because that will turn gold into diamonds.

    The client wins, better insights, and we as consultants win, diamonds!

    Kalani: Your feedback for Web analyst Newbie are much better than anything I would have said, thank you for taking the time to add such detailed and specific recommendations. Much appreciated!

    Mark: If you have tried the "so what" method to show them how bad their metrics are then I do have one more recommendation.

    Please try using my Line of Sight model. I have found that taking all the metrics out of the equation and forcing your clients to think about objectives, and not just some vaporware objectives but Price – Cost – Market Size – Market Share, and flowing that out to specific sales and marketing levers being used at the moment and then bringing in the metric (which will now be directly tied to a desirable outcome) will normally help accomplish.

    Pick the right metrics by taking metrics out of the first three conversations! :)

    Simon: Thanks for the distinguishing between the two main types of data puking requests. You are right, they are both important.

    For the second one though I would recommend the strategy Michael Notté highlighted in his comment: Give them access to the data. Train them if you have to, the investment is well worth it. Then they can go help themselves when they just "want the data" and you have just reduced your personal burden (to do more value added work) AND empowered people to help themselves for request type number two!

    -Avinash.

19. Mark Coleman Says:
    October 4th, 2010 at 19:34

    Spot on here Avinash – again – the ultimate CTA!

    It's like the #Measure "12 step" process:

    * Admit your data addiction has become unmanageable, constantly feeding data without positive results or insight

    * Believe in a greater future

    * Take inventory of the real contribution you can offer

    * Confess your sins to the #measure folks around you (or blogs like this)

    * You may find yourself asking HiPPO's for forgiveness (in other 12 steps this would be relapse but not here!)

    * Seek out those prior requests/requestors & amend the results with better questions

    * Constantly challenge yourself to ask & provide more

    * Never stop learning, and finally

    * Pass on this awareness to those you work with

    There will be relapses, it must constantly be practiced, you will be tempted to fall back in the data bottle, those quick hits, but don't

    And perhaps Avinash the only thing missing here is the emergency list of tips for those awkward moments when it's apparent those asking for data have no clue the root question.

    It can be rough, and it may not be a 100% success with all, some will resist (see coping list immediately above). There are times where data is completely valid.

    The job of a professional here is knowing when that is, and the other 95% of the time having the conversations that your clients deserve and all good consultants know how to draw out.

20. Clark Frye Says:
    October 4th, 2010 at 20:21

    Great post, Avinash!

    Data vs. Information – it's the story I find myself repeating to our clients and internal stakeholders. I like to start my response with "Yes, I **could** provide you that data, but what if I could give you xxxx instead?" Add a chat about how x becomes y and then y becomes $$. (now I'm talking their language).

    As with so many other things, making the other person feel like they're creating their solution goes a long way in gaining their buy-in and earning their conversion to the data-driven lifestyle.

    Short-term positive feedback – I love the point in the conversation where you can truly see the light bulb turn on and they become an ally in the data-driven crusade.

    Long-term positive feedback – I know when a former report requestor drank the Kool-Aid when they qctually book time to sit down and talk through their needs.

    RE: Your line on twins and businesses and how no two are alike – Love it! And it's so true.

    Thank you!! ;)

21. Theodor Mavrodis Says:
    October 5th, 2010 at 03:00

    As other people have said spot on.

    This is what I find the hardest thing on my job. It is about educating people to ask the right questions but it takes time. I wonder if there is an organisation out there that excells in this?

22. Abhinav Says:
    October 5th, 2010 at 03:13

    What if the analytics access is not given to the marketing person and kept with the technical lead?

    By technical lead I mean a person who knows to implement the code and get that analytics blurt out those numbers and nothing beyond that.

    A lot of companies are making this mistake and expecting those numbers to make some difference to their revenues. Any points on how to deal that?

23. Dan Derrick Says:
    October 5th, 2010 at 08:40

    While all the suggestions here are good, the reality is that unless you have done your homework, nothing much will come of your efforts. You need a champion who can stand the heat with you as you do the right thing.

    As a consultant I (sort of) have a champion in the person who hired me. Of course I've also had that same person turn on me and proclaim that I am the source of the problem. Goes with the territory.

    You can not force a person to eat especially if they are higher up in the chain than you are. You need to make them hungry. 80% of your work has to be done before the shoot out (or protracted fire-fight).

    Solving problems by eliciting the proper measurable questions first is Business 101. As my favorite commercial says "I gots it."

24. kim Says:
    October 5th, 2010 at 10:07

    Were it not for my dear friend Avinash, this squirrel would've jumped long ago. :)

    Thanks for keeping hope alive.

25. Brian C Says:
    October 5th, 2010 at 10:19

    Great post Avinash!

    I'd like to add that I've noticed that clients who tend to ask open-ended business questions to me have more respect for this "reporting squirrels" opinions than the clients who simply expect data points from me.

    Also, the same clients who ask these open-ended business questions generally adapt quicker than the other clients.

    Personally, I love the clients who attempt to teach me more about their business and what they expect out of their website.

26. Ophir Prusak Says:
    October 5th, 2010 at 11:58

    Great post as usual.

    I find that asking an additional question is often required and I'm surprised how many analysts don't ask it:

    "What are you going to do with my answer once I give it to you?"

    Sometime the person asking the question isn't quite sure, so I help them out by giving them make up answers and then asking them again – what are you going to do with this data?

    For example, I might be asked "what's the bounce rate for campaign X over the past 14 days?"

    I tell them (on the spot) "It's 45%. Now what?"

    You need to hammer into their heads the "now what" :)

    Ophir

27. Avinash Kaushik Says:
    October 5th, 2010 at 12:43

    Mark: I love it!

    Thanks for sharing this specific guidance and inspiring others with your words. I really appreciate this very much.

    PS: #7 & 8 I think are the hardest. I am constantly surprised at how rare they are.

    Chris: You are absolutely on the money that taking the conversations from "you want this, but I could give you this + 2, and here is how this + 2 ties to your personal $$$" is a magnificent strategy. I will keep beating the drum of Outcomes, Outcomes, Outcomes!

    Thanks for sharing the two signs to look to judge if things are going in the right direction. They are on the money.

    Theodor: I wish there were more, the ones I see are mostly small or medium sized companies.

    What I do see in my engagements with large companies is that there are individuals who excel in this and hence their small group / division in a large behemoth does really well. But at a big company level it is exceedingly rare to see this.

    But that is why we need to fight and that is why we need to focus on this. :)

    Abhinav: Two recommendations.

    1. Try to use a framework like the Clear Line of Sight Model to work directly with the business leaders to execute the recommended steps. It will get them to appreciate what you bring to the table, it will get them (if they are smart) to help you understand what the priorities are, and it will help you focus on what matters to measurement. Technical stuff will then be secondary.

    2. If the above does not work, or you have tried other structured processes to address the issue, then it might be time to look for another job. Don't quit tomorrow, but do get your resume out there.

    Dan: I am a passionate advocate for

    1. Squirrels investing in themselves to elevate themselves to Ninjas (i.e. continuous self improvement)

    2. Using frameworks like the Web Analytics Measurement Model and Clear Line of Sight to approach web analytics right.

    So you are 100% correct about the homework part.

    Consider this specific blog post as step three. After you do the above.

    You have your personal ducks in order. How to do you ensure your company/client gets value from you? Answer business questions. And if the person, as you kindly put it, won't eat or does not feel hungry then there are other options for you personally. :)

    Ophir: I have this process of asking "so what" but I like your more street smart "now what!". [See: Kill Useless Web Metrics: Apply The "Three Layers Of So What" Test]

    :)

    -Avinash.

28. Josh Braaten – Big Picture Web Says:
    October 5th, 2010 at 18:27

    I must have to hone my "eye twinkle" a bit more because I just wrapped up a nice big column/row report. I am definitely prone to your 1-2 list of the web analytics world.

    Experienced Analysis Ninjas such as yourself seem to have a type of "reporting aikido" whereby you redirect their request for report puke to Web Analytics and Multiplicity.

    I may have to offer up some ad hoc analysis based on your list of business questions for extra credit.

    Wonderful post as always!

29. Stephan Says:
    October 7th, 2010 at 06:12

    Love reading this blog even though this is my first time posting.

    I am trying to figure out how I can apply this ideal to my own situation.

    We are currently building out our own internal analytics system so these questions really hit home for me.

    The problem is that we are performance based marketers and really these questions for us turn into 'How can we improve our EPC?' and 'How can we balance our CPC costs in order to leverage the most traffic?'

    I think my point is that KPIs such as conversion rate, click through rate, and visits are the critical questions that we have to ask in order to gain insight into what our response should be so it is difficult for me to just throw out that way of thinking.

    The real value for me, and is the reason why we are building this system, is when we are able to automate these insights and actions to the point where we can optimize things based on comparisons of historical data from working campaigns.

    So what happens when your business questions are a directly affected by these metrics that you shouldn't be thinking about?

    Though it is a very real possibility that I may have completely misunderstood your point also.

30. Avinash Kaushik Says:
    October 7th, 2010 at 17:36

    Stephan: I think, and this is just my hypothesis, that you are conflating two different roles: the business's role in asking good questions and the analyst's job to answer the questions using analytical techniques and metrics available at her/his disposal.

    The two questions you mention in your comment are not business questions. They are important, they are specific, they should be answered. But strictly speaking they are not business questions.

    Business questions will be of the type mentioned at the end of the blog post.

    So it might be: "What are the best options to reduce acquisition costs while not killing our traffic?"

    You, the Ninja's action, might be to analyze all the acquisition streams, their costs, do some what-if and find CPC balancing is the best option (or more likely because you did not start at a rabbit hole you might find something different / better). You will do this via segmentation, drilling down below the KPI level (remember not everything is a KPI) and look at many metrics etc and answer many questions before you answer your business question of how to reduce cost.

    Two different roles. The first outlines the big desire. The second leads to specific analysis on various fronts before giving the right answer.

    Some of the latter work can be automated (perhaps by the system you are building). But I must admit that I have never believed that "automated systems" provide insights. They provide data. Often timely well processed data. But they are missing much of the context and tribal knowledge required to covert that data into insights. That is where you come in, an actual human.

    I would lower the expectations in your company that your internal system will deliver insights. I would stress that it will automate things and give you access to better data faster and it will allow you to do n-level segmentation etc etc which will deliver faster insights. But it's you.

    That is why we love analytics. You are important. 10/90 rule. :)

    Josh: It takes a lot of practice, and the willingness to get beaten up and getting up and trying again. Sad but true.

    This is very hard but as Joe said we have to figure out how to fight not just to get a pot of gold at the end but convert it into diamonds. That to me is a great motivating factor to try and see if on top of their data puke request I can add something that I think they really want or to go back and ask for some clarifying questions hoping to get to the root cause.

    -Avinash.

31. Kyle Rudy Says:
    October 8th, 2010 at 11:49

    Avinash, thanks for the great insight, i like many other have been susceptible for too long to the internal customer data reports. This is something i plan to start implementing immediately.

    I would also like to say that if a person asks for a report and they can not come up with business question behind a report, i would tell them to come up with one and I would get them a report. There is not enough time in the day to get people reports for the sake of reports; if they dont have a need, they dont really need the data imho. (unless its a hippo)

32. Bill Says:
    October 8th, 2010 at 15:09

    Great post!

33. Johan Says:
    October 11th, 2010 at 04:30

    Wicked Avinash!

    I've spent the whole morning and tried to identify Business Questions, just did not think it was called Business Questions until I read this post!

    Since I work in the public sector is often our Business Questions[..] require you to go outside your current systems and sources to look for data and guidance in order to measure success.

    This often creates exciting challenges for the person who came and asked me for the data in the first place.

    So by using this method, you are so much more than a Reporting Squirrel! Now im off to have a meeting and I will with a twinkle in my eye talk about Business Questions ;)

    Thanks again for an eye-opening blog!

    From Sweden!

34. Avinash Kaushik Says:
    October 11th, 2010 at 10:24

    Johan: Government websites can pose a unique challenge, especially because most of the the time the government just wants to do and not think. :)

    Here is a blog post I had written for an enterprising person working for the Belgian government about how I would approach measurement for them:

    ~ Web Analytics Success Measurement For Government Websites

    Perhaps you will find it to be of some value.

    Good luck!

    Avinash.

35. Maria Says:
    October 12th, 2010 at 04:25

    I have recently been interviewing for two junior web analysts to join my team. A key question asked in the interviews was…

    “If someone in authority (HiPPO) asked you for some ‘numbers’ what would you do”?

    The two candidates that were offered the job answered with something along the lines of…“I would ask them why they wanted to know what they wanted to know”.

    Despite having no analytics experience or any knowledge of analytics tools I have high hopes that these two individuals will go far.

    We had spent the previous 12 months unsuccessfully trying to fill a vacancy for a senior analyst. Of the expert tool users and reporting specialists that were interviewed none showed an appreciation or understanding of what being a web analyst is really about.

36. Kimberly Stedman Says:
    October 12th, 2010 at 15:59

    Ok– I know you're right, you know you're right.

    But when bound by the laws of organization physics, I come up against an insurmountable force:

    Money.

    When I ask the "why" of the data, I invariably learn one of two things.

    * My organization doesn't yet own access to the tool I would need to get you a meaningful answer

    * I can get you a meaningful answer with 10 ours of work.

    Or, I can spend 10 minutes giving you a spreadsheet of historical page views. And since we have no budget and are 50% understaffed for even basic puking duties, that's what I do.

    I hate it, you hate it. When people believe they can limp by with bile in lieu of meaning, they restrict funding to one bare-bones analytics tool and 2 seasick analysts. How do you show them that they need more? By asking the questions, and using the superior methods, that show value, so that they'll provide the funding, so that you can afford the headcount and the tools to ask the questions and use the superior methods…. oops.

    It's circular. How do you teach a company to prioritize meaningful data when you're so strapped for resources that it makes you want to, well… puke?

37. Marc Says:
    October 12th, 2010 at 16:49

    One caveat to refusing report requests is to log all the requests you receive, no matter how small. It's a great way to communicate to stakeholders the demand for metrics as well as a way to substantiate the need for additional resources.

    It's also a good way to look back and to consolidate repetitive requests into dashboards that all can benefit from.

    As always, great post!

38. Avinash Kaushik Says:
    October 12th, 2010 at 22:22

    Maria: That is a great insight! Your last observation is particularly key.

    So many people who are now "senior" in the industry grew up with the log file and technical implementation skills (which were key then) that they really struggle to bring a marketing / business perspective to analysis.

    They are all really good at the technical and the complicated technical (valuable skills), but web analytics itself long out grew the value of implementation and efficient "data puking". It is about "show me the money!" now, and rightly so.

    Kimberly: I empathize with you, and this is not just at large companies. Let me also say that you have guessed right, I have personally lived through this "hell".

    I should have said at the start of my blog post that my recommendation works when there is at least the faintest of desires in the company to want to be data driven and / or some support for the Analysts to do their job well. If that does not exist then no question asking will get us any where.

    Sad but true.

    In scenarios such as this my approach (based on graduating from the school of hard knocks) is:

    1. I first look inward at my own work as an analyst to see if I am doing this right. Are you insights powerful enough (whatever little I can provide in the compressed environment you are describing)? Am I just reporting page views or identifying some micro and macro conversions, quantifying economic value, focusing on visitor loyalty increases (and causes) etc?

    So how can I improve what I am doing.

    2. Have I tried the strategies outlined in how to create a data driven boss?

    ~ Six Rules For Creating A Data Driven Boss!

    3. If #1 and #2 have failed and I have determined that I am working at a company described in this blog post:

    ~ Online Marketing Still A Faith Based Initiative. Why? What's The Fix?

    It is time to move to another company that will appreciate my work. Life is too short to waste it in circumstances where the absolute futility of my job makes me want to jump off the Golden Gate bridge.

    It won't be easy to find a job in a recession but I would certainly put my resume out there and start looking. Meanwhile I'll also take up quilting as a hobby to find meaning in my life! :)

    All the best!

    -Avinash.

39. Praveen Says:
    October 13th, 2010 at 06:59

    Great post Avinash :)

    Thanks alot for such a great post, I have shared the link of this post with some of my clients and hope they will understand the point.

    Regards,
    Praveen

40. Leslie Says:
    October 14th, 2010 at 11:28

    Great blog post!

    I have the biggest problem with report requests. Does it matter if you get 300 clicks from an ad if each of them bounces or never gets to the final conversion? Nope, but that is the kind of request I get. To make things worse, analytics is only half my job. I create monthly reports for at least 10 different clients aside from my other broad Internet marketing strategic development and implementation duties. It is really tough to avoid data pucking with the time crunch and with such little time on each client!

    This is a great motivator for me to insist on asking (and thus receiving) those business questions and getting down to actual issues instead of numbers. I know my account execs and my clients don't get the numbers, but when I don't have anything coming in (questions, direction, feedback) it is truly hard to give good insight.

    Hopefully I can start to demand (nicely) a little more critical thinking and involvement on the AE side in developing questions and goals to drive analytics.

    I believe this through and through: unless we are using analytics to make decisions and reach goals, we are simply wasting our time looking at pretty charts and columns of numbers each month and I am wasting my time putting them together.

    Thanks for the push in the right direction and away from all this time wasting.

    Leslie

41. Kevin Says:
    October 14th, 2010 at 11:57

    A lot of great feedback to this post. I wonder if we can simply get away with asking back:

    Why do you want to know?

    -or-

    What are you hoping to learn?

    Yeah, we might get the "just send me the report" response, but we should take some responsibility to open the dialog.

    Oddly, I was just about to tweet that I need to change my educational diet. I want to read more about the industries I serve, and peel away from analytics reading a bit.

    I'm hoping I can learn some of the good questions ahead of time, so i don't go down this road every month.

    Thoughts on that?

42. Kevin Says:
    October 14th, 2010 at 11:59

    Of course, I just noticed that Maria's response above was basically mine in a nutshell. Thanks Maria, and sorry to ask the same questions :)

43. Avinash Kaushik Says:
    October 14th, 2010 at 12:29

    Leslie: It is hard to get them to answer your questions, at least when you start the relationship, especially in a client consultant relationship where the Client believes you know nothing and they are a gift to you. So starting with some data puking to report requests is all we can do.

    But you are right to stress that no insights will come of it so from week two (see I am the patient type :)) we start asking questions and trying to get to some root causes.

    I am thrilled that you are on the side of non-time-wasting. Life is just too short for that! :)

    Good luck.

    Kevin: The two questions you have outlined are prudent and will do the job. They are open ended, which is nice.

    I think if you back them up with some knowledge of the client and their industry you'll be able to have a much better conversation with the client. Because in response to your question they might say something odd or even but based on your knowledge you might be able to drill down or drill sideways to nail down exactly what they are looking to get done.

    So your plan to change your "educational diet" is completely on the money!

    Avinash.

44. Yosef Says:
    October 18th, 2010 at 01:39

    So I have a question not directly related to this post.

    I'm a beginning website manager and I would like to enhance my knowledge and understanding of web analysis. I've read many posts on this blog and I would like to go one step further and read one of your books. Which one should I begin with?

45. Philipp Says:
    October 18th, 2010 at 11:38

    Good point there! Acutally one of the most important questions about web analytics for me at the moment.

    In my experience its not that hard to ask the right questions as long as you have a clear target like sales (like an online shop that sells T-Shirts for example…btw I love the new page-analytics feature for that).

    But it can become pretty though when you have to work with softer targets like creating awareness. Especially for websites that are selling "promotional-goods" it is a hard thing to do.

    For example the music industry. Most of the new media / digital departments are having a hard time to proof that they are worth the money. TV, radio and print departments are still much more appreciated in most labels. On top of that iTunes & Co dominate the online retail so the online departments often have no direct control about the traffic and the impact of the awareness they are trying to create.

    My point is: There is a difference between clear targets like sales and softer targets like awareness. What question do you ask someone who's aim is to create awareness (despite newsletter subscriptions and stuff like that) but is not directly selling? Maybe I should put like that: Is there even a way?

    I would appreciate every hint ;)
    Philipp

46. Bhagawat Jadhav Says:
    October 19th, 2010 at 05:36

    Hey Avinash,

    What a great support from your blog to convince about the business questions and not only data pulling for report.The HiPPos will definitely check out the request they always used to send us only for data.

    I am hoping for positive feedback from these guys.

    Let us see. I looking forward to solve much more business questions not the reporting :).

    Thanks,
    Bhagawat.

47. Bhagawat Jadhav Says:
    October 19th, 2010 at 05:44

    Also I forgot to add one more thing that I liked the comments you got for this post.Thanks everyone for commenting and sharing their thoughts here.

48. Avinash Kaushik Says:
    October 19th, 2010 at 15:28

    Philipp: You are right that success measurement is a bit easier for ecommerce type sites and a bit harder for non-ecommerce sites. But. It is totally possible, just needs a pinch of imagination.

    For example if you step outside the clickstream world you are able to tap into competitive intelligence and other sources to measure success in improving awareness. Some specific tips on this are in my post about measuring success for branding campaigns (where all the targets are "soft"):

    ~ Brand Measurement: Analytics & Metrics for Branding Campaigns

    The music industry case is a bit more unique. I am not so sure that it is a measurement problem, or at least not yet. The music industry has decided to put its head into the sand and wish away the internet, their strategies reflect that. So it is a business problem they need to solve first (measurement will come later).

    It is important to realize that we have limits when it comes to data. We can only do so much, after a certain point if the business side of the house is in a mess or the Senior Leadership is unimaginative about using the web then it is not the data's fault one way or the other. :)

    Please see this post:

    ~ Online Marketing Still A Faith Based Initiative. Why? What's The Fix?

    Avinash.

49. Chris Leone Says:
    October 27th, 2010 at 06:33

    Hi Avinash,

    These are great suggestions on driving meaningful analysis. Thanks!

    Turning into a reporting squirrel is one of the biggest boobie traps in the world of being a web analyst, imo. No matter how hard you convince yourself that "things will be different this time," we'll end up putting those tables and columns together if we let any one else, especially the hippo, drive the web "analysis."

    Of course, we are working to make our hippos and company/clients :D , but if we aren't resolute with our initial objectives, other voices and opinions will begin to dominate the course of the web analysis, inevitably leading to pages and pages of spreadsheets.

    It sounds silly, but it feels like this is a beast I'm constantly fighting off with clients, especially for those that insist on having their hands in the data and want to make their authority known.

50. Rebecca Says:
    December 20th, 2010 at 07:25

    Loved this post.

    The purpose of analytics is, after all, to further business goals… not ot just take a thermometer reading occasionally and never investigate causes and remedies…..

    However, it is much more difficult to answer the business questions… and to be sure that you have really found a good true answer.

    What advice do you have for aspiring analytics experts to guide them on the path to being able to contribute meaningfully through analytics?

    Are there specific books that address the topic? Other sources of info?

51. Felipe Maggi Says:
    January 7th, 2011 at 15:40

    Dear Avinash:

    I was working in the field of web development for more than 12 years. And in the field of Web Analytics for the last two years. In all this time, I have heard a real good bussiness answer only once. Maybe I have asked the right question also only once.

    Some day a refered unknown client call me and said: I need to improve my web. I said: "Ok. What is the purpose of your site?"

    The client answered very quickly: "Get more patients, and as a result make more money". (The client was a doctor, neurosurgeon, that have a web with a great number of informative articles on his specialty).

    The response, not the question, was open ended, forced me to look beyond the data offered by my beloved tool of analysis and, of course, brings to the table an issue that could not be resolved with rows and columns.

    Perfect. And very,very exciting.

    With this answer in my mind, I visited the site and in few minutes I find insights. Only one example: the site needed improvements in their metatags, for get organic trafic. But thinking in patients, not in other surgeons…

    But I know that the real hard work not was done by me. The real hard work was done by the client before calling. He spent some time thinking about your site, and obtained a business response to a business question before no one asked for that.

    After this event, in my diary work, I try to give customers time to think. It makes my career a lot more fun.

    Regards
    Felipe.

Join the conversation. . . .