Random metric names and symbols is not an equation

Let’s be honest with ourselves here. Not everyone is good at math. Once we all accept this, the social media measurement world is going to be a hell-of-a-lot better off.

Watch this video. Ignore everything except the equations and how they progress. Yes, some of the metrics are complete nonsense. Yes, subscribers are just like followers. Yes, the video transition effects were nifty. I am asking you look past all of this.  Focus solely on the thought progression to the final equation.

You likely didn’t take notes while you watched that, did you?  If you didn’t, you missed all the messy bits. But, have no fear, because I am going to take you though the proposed equation step by step so you can see it for what it is- (mess x epicfail)/lack-o-judgment.

First, the host introduced you to three major metric categories (volume, engagement, & conversions). Under those three categories she listed several proposed metrics. Do you remember this? Or were you to focused on the super hero t-shirt? I know; it was a great t-shirt.

Now to make following the progression of this proposed equation easier, I broke each of those metrics into two groups. For example, I split the proposed Volume metrics into those that represent Reach & those that show Frequency. For Engagement I parsed the metrics into Time and Content engagement types. Lastly, I broke the metrics mentioned in the Conversion category into Responses & Revenue related metrics.  If you’re reading all this and are confused, the picture below should clear everything up.

Part 1

In the next section the presenter outlined how you should divide these metrics, regardless of which category they were in within the previous section, into two groups: Hot & Cold metrics. Try to ignore that these groups make about as much sense as splitting the metrics by what which letter of the alphabet they start with. I know it’s hard, but just try.

The metrics the video host allocated to the Cold side are those that fall into the standard media buyers equation (reach x frequency) / timespent.  Additionally, revenue & responses are also fall under  Cold metrics. NOTE: it is not specified where in the equation these metrics belong, just that they belong there. Somewhere. The Warm side contains “harder to measure” Content Engagement metrics such as Sentiment & Ecosystem.  See below for the picture-fun version.

Part 2

Now does anyone see some major possible issues yet? You should. If not, I am more than happy to point them out.

  1. The actual metrics in the previous sections are replaced with less specific category titles. This begs the question why were those category groups originally defined? 
  2. Responses & Revenue aren’t included in the Cold metrics equation & seem to be mentioned as an after thought?
  3. Many of the data rich metrics in Content category of Engagement  are completely ignored, instead favoring to rely solely on Sentiment analysis
  4. The host has introduced a new metric to the equation which was not included in the previous metric categorization: Ecosystem

So after all few more sultry glances and mirage of smoke, mirrors, and excessive metric organization, the video host presented the final equation:

Part 3

You’ll likely note I added a little color to the above graphic. Here’s why. The yellow represents those metrics the host mentioned previously in each part of the discussion leading up to the grand reveal of the master equation. The plum section signifies metrics that were introduced in the second part of equation definition. Those red highlights those metrics which may have been alluded to, but were not brought out specifically during the previous discussions.

So now let’s play point out the possible problem points again (it’s a fun game isn’t it?).

  1.  What are the Page Views & Visits in the Social Media world? Up until this point we have not see anything in this video that mentions these metrics or what defines what metrics would represent them.
  2. Where did Frequency & Reach go? Are they supposed to be represented by Page Views & Visits? Are those two things really the same thing in social media measurement?
  3. Why did the equation change from Timespent being in the denominator of the Cold metrics portion of the equation, to being an additive?
  4. Why are Responses and Revenue removed, especially since they’re the only metrics which track possible financial return?
  5. What exactly is the resulting metric meauring?

Now let’s combine everything together into a pretty picture. It’s a beautiful disaster.

 

DREquationSmackdown

This entry was posted in Equation Smackdown and tagged , , , , , . Bookmark the permalink.
  • Pingback: Tweets that mention » Blog Archive » Random metric names and symbols is not an equation -- Topsy.com()

  • http://blattcave.com/ Rob Blatt

    What’s the point of the equation? After watching the video, I get to thinking that if you monitor your key performance indicators, you don’t need an equation. Just numbers. Numbers go up? Good. Numbers go down? Bad.

    Maybe she’s trying to answer the ROI question?

  • http://blattcave.com Rob Blatt

    What’s the point of the equation? After watching the video, I get to thinking that if you monitor your key performance indicators, you don’t need an equation. Just numbers. Numbers go up? Good. Numbers go down? Bad.

    Maybe she’s trying to answer the ROI question?

  • Anna

    You know, I am not certain what the point of any of it is.

    My thought is that it’s a knee jerk reaction, IE. If we have metrics we must have an equation. The reality is, in basic reporting there aren’t a lot of equations. Comparison metrics(historic V present), with a little context, typically suffice.

  • Anna

    You know, I am not certain what the point of any of it is.

    My thought is that it’s a knee jerk reaction, IE. If we have metrics we must have an equation. The reality is, in basic reporting there aren’t a lot of equations. Comparison metrics(historic V present), with a little context, typically suffice.

  • http://blog.jimnovo.com/ Jim Novo

    The upside to social media is people get to expose once and for all how little they know about a topic so they can be forever ignored as a legitimate resource.

    The downside: very few people understand what the upside is.

  • http://blog.jimnovo.com/ Jim Novo

    The upside to social media is people get to expose once and for all how little they know about a topic so they can be forever ignored as a legitimate resource.

    The downside: very few people understand what the upside is.

  • http://www.amymengel.com/ amymengel

    Rock breaks scissors. Scissors cut paper. Paper covers rock. Sentiment beats time spent. Page views trump ecosystem. Click-throughs beat retweets. Cold metrics beat… *head explodes*

  • http://www.amymengel.com amymengel

    Rock breaks scissors. Scissors cut paper. Paper covers rock. Sentiment beats time spent. Page views trump ecosystem. Click-throughs beat retweets. Cold metrics beat… *head explodes*

  • http://www.jmorganmarketing.com/ jacob morgan

    All I can do is laugh, this is great. Once I sent this video to Olivier I knew he would have a field day with it, now it’s everywhere; this is beautiful…I just got a little tear in my eye, thanks :)

    What’s amusing to me is the name of the co is “digital royalty” and apparently she represents some pretty large name folks… go figure.

    Jacob

  • http://www.jmorganmarketing.com jacob morgan

    All I can do is laugh, this is great. Once I sent this video to Olivier I knew he would have a field day with it, now it’s everywhere; this is beautiful…I just got a little tear in my eye, thanks :)

    What’s amusing to me is the name of the co is “digital royalty” and apparently she represents some pretty large name folks… go figure.

    Jacob

  • Anna

    @Jacob He actually shared the video with me and all I could say was really? that’s not even an equation. I had to watch that stupid thing several times to try and follow her disjointed logic. Then I literally drew the process flow and I was still confused.

    @amymengel I can’t even come up with a response that is awesome enough to be on par with this comment. So simply, lol.

  • Anna

    @Jacob He actually shared the video with me and all I could say was really? that’s not even an equation. I had to watch that stupid thing several times to try and follow her disjointed logic. Then I literally drew the process flow and I was still confused.

    @amymengel I can’t even come up with a response that is awesome enough to be on par with this comment. So simply, lol.

  • http://btrandolph.com/ Todd Randolph

    the site is a mess, too. is anyone actually paying this person to do stuff for them? looked like she had pretty deep contacts in college sports…

  • http://btrandolph.com Todd Randolph

    the site is a mess, too. is anyone actually paying this person to do stuff for them? looked like she had pretty deep contacts in college sports…

  • Anna

    @Todd the creator has over a million followers on twitter….. scary to think about.

  • Anna

    @Todd the creator has over a million followers on twitter….. scary to think about.

  • http://www.seanbohan.com/ Sean Bohan

    just found this post thanks to Olivier’s twitter feed – now I am gonna lose HOURS reading your blog!

    ARRRGGGHHH!!!!

    (thanks)

    :)

  • http://www.seanbohan.com Sean Bohan

    just found this post thanks to Olivier’s twitter feed – now I am gonna lose HOURS reading your blog!

    ARRRGGGHHH!!!!

    (thanks)

    :)

  • http://blog.owengreaves.com/ Owen Greaves

    I saw this video before seeing it here but lets be completely honest, this video doesn’t really solve anything. It’s a very poor understanding of what truly needs to be measured and how it should be measured. Olivier is the man, he has the deepest understanding of Social Media ROI that I have ever met.

    Have fun!

  • http://blog.owengreaves.com Owen Greaves

    I saw this video before seeing it here but lets be completely honest, this video doesn’t really solve anything. It’s a very poor understanding of what truly needs to be measured and how it should be measured. Olivier is the man, he has the deepest understanding of Social Media ROI that I have ever met.

    Have fun!

  • http://basberkenbosch.wordpress.com/ Bas Berkenbosch

    I a m u t t e r l y s p e e c h l e s s. Do people make money with this complete BS?

  • http://basberkenbosch.wordpress.com Bas Berkenbosch

    I a m u t t e r l y s p e e c h l e s s. Do people make money with this complete BS?

  • Pingback: Emperor’s new cloths torn apart « ROI Marketing()

  • http://www.partnersinc.biz/blog Lynda Partner

    All very interesting but who is this mysterious Olivier?

  • http://www.partnersinc.biz/blog Lynda Partner

    All very interesting but who is this mysterious Olivier?

  • Anna

    @lynda you can find Olivier on twitter- @thebrandbuilder. He’s a great guy and a must follow for Social Media insight.

  • Anna

    @lynda you can find Olivier on twitter- @thebrandbuilder. He’s a great guy and a must follow for Social Media insight.

  • http://marketingteaparty.com/ Ron Shevlin

    My brain was turning to mush, slowly leading out of my ears, as I watched that clip.

    But when she said that the ROI calculation was something brands could track “every week”, I popped a gasket, and my brain came pouring out of my ears. I’m still trying to clean up the mess.

  • http://marketingteaparty.com Ron Shevlin

    My brain was turning to mush, slowly leading out of my ears, as I watched that clip.

    But when she said that the ROI calculation was something brands could track “every week”, I popped a gasket, and my brain came pouring out of my ears. I’m still trying to clean up the mess.

  • Pingback: DR. WHAW? – September 28, 2009 « One true sentence.()

  • http://www.blackbeak.com/ Steve Jackson

    Very good post on how to scare marketers.

  • http://www.blackbeak.com Steve Jackson

    Very good post on how to scare marketers.

  • Pingback: Planner Reads » Blog Archive » Mind-boggingly Stupid()

  • Don Rocin

    That’s a lot of trouble you went to there…to save us from what? Of course its bullshit; what did you expect? Here’s the thing: marketing is not a logic system; and rarely is it a value system – in the economic sense of the word… it’s a hope system – more like a religion than an science. To delve into this fantasy world to pick on some absurdity is akin to subjecting a character from Alice In Wonderland to a lie detector test. That’s why all the flakes in SEM and SEO are tolerated, because to expose them ends up exposing everything. And no one wants that. But, just between us, here’s a metric to consider: 88.8% of all products don’t solve what they promise…the cereal you eat won’t make you fitter; the Friday night perfume won’t mesmerise the man you hope for; and that car won’t make you any more appealing to women than you are without it. It’s the purchase, the sacrifice, that produces the hope satisfaction, not the product. If you want to find the truth, don’t waste your talents on this industry.

  • Don Rocin

    That’s a lot of trouble you went to there…to save us from what? Of course its bullshit; what did you expect? Here’s the thing: marketing is not a logic system; and rarely is it a value system – in the economic sense of the word… it’s a hope system – more like a religion than an science. To delve into this fantasy world to pick on some absurdity is akin to subjecting a character from Alice In Wonderland to a lie detector test. That’s why all the flakes in SEM and SEO are tolerated, because to expose them ends up exposing everything. And no one wants that. But, just between us, here’s a metric to consider: 88.8% of all products don’t solve what they promise…the cereal you eat won’t make you fitter; the Friday night perfume won’t mesmerise the man you hope for; and that car won’t make you any more appealing to women than you are without it. It’s the purchase, the sacrifice, that produces the hope satisfaction, not the product. If you want to find the truth, don’t waste your talents on this industry.

  • Anna

    @don I am not going to start a war with you on the impossibilities of measurement, because everyone knows that there is NO perfect measurement in any field whether it be physics or Social Media. Now what I will say it is worth it to try and progress toward the BEST AVAILABLE measurement. Now you can say my post was pointless or a waste of time. You’re entitled to your opinion. But my defense is that if someone doesn’t push for a progression to a better use of metrics ( note: I am not way implying these will be perfect metrics) there will be no consistency or validity in our industry. I watched web analytics go through these same growing pains and I want to make sure social media works through them more effectively.In response to your assumption that hope drives marketing, perhaps it does- on the consumer level. But trust me I have never met a CEO that in response to a sizable investment in a marketing effort wants a some fluff quotes or comments on consumers hopes. They want bottom line return on investment metrics. Money talks, bullshit walks or this case hope walks. So, I guess my work isn’t so pointless afterall, is it?

  • Anna

    @don I am not going to start a war with you on the impossibilities of measurement, because everyone knows that there is NO perfect measurement in any field whether it be physics or Social Media. Now what I will say it is worth it to try and progress toward the BEST AVAILABLE measurement. Now you can say my post was pointless or a waste of time. You’re entitled to your opinion. But my defense is that if someone doesn’t push for a progression to a better use of metrics ( note: I am not way implying these will be perfect metrics) there will be no consistency or validity in our industry. I watched web analytics go through these same growing pains and I want to make sure social media works through them more effectively.In response to your assumption that hope drives marketing, perhaps it does- on the consumer level. But trust me I have never met a CEO that in response to a sizable investment in a marketing effort wants a some fluff quotes or comments on consumers hopes. They want bottom line return on investment metrics. Money talks, bullshit walks or this case hope walks. So, I guess my work isn’t so pointless afterall, is it?

  • http://www.thoughtgadgets.com/ Ben Kunz

    The ferocity of your smackdown has me terrified to comment. But I will bravely venture forth. Anna, if social media involves consumers communicating among themselves in the marketing funnel, then isn’t measuring it simply a matter of isolating:

    – awareness (marketing message seeding)
    – dissemination (marketing message spreading)
    – sentiment (positive or negative)
    – action (marketing response leading to sales)

    I don’t mean to simplify this, but it all seems extraordinarily basic. Each of the above could have components. Some of those components could be difficult to gather (missing information is a separate issue). But the logic is rather basic. We are tracking people moving toward a business through the marketing funnel and, if data exists, tracking resulting actions which could be used to calculate return on investment. I am stunned that gurus like the one in this video make it seem so complex. Am I missing something?

    And yes. It was a very nice T-shirt.

  • http://www.thoughtgadgets.com Ben Kunz

    The ferocity of your smackdown has me terrified to comment. But I will bravely venture forth. Anna, if social media involves consumers communicating among themselves in the marketing funnel, then isn’t measuring it simply a matter of isolating:

    – awareness (marketing message seeding)
    – dissemination (marketing message spreading)
    – sentiment (positive or negative)
    – action (marketing response leading to sales)

    I don’t mean to simplify this, but it all seems extraordinarily basic. Each of the above could have components. Some of those components could be difficult to gather (missing information is a separate issue). But the logic is rather basic. We are tracking people moving toward a business through the marketing funnel and, if data exists, tracking resulting actions which could be used to calculate return on investment. I am stunned that gurus like the one in this video make it seem so complex. Am I missing something?

    And yes. It was a very nice T-shirt.

  • http://twitter.com/blairgoldberg Blair Goldberg

    I cant’ agree with you more Anna. (Re: your response to @don)

    The whole point of marketing analytics is to be able to make more educated decisions. Anyone who’s looking for epistomologically certain knowledge of *anything* is bound to be disapointed. As Kierkegaard says, you can’t be truly certain of anything, we can only look for what is the most probable.

    Working without these kinds of analytics is the equivalent of closing your eyes and trusting your internal compass to know that you’re walking in the direction you intend. (Admittedly, if you *only* rely on these kinds of analytics, it ends up being like driving a car by watching the rearview mirror)

  • http://twitter.com/blairgoldberg Blair Goldberg

    I cant’ agree with you more Anna. (Re: your response to @don)

    The whole point of marketing analytics is to be able to make more educated decisions. Anyone who’s looking for epistomologically certain knowledge of *anything* is bound to be disapointed. As Kierkegaard says, you can’t be truly certain of anything, we can only look for what is the most probable.

    Working without these kinds of analytics is the equivalent of closing your eyes and trusting your internal compass to know that you’re walking in the direction you intend. (Admittedly, if you *only* rely on these kinds of analytics, it ends up being like driving a car by watching the rearview mirror)

  • Anna

    @benkunz The high level goals are simple enough, I agree. It’s the nooks and crannies that get complex. I think what happens is people who have never worked with measurement don’t have experience in distilling mass amounts of data down to key focuses of measurement. Many try to fit everything into some magic formula, but that’s not what matters. The goal is not to create a massive overall equation, but rather to narrow down to what metrics really reflect the goals of the initiatives. For some companies it maybe acceptable to use some sort of buzz metric to represent prevented attrition of customer base in the ROI formula. In others that’s not going to work. So, getting back to you point, yes in theory it’s simple, but in practice it can be messy.

  • Anna

    @benkunz The high level goals are simple enough, I agree. It’s the nooks and crannies that get complex. I think what happens is people who have never worked with measurement don’t have experience in distilling mass amounts of data down to key focuses of measurement. Many try to fit everything into some magic formula, but that’s not what matters. The goal is not to create a massive overall equation, but rather to narrow down to what metrics really reflect the goals of the initiatives. For some companies it maybe acceptable to use some sort of buzz metric to represent prevented attrition of customer base in the ROI formula. In others that’s not going to work. So, getting back to you point, yes in theory it’s simple, but in practice it can be messy.

  • http://basberkenbosch.wordpress.com/ Bas Berkenbosch

    @ Don
    Where were you educated on marketing? And which textbooks did you ever read after that? Where do you really stand? Or do you just float? Hoping things just work out?

  • http://basberkenbosch.wordpress.com Bas Berkenbosch

    @ Don
    Where were you educated on marketing? And which textbooks did you ever read after that? Where do you really stand? Or do you just float? Hoping things just work out?

  • http://www.allisonsumpter.com/ Allison Sumpter

    As I stated on Twitter, Anna, this stuff is Greek to me right now. I’m just starting to learn in this arena. But this post is very well organized with a breakdown I can follow and do very much appreciate. Glad I stumbled upon it! And you! :)

  • http://www.allisonsumpter.com Allison Sumpter

    As I stated on Twitter, Anna, this stuff is Greek to me right now. I’m just starting to learn in this arena. But this post is very well organized with a breakdown I can follow and do very much appreciate. Glad I stumbled upon it! And you! :)

  • Pingback: DR. WHAW? Sunday Digest – Week-ending October 4, 2009 « One true sentence.()

  • http://from.simontsmall.com/ Simon T Small

    Wait wait, I think I get it…

    (Cute girl + little t-shirt X buzz words) / unicorns = clients getting sucked in

    Can they setup my Twitter account? I can’t figure it out.