Open Analytics Talk

Embed Size (px)

Citation preview

  • 7/28/2019 Open Analytics Talk

    1/16

    Copyright 2013 Porter Novelli Inc. All rights reserved. CONFIDENTIAL AND PROPRIETARY MATERIALS OWNED BY PORTER NOVELLI INC.

    Developments and Challenges Social Media Measurement

  • 7/28/2019 Open Analytics Talk

    2/16

    Agenda

    Who is this guy?

    Dj vu all over again

    A game of Chutes and Ladders

    Light at the end of the tunnel?

  • 7/28/2019 Open Analytics Talk

    3/16

    Who is this guy?

    20 years research/analytics experience

    Focus on media: Turner Networks, MySpace,

    Yahoo, media/ad agencies

    Quantitatively focused:

    MMMs

    Segmentation Analysis Campaign Attribution

    Behavioral Targeting

    Fan/Follower Valuation

  • 7/28/2019 Open Analytics Talk

    4/16

    Who is this guy?

    The Public Relations

    discipline took hold of socialmarketing

    PorterNovellis client base

    is global, which leads to

    some interesting social

    media analytics

    opportunities

  • 7/28/2019 Open Analytics Talk

    5/16

    Dj vu all over again

    Dirty data in the social space

    Inappropriate methodologies

    Vendors that do not care about data

    quality

    No industry standards

  • 7/28/2019 Open Analytics Talk

    6/16

    Dj vu all over again

    Data is spam laden

    All tweets are not created equal

    Interactions across social channels

    mean something different

    Does an emoji connote sentiment?

    Does it generate influence? Howmuch influence does it generate?

    What is influence worth? What is

    reputation worth?

  • 7/28/2019 Open Analytics Talk

    7/16

    Dj vu all over again

    Because of the sheer volume of data,

    trying to make sense of this has led somefirms down very strange roads

    A common approach is to sample the

    social conversation, and infer quantitative

    conclusions

    This is in defiance of the Central LimitTheorem

  • 7/28/2019 Open Analytics Talk

    8/16

    Dj vu all over again

    On my arrival into the public relations

    industry, I took as many vendor meetingsas I could. My findings:

    All data vendors have the best

    sentiment scoring engine though the

    criteria for this claim is unknown

    Vendor-side spam filtering is ineffective

    The interest across vendors is creating

    prettier charts with vibrant colors, rather

    than data quality

    magic beans

  • 7/28/2019 Open Analytics Talk

    9/16

    Dj vu all over again

    There are several groups trying to develop

    some industry standards around social mediameasurement, but as of now, there are no

    accepted standards

    The best we have at the moment are the

    Barcelona Principles

    Will social media ever get to the same level ofstandards as the IAB/WAA on online media

    measurement?

  • 7/28/2019 Open Analytics Talk

    10/16

    Chutes and Ladders

    Every thing is measurable

    The reason that standards were

    developed on the web analytics side was

    due to the investment

    Public relations wants more marketing

    dollars

    Standards are coming out, but are they

    strong enough?

    Where:

    E = excused from flyI = insanity

    R = requests an evalu

  • 7/28/2019 Open Analytics Talk

    11/16

    Chutes and Ladders

    Is the objective of the social analytics qualitative insights mining, me

    both?

    If sampling leads to inappropriate or insufficient conclusions what ar

    measurement options?

    In the web analytics world, we take spam filtration for granted; in soc

    everything.

    Every social analytics program is going to have error some known

    unknown.

  • 7/28/2019 Open Analytics Talk

    12/16

    Light at the end of the tunnel?

    There are platforms that allow a full

    analysis of text some are robust

    and offer easy ways to integrate

    text and other data into one

    reporting platform

    The solution that we have

    developed is using an open source

    text analytics platform, so weeffectively built our own solution

  • 7/28/2019 Open Analytics Talk

    13/16

    Light at the end of the tunnel?

    People talk about brands, products

    and services using a specific

    ontology

    Sick connotes good for some

    categories, bad for others

    Most vendors who provide

    sentiment scoring across the entireuniverse of conversation are not

    able to account for these

    differences

  • 7/28/2019 Open Analytics Talk

    14/16

    Light at the end of the tunnel?

    Process:

    Pull in data from multiple sources

    Build dictionary and grammar rules

    Categorize text by conversation

    category and sentiment based on rules

    (human and machine learningalgorithms)

    Human scoring and validation

    Dump results to UI

  • 7/28/2019 Open Analytics Talk

    15/16

    Best Practices

    Any vendor who talks about best sentiment engine based on wha

    Know your data

    Get as close to the source as you can

    Solutions custom to your needs are always better than out-of-the-box

    Beware of pretty Uis

    Good governance of data and analytics

  • 7/28/2019 Open Analytics Talk

    16/16

    Questions?