33
u Visual search for social Every company tracks social media through text. But today the conversation is visual… 85% of photos with brands and products CANNOT be found with text search alone. They need visual search. 85% 15%

David Rose, MIT Media Lab: Ditto Labs and the torrent of UGC on social media

Embed Size (px)

Citation preview

u

Visual search for socialEvery company tracks social media through text. But today the conversation is visual…

85% of photos with brands and products CANNOT be found with text search alone. They need visual search.

85%

15%

1.8 Billion photos are shared every day!

Every product company faces the challenge to find and leverage social photos, and feed their CRM

Now with Ditto, marketers can find their brand photos and the fans who post them

Ditto is a proprietary visual search engine built by MIT-trained

vision scientists that scours photos on social networks like

Twitter, Instagram and Tumblr to identify brand logos.

DEMO: Realtime brand-matches from Twitter and Tumblr: streamditto.com

1. Live Photos

4.

7. Influencers

PRE_PROCESS CLASSIFIER PIPELINE VALIDATION DATABASE OF AFFINITIES

FEATURE POINT DETECTION

MATCH REFINEMENT

PATTERN TEMPLATES

15 million/day

50 million/day

120 million/day

Logos Characters Flags

Image Queue

Ditto continuously processes photos for brands, faces, smiles and more, to compile a database of affinities

Resize Normalize Divide into color channels

HOG BOW HAAR

Faces Facial Expressions CNNs.Objects CNNs.Scenes

Machine learning classifiers *Image statistics *Feature point weighting

FEEDBACK & RETRAINING

Graph of people, friends, followers, photos & attributes, and affinities

*Broaden region of match *Boost confidence with detailed pass

Matching of features

Detect features

CONFIDENTIAL

SOURCES

ANY PRIVATE SOURCE• Facebook • Pinterest • Tencent • Customer review sites • Flickr • Publishers (ad-targeting) • Broad Web (ad-targeting) • etc.

“Deep learning” on photos reveal more than brands, including products and contexts-of-use

Smiles

Fabric

Animals

Glasses

Scenes, revealing context-of-use (snow, beach, indoor)

Shoes

Product patterns like these from Vera Bradley are also detectable

What you eat…

Confidential

What you wear…

What you watch…

Where you shop…

Through fan photos, French’s found a new pairing worth sharing—broccoli.

Key value propositions for photo-listening include insights, quantitative analytics, and ad targeting

1) Product insights How is my product being used? In what context?

With what other products?

2) Competitive Intelligence How does my visual brand presence compare with

my competitors’? Where am I leading v. following?

3) Customer Acquisition and Ad Targeting Who are my fans? What do they care about?

How can I use social media to laser-target my

competitors’ audience?

Brands/agencies use Ditto for marketing insights, and as a CRM tool to grow their customer base

CPG

Sports

Fashion

Beverage

QSR

Auto

BK

Redbull Coke Beam

Vera MK

NHL MLB Fox

Nestle Kraft

VictoriaSecret

Chobani

Ford

Bacardi

Brand Manager tool

1. 2. 3.Live Photos Photo Impressions Customer’s Face

4. 5. 6.Brand Life Shared Interests Word Cloud

7. 8.Influencers Heat Map

Photos for each brand can be sorted by place, time, popularity, smiles and groups

Profile shots show the face of the customer who is posting these photos

Analytics measure the number of photos, how many people have seen them and how many people engaged with them

See what other brands appear frequently in your fans’ photos

View your audience’s affinities normalized against the general population

Download the user ids of your most influential fans for ad-targeting or engagement

Analyze what people say about these photos

Interact with a heat map of where these photos appear across the globe

Through fan photos, French’s found a new pairing worth sharing—broccoli.

Brand and agency relationships accelerate enterprise software deals

Yahoo/Tumblr/Flickr

Twitter

Pinterest

Facebook/Instagram

Amazon

Apple

TenCent

Social ListeningSRMs + Media Buying

Big Social Platforms Agencies

SalesForce/Radian6

Adobe Social

Sprinklr

Oracle/Virtue

BrandWatch

Tracx

IBM Social

Crimson Hexagon

Spredfast

Clarabridge

Simply Measured

Millward Brown

500+ total

WPP/GroupM

IPG/Hill Holiday

Publicis/Digitas

MDC

Havas

Dentsu

5000+

Brands

Kraft

Modelez

Unilever

P&G

J&J

InBev

Nestle

Campbells

Kimberly Clarke

PepsiCo

10k+

EDUCATE

Visual BrandPower™ helps companies see how they compare relative to marketshare

BrandPower™ = Photoshare / Marketshare

Visual BrandPower™ is a metric that ONLY DITTO can generate: VisualBrandPower.com

BrandPower™ = Photoshare / Marketshare

Trajectory of Uses for User Generated Photos

Discover, Organize, & Measure Photos

Sell affinity database for Ad Targeting

Reuse QUALITY photos on social or ecommerce sites

Tag Photos so they are Shoppable in social

Camera-phone as instant commerce tool

1 2 3 4

• Curalate Like2Buy • Twitter BUY button • Tumblr BUY button

• Amazon Flow • SuperFish • Slyce

• Olapic • Percolate • Bazaar Voice

• Curalate • Chute* • Spredfast • Crimson* • BrandWatch*

SaaS for insights 4-10% of Transactions $$$$

CONFIDENTIAL

Account Expansion Goals

NOTE: Ditto can enable these “BUY” buttons on any photo, by recognizing what is inside the photo.

CONFIDENTIAL

NOTE: Ditto can enable these “BUY” buttons on any photo, by recognizing what is inside the photo.

David Rose, CEO [email protected] (857) 222-4416