The Vision of Computer Vision: The bold promise of teaching computers to understand the visual world...

@ITCAMPRO #ITCAMP17Community Conference for IT Professionals

The Vision of Computer Vision: The bold

promise of teaching computers to understand the visual world

Tim Huckaby

InterKnowlogy, Founder / Chairman

VSBLTY Founder / CTO

Microsoft Worldwide RD

Microsoft MVP, Artificial Intelligence

A lap around the

Microsoft Cognitive Services Vision API

@ITCAMPRO #ITCAMP17Community Conference for IT Professionals

Many thanks to our sponsors & partners!

GOLD

SILVER

PARTNERS

PLATINUM

POWERED BY

User Interface Innovation: What’s on the Horizon?Delivering the Art of Software

A Little Bit About Me and Why We I am Here…

https://binged.it/2qpYCvF

A THINK TANK OF MAKERS WHO CREATE FOR ALL DIGITAL SURFACES

Who we work for...that we are allowed to talk about...

Delivering the Art of Softwareinterknowlogy.com1525 Faraday Ave, Suite 250, Carlsbad CA 92008curious@interknowlogy.com

User Interface Innovation: What’s on the Horizon?Delivering the Art of Software

Computer Vision in Cognitive Services, Machine Learning and Artificial Intelligence

With Computer Vision, comes responsibility…

Objectives And Agenda

Using Machine Learning without being an expert

Where We have Been in Compuer Vision and Where We are Going

How to get started

Demos, Demos, Demos...

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Microsoft Cognitive ServicesGive your apps a human side

Microsoft Cognitive ServicesGive your apps a human side

Microsoft Cognitive ServicesGive your apps a human side

Roll your own with REST APIs

Simple to add: just a few lines

of code required

Make the same API code call on iOS,

Android, and Windows

Integrate into the language and

platform of your choice

Bring your own data for your custom

experience

Built by experts in their field from

Microsoft Research, Bing, and Azure

Machine Learning

Quality documentation, sample code,

and community support

Easy Flexible Tested

Why Microsoft Cognitive Services ?

Why?The Seeing AI App

Computer Vision, Image, Speech Recognition, NLP,

and ML from Microsoft Cognitive Services

Watch Video HereRead Blog Here

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Face API

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

VisionCaptor™

VisionCaptor™ marries high impact, engaging motion graphics

and interactive brand messaging on glass display at point-of-

sale in retail environments including supermarkets and c-store.

VSBLTY’s “first of its kind”, built-in facial recognition and data

capture technology delivers real time demographic analytics,

emotion detection, and other important KPI’s. Applications range

from informational display to dynamic video and advertising to

dynamic way finding.

DataCaptor™

DataCaptor™ soley uses the optics and analytics technology

and can be embedded into an end cap display in retail,

traditional out of home applications, and existing POS screens to

capture analytics and provide campaign measurement.

The engine behind the VSBLTY: “GoldenTrout”

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Intelligent Kiosk: Real Time Crowd Insights

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Computer Vision API

Content of Image:

Categories v0: [{ “name”: “animal”, “score”: 0.9765625 }]

V1: [{ "name": "grass", "confidence": 0.9999992847442627 },

{ "name": "outdoor", "confidence": 0.9999072551727295 },

{ "name": "cow", "confidence": 0.99954754114151 },

{ "name": "field", "confidence": 0.9976195693016052 },

{ "name": "brown", "confidence": 0.988935649394989 },

{ "name": "animal", "confidence": 0.97904372215271 },

{ "name": "standing", "confidence": 0.9632768630981445 },

{ "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" },

{ "name": "wire", "confidence": 0.8946959376335144 },

{ "name": "green", "confidence": 0.8844101428985596 },

{ "name": "pasture", "confidence": 0.8332059383392334 },

{ "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" },

{ "name": "grassy", "confidence": 0.48627158999443054 },

{ "name": "lush", "confidence": 0.1874018907546997 },

{ "name": "staring", "confidence": 0.165890634059906 }]

Describe0.975 "a brown cow standing on top of a lush green field“

0.974 “a cow standing on top of a lush green field”

0.965 “a large brown cow standing on top of a lush green field”

Intelligent Kiosk – Vision API Explorer

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

U-SQL

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Custom Vision Portal (IRIS)

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Object Recognition: “RoosterFish”

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Microsoft

Cognitive

Toolkit

https://github.com/Microsoft/CNTK

Microsoft Cognitive Toolkit, CNTK

Bing Image

API

Face API

Emotion API

Computer Vision API

Custom Vision

Cognitive Toolkit

U-SQL Gesture Reco

Video Indexer

Content Moderator

Video Indexer: vi.microsoft.com

Tim Huckaby• InterKnowlogy, Chairman/Founder

• VSBLTY, CTO

• Microsoft Worldwide RD

• Microsoft MVP, AI

Samples and Documentation:https://azure.microsoft.com/en-us/services/cognitive-services/

How to Sign Up:https://azure.microsoft.com/en-us/try/cognitive-services/

SDK:https://github.com/Microsoft/ProjectOxford-ClientSDK

Samples in Github:https://github.com/search?o=desc&p=1&q=org%3AMicrosoft+cognitive&s=updated&type=Repositories(from Github search on: org:Microsoft cognitive)

The Engaging User Experience & the Natural User InterfaceDelivering the Art of Software

More info on InterKnowlogy:

◦www.InterKnowlogy.com ◦http://ikeurope.com/◦www.vimeo.com/InterKnowlogy

More info on VSBLTY:

◦www.VSBLTY.netAbout Tim Huckaby…

• Founder/Chairman, InterKnowlogy, Actus Software, VSBLTY• Microsoft® Global Regional Director • Microsoft® AppDev Partner Advisory Council Founder /

Member• Microsoft® MVP – Emerging Experiences• Accomplished Author & Speaker• Board Member: Facial Networks, Crespi Carmelite, San

Diego Fly Fishers

www.TimHuckaby.com

Contact Tim:E-mail: TimHuck@InterKnowlogy.com

THuckaby@VSBLTY.netPhone:

Office: 760-683-9650 Mobile:: 619 990 9200

Blog:http://team.interknowlogy.com/blogs/timhuckaby

FaceBook:http://www.facebook.com/Tim.Huckaby.Carlsbad

LinkedIn:http://www.linkedin.com/in/timhuckaby

Twitter: @TimHuckaby

Tim Huckaby