Azure AI - EBC Deck · Azure Search + Cognitive Services Information Pre-trained ML Models Fully text-searchable rich index INGEST ENRICH EXPLORE Form ... You are welcome to join

Today

empowerment

Microsoft Surface

Every Surface includes a touchscreen for fast, intuitive navigation — with more power, battery life and portability for life on the move.

https://www.microsoft.com/en-us/surface

Tomorrow

empowerment

Transformative technologies

Mixed Reality, Machine Learning, and Quantum Inspired Optimization

“We want to democratize AI to

amplify human ingenuity”

MSR Beijing

MSR Cambridge

MSR Redmond MSR MontrealMSR New England

MSR New York

Fueled by Microsoft breakthrough research

96% on RESNET vision test

94.9% on Switchboard test

89.4% on Stanford CoQA test

69.9% with MT Research system

39.5 Teraflops with Intel Stratix 10

MSR India

MSR Shanghai

Machine translation

human parityObject detection

human parity

Switchboard

Switchboard cellular

Meeting speech

IBM Switchboard

Broadcast speech

Speech recognition

human parity

Conversational Q&A

human parity

First FPGA deployed

in a datacenter

Envision, create, prototype, solve,

lead on questions, challenges, and

possibilities

Short-term, immediate, tangible

impact to products and business

Curiosity-driven research Deployment-driven research

ProductiveAny language, any developer, any skill level

Built for enterprisesOptimized to work at any scale with existing systems & processes

TrustedYou own and control your data

Our investment principles

Happiness

Meaningful

Innovation

Empowering

PeopleResponsible AI

Meaningful

Innovation

https://www.microsoft.com/en-us/ai/seeing-ai

AI for Accessibility

https://www.microsoft.com/en-us/ai/seeing-ai

https://imagingcovid19ai.eu/

https://imagingcovid19ai.eu/

‘COVID-19 Knowledge Miner’Latest news and research at your fingertips

How do you stay up to date and cut through the noise, when

information is constantly evolving from infinite sources? Maybe

we can help.

For doctors and researchers, we are providing you with

complimentary access to a continuously updated aggregation

of COVID-19 data news and research, with a simplified and

intelligent search experience.

55

countries

active

50k

searches

per week

2x

users per

week

Additional resources: https://aka.ms/COVID19information

https://aka.ms/COVID19information

Reference #1

• Customer: HUS

• Customer Country: Finland

• Released: 13/03/2020

• Partner: Tieto Every

• Url: https://www.terveyskyla.fi/

Reference #2:

• Customer: Region Hovedstaden

• Customer Country: Denmark

• Released : 14/03/2020

• Partners: Proactive

• Url: http://1813.dk/

Reference #3:

• Customer: HSE

• Customer Country: Ireland

• Released : March 18/03/2020

• Partner: pTools

• Url:

https://www2.hse.ie/coronavirus/

Healthbot Service Covid-19

https://www.terveyskyla.fi/

http://1813.dk/

https://www2.hse.ie/coronavirus/

Happiness

Meaningful

Innovation

Empowering


Empowering

People

Microsoft LearnMicrosoft.com/Learn

http://www.microsoft.com/Learn

AI in productivity enablement

Guided process management Factory assistant

Remote assist Knowledge management

Happiness

Responsible AI

PracticesPrinciples Tools

AETHER committee

The Partnership on AI

Guidelines for Human-AI Design

Homomorphic Encryption

Interpret ML

Differential Privacy

Data Drift

Secure MPC

Guidelines for Conversational AI

Fairness

Reliability

Privacy

Inclusivity

Accountability

Transparency

Transparency

People should be able to

understand how AI systems

make decisions, especially when

those decisions impact people’s

lives

Example: Cardiovascular disease risk score

Happiness

Meaningful

Innovation

Empowering


AI Business School

FOR CUSTOMERS, PARTNERS, AND MICROSOFT EMPLOYEES

https://www.microsoft.com/en-us/ai/ai-business-school

https://www.microsoft.com/en-us/ai/ai-business-school

AI for

Accessibility

AI for

Earth

AI for

Humanitarian

Action

AI for

Cultural

Heritage

AI for

Health

Make Your Application More Human with AI and Cognitive Services

Microsoft webinar, 20-05-2020, Donald Hessing

Twitter: @dhessing

Linkedin: https://www.linkedin.com/in/donaldhessing

https://www.linkedin.com/in/donaldhessing

©2019 Idean Proprietary and confidential©2020 CapgeminiRFP Global Website DevOps Partner

Donald Hessing

Digital Customer Experience Lead Microsoft

Microsoft Certified Master (MCM)

Programme Chair | European SharePoint, O365 and Azure Conference

[email protected]

@dhessing

mailto:[email protected]

Agenda

Introduction to Cognitive Services

Q&A

Wrap-up

Knoweldge Mining through Cognitive Services

DEMOS

Bring AI to every Application

Adding humanlike

capabilities to appsVision, Speech and Prediction

30© Capgemini 2020. All rights reserved |Presentation Title | Author | Date

Cognitive Services

Broad range of advanced capabilities

Cognitive Solutions

8

1

2

3

4

5

6

7

Classification Modelsgrouping data into segments for better understanding of hierarchical relations,

e.g. automated system for financial documents classification

Predictive Modelling predicting occurrences of certain categories of events, e.g. type and volume of future incidents, complaint probability based on ticket handling process

Bot trainingChat bot machine learning - training to automatically improve user intent recognition

IoT insights & decisionsmanaging automatically huge amount of data coming from IoT devices for intelligent purposes e.g. office space utilisation management

Computer visiongaining high-level understanding from digital images or videos. image recognition, e.g. recognize error type from a screenshot, face

recognition, e.g. biometric user identification

Text mining & text analyticsmining and analysing text data to discover

patterns, extract useful knowledge, and support decision making e.g. identify

automation use cases, sentiment analysis

Natural Language Processing (NLP)voice/text understanding in natural language

e.g. Virtual Assistant (Chat/Voice bot)

Speech recognitionrecognition and translation of spoken

language into text, e.g. Alexa, Siri, Cortana

MachineLearning

CognitiveThinking

These capabilities can be mixed

in different combinations to

create a cognitive solution


Humanlike

EntitiesPersons“Anita Christiansen”,“Conrad Nuber”,

Locations“Bothell”, “Woodinville”

Organization“Litware Insurance Corp.”


Vision

Face

Detects and recognizes faces in images

27 attributes (Age, Emotion, Gender)

Trainable - matching private people collection

Computer Vision

Identify 10.000 objects

Detect handwritten text

Landmarks, brands, printed text

Ink Recognizer

Recognition of hand written words and shapes

Ink strokes to text

Form Recognizer

Identify and extract key/value pairs from forms

and receipts

Custom Vision

Build, deploy, and improve your own image classifiers.

Image classification and object detection

Video Indexer

Not a cognitive skill, but service that brings the

cognitive services together (Vision, Language, Speech)


Computer Vision


Face API

Detect human faces in an image including

age, emotion, gender, pose, smile, and facial

hair, along with 27 landmarks for each face in the image.

Face API enables you to search, identify, and

match faces in your private repository of up to 1 million people

Easily find similar-looking faces. Given a collection of faces and a new face as a query, this API will return a collection of similar

faces.

Organize many unidentified faces

together into groups, based on their visual

similarity.

Face identification Similar face search Face groupingFace detection


Custom Vision

Adapting Computer Vision models with your own data


Two key scenario’s

Source: https://www.datacamp.com/community/tutorials/object-detection-guide

https://www.datacamp.com/community/tutorials/object-detection-guide


Use Cases


Speech Service

...

Text to Speech

Standard and Neural Voices

Custom Neural Voices (new)

Custom Voices

Speech to Text

Transcription

Conversation Transcription

Custom model with O365 data

Speaker Recognition

Speaker Identification

Speaker Verification

Speech Translation

Language Detection

Real Time Translation

Speech SDK Devices SDK AI Containers Languages Voice Models


Microsoft TranslatorBreaking language & communication barriers


Speech Translation


Custom speech domain model

Transcription.txt (audio + human transcript)b0046.wav Herrerasaurus lived in late Triassic and was hugeb0047.wav Noasaurus is another species of that period and it was up to 8 feet longb0048.wav Noasaurus lived in late Cretaceous periodb0049.wav Staurikosaurus became extinct in late Triassic period

Testing and Training


Benefits for Call Centers Artificial Intelligence (AI) will

handle 15% of all customer

interactions by 2021*

* Gartner 2018

What are the strategic benefits of implementing call center automation solutions?

✓ Reduced customer friction

✓ Lower operational Costs

✓ Streamlined processes

✓ Better customers insights & predictions

✓ Highly efficient use of service agent’s time

https://www.gartner.com/smarterwithgartner/4-trends-gartner-hype-cycle-customer-service-customer-engagement/


Call and Service Center use cases

Store reviews and correlated

purchases in Cosmos DB

Use Text Analytics to

extract

sentiment/known

entities & phrases

Use Speech-to-Text

to transcribe calls

Chatbot

PowerBIMetrics:

“Top words mentioned”

“Analysis of Emotion”

“Positive vs. Negative”

“Hourly Updates”

“What’s Trending”

Call Logs

Live Agents

Translate

(as needed)

Purchase

DB

Company Web Site

&

Social Media

Platforms

Use Content Moderator

to remove profanity or

inappropriate

comments

Operations Dashboard

Azure Logic Apps

✓ Analyze Trends

✓ Sharpen Marketing Focus

✓ Recommend Agent Training


Language

Language Understanding (LUIS)

Understands user goal (intent)

Extracts entities from sentences

Support 12 languages, pre-built entity dictionaries

Immersive Reader (Preview)

Text reading and comprehension capabilities

Already used by 15M people

Translation of 60 languages

Text Analytics

Detect sentiment, key phrases, named entities

and langue from text

Translator Text

Machine translation of 60+ languages

Support custom models to reflect custom domain

terminology

QnA Maker

Build a Question and Answer Knowledge base

Extract QnA Pairs from external sources


Text Analytics

Key Phrases

Sentiment

Entity Linking

Bing Entity Search


Use Cases


QNA Maker

I want to buy a ticket for the European

SharePoint Conference

Where can i buy an ESPC Conference

ticket?

I want to attend the European SharePoint

Conference

What are the ticket packages for ESPC?

Can I purchase a ticket online?


Multi-Turn QNA Maker

PersonalizationPowered with Azure Cognitive Services for advantaged knowledge mining


Reinforcement Learning

Action 2 Info

Action 3 Info

User & Context Info

Action 1 info

Reward Score

aka.ms/personalizerdemo

http://aka.ms/personalizerdemo


Personalization patterns

Discovery Pattern and Causality

Expoit versus Explore

Exploit

“Exploit”= use

“Explore”

Explore


Use Cases


DEMOS

Custom Vision

Speech domain model

Personalizer

Azure Search

Azure SearchPowered with Azure Cognitive Services for advantaged knowledge mining


80%of business relevant information is unstructured


…


Azure Search + Cognitive Services

Information Pre-trained ML Models Fully text-searchable rich

index

INGEST ENRICH EXPLORE

Form 5471


Use Cases

Knowledge mining, custom classifiers, image libraries, brand management, ...

59© Capgemini 2020. All rights reserved |

Wrap Up


Capgemini recently presented the purpose and use cases of making your applications more human by using pre-trained AI. Keynote speaker Donald Hessing highlighted a broad number of use cases with endless scenarios and opportunities.

You are welcome to join our deep dive sessions to explore your specific use cases and desired business outcomes. These would be 1:1 sessions with you and your key stakeholders from your organization, Capgemini and Microsoft. Our deep dives are a 3 step approach to co-create your business case and proof of concept by using pre-trained AI models in our lab.

Our Approach

➢ Identify use cases and desired business outcomes driven by pre-built AI

➢ Learn to apply pre-trained AI in your applications and provide a more detailed architecture

➢ Co-create with Capgemini and Microsoft experts and build a holistic proof of concept by creating a business case and technical validation in our lab

1

2

3

Deep Dive Session – Define uses cases and build a proof of concept in our lab

Registration Form

First Name:Last Name:Job Title:Company:Email:

Our Team in the deep dives

Donald HessingCapgeminiPrincipal ConsultantMicrosoft Lead Architect, DCX

Gerard JongsmaCapgeminiDigital Transformation ExpertCapgemini Digital CoE


Questions?

Capgemini is a global leader in consulting, digital transformation, technologyand engineering services. The Group is at the forefront of innovation to addressthe entire breadth of clients’ opportunities in the evolving world of cloud, digitaland platforms. Building on its strong 50-year+ heritage and deep industry-specific expertise, Capgemini enables organizations to realize their businessambitions through an array of services from strategy to operations. Capgeminiis driven by the conviction that the business value of technology comes fromand through people. Today, it is a multicultural company of 270,000 teammembers in almost 50 countries. With Altran, the Group reported 2019combined revenues of €17 billion.

About Capgemini

Learn more about us at

www.capgemini.com

This presentation contains information that may be privileged or confidential and is the property of the Capgemini Group.

Copyright © 2020 Capgemini. All rights reserved.

http://www.linkedin.com/company/capgemini

http://www.slideshare.net/capgemini

http://www.twitter.com/capgemini

http://www.youtube.com/capgeminimedia

http://www.facebook.com/capgemini

http://www.capgemini.com/about/how-we-work/the-collaborative-business-experiencetm

http://www.capgemini.com/about/how-we-work/rightshorer

Documents

Azure AI - EBC Deck · Azure Search + Cognitive Services Information Pre-trained ML Models Fully text-searchable rich index INGEST ENRICH EXPLORE Form ... You are welcome to join