CORTANAA Microsoft Virtual Personal Assistant

Saurabh Kumar, 1301292648, CSE ’B’Sushil Kr. Sharma, 1301292704, CSE ’B’

Submitted By,

Prof. Kailash Shaw, CSE, Gandhi Engineering College, BBSRSubmitted To,

Content

• Introduction to Cortana

• The Cortana interface

• Cortana as a powerful personal assistance

• Microsoft Cortana vs other IPAs

• Working of Cortana

• Speech Recognition

• Advantage of Cortana

• Availability of Cortana

• Conclusion

• References

Introduction to Cortana

• Cortana is the name for the intelligent personal assistant and knowledge navigator for Windows Mobile and Windows 10.

• Cortana was demonstrated for the first time at the Microsoft BUILD Developer Conference (April 2–4, 2014) in San Francisco.

• It is named after Cortana, a synthetic intelligence character in Microsoft's Halo video game franchise originating in Bungie folklore.

• It is written in C# (C Sharp).

Hi there, I’m Cortana

• Cortana is constructed from the cloned brain of Dr. Catherine Elizabeth Halsey, the creator of the SPARTAN Project.

• According to the Halo novels, Cortana is classified as a "smart" AI, meaning that her creative matrix is allowed to expand, in contrast to the limited matrix of other "dumb" AI characters in the stories.

• Personal digital assistant similar to Siri and Google Now.

• Can be talked to or typed at, Responds in the same way as addressed.

• Cortana is region-specific, and adapts its voice to match the everyday language, culture and speech patterns of the country its user lives in.

The Cortana interface

• Cortana uses BING & SAFARI as its default search tool.

• It also works with Google, but with some changes in settings in it.

Bing Safari Google

Cortana currently works on the following platforms -

• Windows 8.1/10 Mobile

• Windows 10 PC

• Microsoft Band/Band 2

• iOS

• Android

• Xbox One

• Skype

• Cyanogen Mod

Cortana on Windows 10 PC

Cortana Home

Notebook

Reminders

Help

Feedback

Speech Listener(Enables Cortana to hear something)

Cortana: A powerful IPA

• Cortana was created to be a truly personal digital assistant – available on the go, no matter where or when we need help, and on whatever device we carry.

• Cortana is the first personal digital assistant to help, complete tasks across multiple devices, from PC to phone and vice versa.

• Cortana can understand you like your personal assistant virtually and with more accurate understanding of your language!

“Remind me to tell my bro about my new website”Or

“Call my dad”

Convenient TrackingReminders that travels with us Never miss a phone call

Flip a coinRoll a dice Active Listening

Cortana vs Siri vs Google Now

FEATURES

Summon with hardware button No Yes Yes

Geofencing Yes Limited Yes

Voice Activation Yes Yes Yes

Third Party Integration Limited No Yes

Answers sassy questions like "Are you sexy?" No Yes Yes

Play music by artist/genre Premium Service Yes Yes

Web Search Yes Yes Yes

Feature Comparison

COMMANDS

Where can I see the movie FAN? 5.5s 3.5s 4s

Remind me to restart my laptop. 3s 3.6s 3s

What is the meaning of friendship? 6s 4s 3.7s

Text message Dad ‘I’m in class’. 8.5s 5s 4.2s

What will the temperature be this Monday? 7s 3.3s 3.2s

What does poison oak look like? 6s 5.4s 4.5s

Who is the prime minister of India? 5s 3.5s 3s

Command Processing Comparison

Unique Abilities

Siri provides a more cohesive experience than her competitors. Siri also integrates with third-party services. For instance, it connects to OpenTable to book dinner reservations on the fly and Fandango to help you buy movie tickets.

Microsoft's assistant is smart enough to know not only your name, but also the names of your contacts. You can then use Cortana to set a reminder to be displayed the next time you communicate with a particular person, such as, "Wish Joey a happy birthday."

Google's assistant is the only one of the three that features an always-on mic, so it's quick to respond when you say, "OK, Google."

Working of Cortana

• Cortana will allow Windows Phone users to set how they want to be addressed by the voice-activated assistant.

• Cortana can call users by their name or nicknames like "Master Chief" after the function is enabled in the settings.

• A key part of Cortana is its ability to save information and data in a Notebook system.

• Notebook will allow the Cortana digital assistant to access information such as location data, behaviours, personal information, reminders, and contact information

• Cortana can also track flights or other mentions in emails, allowing it to generate notifications similar to Google Now.

Schematic Flowchart of Cortana

• Information management• Big data stores• Machine learning and analytics• Intelligence

Cortana Intelligence

Speech Recognition

Legacy speech technologies used in Cortana

• From above speech APIs, now it is helpful to provide third party apps a human side with the beautiful voice of Cortana!

• Launch an app or extend Cortana with app functionality and data using voice commands. Accept short input and long dictation using speech recognition.

Speech processing for Cortana with Bing Speech API

Advantage of Cortana

Advantage of an IPA(Intelligent Personal Assistant) like Cortana

We can type out our commands.

She’s a virtual assistant that can learn about us.

She can track our packages and trips.

Cortana is a standalone app.

Cortana is always running in background.

• Cortana is a desktop search engine, but there are three things that make it extraordinarily powerful: it's integrated with the OS, it's extensible and it supports natural language.

• In addition to performing internet searches, Cortana can help us find local resources, such as OS settings or files.

• Automatic voice activation of Cortana by saying just – HEY! CORTANA will make it easy to done our work without even touching our device!

• Multi-tier queries will make user more interactive with their device and their work.

Hey! Cortana.

Availability of Cortana

Cortana is currently available in 11 countries with their official language.

• To use Cortana, the region and language settings have to be aligned. See the following list of regions where Cortana is available, and the corresponding language for each of those regions.

• Cortana is available in these regions for these languages:Australia: EnglishCanada: EnglishChina: Chinese (Simplified)France: FrenchGermany: GermanIndia: EnglishItaly: ItalianJapan: JapaneseSpain: SpanishUnited Kingdom: EnglishUnited States: English

• Note: If you change your region, you might not be able to shop at the Store, or use things that you’ve purchased such as memberships and subscriptions, games, films, TV and music

Hi! I’m Cortana.

Conclusion

• Cortana isn’t just about work, she’s always listening at you try asking a casual question such as “Where do you came from?”

• The best thing you can do to learn about Cortana is talk to her, you may be surprised by how she can help you and what she has to say!

• And in the last our vision: We see a world where Cortana will be our personal digital assistant everywhere in our devices:

-PC-Tablet-Phone

• If a person login with his/her Microsoft account the personal Cortana with her knowledge about that person, she already knows who is his/her partner, will assist in everyday life trying making it a bit better.

References

This presentation was made and organized with the help of following sources.

Cortana search tool.

Microsoft Official Website for Cortana & Cognitive Services.

Google, Mashable.

Wikipedia

Slide Share

Vofolio Designs

Any Queries?

Thank You!