Silent Talks

8/3/2019 Silent Talks

1/20

A tool for verbalizing thoughts

Pulkit Arora (5104716)

Under the guidance of Dr. Hima Bindu, J.I.I.T.U. Noida


2/20

Imagine a situation

You are out for a family function and a student is calling you

for a discussion on some queries about the subject. You cantcant /

dontdont wantwant to attend the call, yet the call may be urgent, what

will you do ?

While you are driving a bike, wearing a helmet, heading

towards your home where your family is waiting for you but

you are stuck in a heavy traffic jam. Your mom is repeatedlycalling you and you cannotcannot respondrespond back to her, what's the

solution ?

2


3/20

Imagine a situation

You are a student, attending a lecture and suddenly your mom

calls up in the middle of lecture, the issue may be urgent, but

you cannotcannot attendattendthe call whatsoever, how will you react ?

You are standing in a long queue in a bank (you cant use

mobile phones inside a bank) and an importantimportant clientclient calls

up, will you talk ?

You missed an important call while you were in bathroombathroom or

watch ingwatch ing TT..VV.. or do ingdo ing medita tionmedita tion or while sleep ingsleep ing.

3


4/20

Imagine a situation4

You are a businessman, having a meeting with the board ofdirectors and your wife is constantly calling you to ask, whenwill you get free, while she is waitingwaiting for you at home. Will

you be able to take all her calls ?

The list is endless

But, could you find a solution to it ??But, could you find a solution to it ??

Or, you stil l answer thatOr, you stil l answer that stupid stupid callcall ?? ??


5/20

The answer is

The most obvious answer to all questions would be

NO !!

But with SilentTalksSilentTalks, now the answer would be

I dont need to

5


6/20

Solution Approach

To develop a multi-utility mobile based application, which will

enable its users to seamlessly respond to all incoming

communications (calls/sms), automa ticallyautoma tically from the device,

while they are busy.

It will provide a robust Call Management Suite, wherein users

can create custom profiles for responding to their callers

depending on the callercaller , the urgencyurgency and the activityactivity.

6


7/20

Solution Approach7

A dynamic Text-to-Speech engine will be incorporated in the

application, which will help the users to talk to their callers, on

the fly and of course, whilewhile beingbeing silentsilent.

An integrated IVR System (Interactive Voice Response), will

ensure that every caller is being taken care of, as the user

wants it to be. (with built in AnsweringAnswering MachineMachine )


8/20

Solution Approach

An advanced Template Manager to manage all the templates

(pre-defined / user-defined) that could be activated during a

call. It will take care of all possible responses (voice/pre-

defined text/sms/alerts etc.) generated or used during a call.

Integration of an Alert System, which can be used for

automatically switching profiles based on DayDay or TimeTime or even

LocationLocation. It can act as a personalpersonal alarmalarm for certainappointments or a trigger to poke user about the various tasks

he intends to perform.

8


9/20

Implementation9

Implementation of all the aforementioned functionalities in

a single mobile device application is quite a challenge.

Here the extent of resources are

very limited and the performance

of the device cannot be

com

prom

ised, hence optingGooglesGoogles new OS for mobile

platform, Android, is a viable

choice.


10/20

Why Android ??10

Android is the first truly open and comprehensive platform for

mobile devices.

It includes an operat ingoperat ing s ys t emsystem , useruser-- interfaceinterface and appl ica tionsappl ica tions

i.e. all of the software to run a mobile phone, but without the

proprietary obstacles that have hindered mobile innovation.

I

t is developed in cooperation with theO

penO

p en Ha nd s et Ha nd s et Al lianceAlliance ,which consists of more than 30 technology and mobile leaders

including Motorola, Qualcomm, HTC and T-Mobile.


11/20

Why Android ??11

The Android Platform is an integration of:

ApplicationApplication frameworkframework enabling reuse and replacement of components.

DalvikDalvik virtualvirtual machinemachine optimized for mobile devices.

Integrated browser based on the open source WebKitWebKit engine. Optimized graphics powered by a custom 2D graphics library; 3D

graphics based on the OpenGLOpenGL ESES 1.0 specification (hardware

acceleration optional).

SQLiteSQLite for structured data storage.

MediaMedia supportsupport for common audio, video, and still image formats(MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, GIF).

GSMGSM Telephony (hardware dependent).

BluetoothBluetooth, EDGEEDGE, 3G3G, and WiFiWiFi (hardware dependent).

CameraCamera, GPSGPS, CompassCompass, and AccelerometerAccelerometer (hardware dependent).


12/20

Android Architecture (courtesy: www.code.google.com/android)12


13/20

Challenges13

First things first, NO SUCH APPLICATION IS AVAILABLE IN

MARKET till date, hence no references available for desired

features for the app and will have to rely on market survey.

Without any support of speech libraries on the platform, I aim

to incorporate a dynamic TextText--toto--SpeechSpeech engine in the

application.


14/20

Challenges14

The InteractiveInteractive VoiceVoice ResponseResponse SystemSystem feature will have

to accept DTMF tones, from the callers, as input for different

kinds of responses, during a call.

Developing an eminent and a robust CallCall ManagementManagement SuiteSuite

to ensure that relevant responses are activated at appropriate

time is one of the biggest challenge for success of this app.


15/20

Roadmap15

Call Management Suite

Text to Speech Engine

Interactive Voice Response System

Answering Machine

Advance Template Manager


16/20

Other Potential Ideas16

Before finalizing on this application, I had been working on some

more ideas:

A Karaoke application for mobile device, which willautomatically play instruments as user starts singing.

A Recharge-thru-SMS service for students/faculty of JIIT.

A Bilingual Interpreter for Mobile Devices (User speaks in

language A and the device repeats it in language B). An Advanced ToDo List Manager.

Finally, decided to work on SilentTalks as this proved to be a novel

and desirable concept, and has notnot beenbeen implementedimplemented yet.


17/20

Work done till date17

I am also reading some research papers on TextText--toto--SpeechSpeech

and IVRIVR SystemSystem implementation as Android does not provide

any speech library support.

These technologies are an integral part of the application and

hence need a coherent implementation.


18/20

UIScreenshots1

8

Home Screen Incoming Calling State


19/20

UIScreenshots19


20/20

Documents

Silent Talks