The Voice Controlled Smart Robotic Assistant

BE Final Year Technical Seminar

Presented by Under the guidance of Rachith Kumar Hegde Ms.Anisha Kunjan

1CR12IS086 Assistant Prof. Dept of ISE,CMRIT Dept of ISE,CMRIT

CMR INSTITUTE OF TECHNOLOGY

AgendaAbstractIntroductionBlock DiagramHow it worksComponents UsedConclusionFuture EnhancementBibliography

ABSTRACT

Smart robotic assistants help human beings in reducing the manual efforts in day-to-day tasks and the risk to precious human lives in hazardous situations.In this we develop a smart robotic assistant that operates on human voice commands, given remotely by using an Android platform based smart IoT device.The real-time signal processing of the voice commands is carried out using a cloud server. The speech command signal converted to text form is then communicated to the robotic assistant over a Bluetooth network. The robotic assistant is developed on an Arduino micro-controller based platform.

INTRODUCTION

Human life is valuable and human efforts at premium. People can get injured while handling hazardous chemicals or explosives, in chemical industry or in explosives manufacturing industry, respectively.

Inside homes, people may need assistance to reduce manual effort, needed critically in case of physically challenged people.

Assistant robots can be used in manufacturing sector for different tooling and re-positioning operations.

In this we develop a voice controlled smart assistant robot that can perform different operations for applications in homes, hospitals and industries.

Smart Robotic Assistant(RA) Block Diagram

How Robotic Assistant Works

The movements of the smart RA are controlled by speech commands given through a smart mobile phone using Android OS based platform.

The voice commands signal is converted to the text form, using an online cloud server in real-time.

Using a smart IoT device, this text command is then transmitted to the Bluetooth module on-board the robot.

The Bluetooth module receives the signal and then sends commands to the micro-controller, on-board the RA’s body.

The micro-controller in turn processes the commands and controls all the 4 DC motors used for various movements. In the receiver side, the micro-controller ports are used as interface between the Bluetooth receiver and the RA.The movements of the RA’s body, hands and arm are independent of each other and all can be controlled at the same time, since each function is controlled by motors.

The Voice Controlled Smart Robotic assistant

Voice Processing Concept of Cloud Server(example)

Voice Commands Movements

Forward RA’s Body moves forward

Backward RA’s Body Moves Backward

Left RA’s Body Move left

Right RA’s Body Moves right

Up RA’s Arm Moves Up

Down RA’s Arm Moves Down

Open RA’s Hands Open

Close RA’s Hands Closed

Rotate θ◦ clockwise RA’s Body rotates clockwise by θ◦

Rotate θ◦ anticlockwise RA’s body rotates anticlockwise by θ◦

Voice Commands and movements of the RA

ARDUINO MICROCONTROLLER

Components Used

DC MOTORVoice Recognition Android Application

Arduino is an open-source computer hardware and software

company, project and user community .

It designs and manufactures microcontroller-based kits for

building digital devices and interactive objects that can sense and

control objects in the physical world.

These systems provide sets of digital and analog I/O pins that can

be interfaced to various expansion boards and other circuits.

The boards feature serial communication interfaces,

including USB on some models

What Is Arduino Microcontroller

CONCLUSIONIt is feasible to implement Bluetooth communication

between smart phone and microcontroller.The development of apps for Android in Android

SDK is easy and free of cost.This topic should be helpful in showcasing an IoT

application in developing a voice-controlled smart robotic assistant.

Areas that can be explored further are, the effect of the distance between the mouth and the smart IoT device on the performance of the robot, and the effect of noise on the speech to text conversion.

APPLICATIONS AND FUTURE ENHANCEMENT

1. It can be used in various industries for picking various objects where human intervention is not desired.2. On a large scale, it can be used to develop robots with military applications. It can be used to target enemy without any human being crossing the territory. 3.It provides for more development of applications based on android operating system. Such as , Application based on sensors.

This opens door for wide range of possible similar applicationsi. Remote starter for carii. Automation of household tasks

4. It is robust, sensitive and fast moving, hence can be applied in rescue operations.5. With tremendous smart phone in markets, it is bound to have many more applications in near future.

BIBLIOGRAPHY[1] Wong Guan Hao, Y. Y. Leck and Lim Chot Hun, “6-DOF PC-Based Robotic Arm PC-ROBOARM with efficient trajectory planning and speed control”, in Proc. 4th International Conference Mechatronics (ICOM),Kuala Lumpur, pp. 1-7, April 2011, ISBN:978-1-61284-435-0[2] H. Uehara, H. Higa and T. Soken, “A Mobile Robotic Arm for people with severe disabilities”, in Proc. 3rd IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob), RAS and EMBS ,Tokyo, pp. 126-129, September 2010, ISSN:2155-1774[3] David Orenstein, “People with paralysis control robotic arms using brain", https://news.brown.edu/articles/2012/05/braingate2 (Last viewed on October 23, 2014)[4] http://www.codeproject.com/Articles/628894/Learn-How-to-Develop-Android-Application

THANK YOU ….