33
QUADCOPTER NAVIGATION USING AAKASH TABLET WITH ON BOARD IMAGE PROCESSING Garuda Control Station Principal Investigator Prof. D.B. Phatak

Quadcopter navigation using aakash tablet with on board image processing

Embed Size (px)

DESCRIPTION

Final Presentation for Team Garuda . This quadcopter and its ground control station(GCS) was built in the Integrated Development Lab during my summer internship at IIT Bombay . https://www.youtube.com/watch?v=0966YNqcisg.

Citation preview

Page 1: Quadcopter navigation using aakash tablet with on board image processing

QUADCOPTER NAVIGATION USINGAAKASH TABLET WITH ON BOARD IMAGE

PROCESSING

Garuda Control Station

Principal InvestigatorProf. D.B. Phatak

Page 2: Quadcopter navigation using aakash tablet with on board image processing

TEAM GARUDA

Project Team Members

Mr. Aaditya Hambarde

Mr. Ankit Kumar

Mr. D Yogendra Rao

Mr. Shubham Garg

Miss. Shuchi Sharma

Project Mentors

Mr. Sandesh PatiMiss Maitreyee MordekarMr. Sivakiran KodaliMr. Varun Madkaikar

Project In-Charge Mr. Rajesh Kushalkar

Page 3: Quadcopter navigation using aakash tablet with on board image processing

FEATURES

• Video Streaming

• Door detection

• GPS Tracking

• Ground Control Station on Aakash

Page 4: Quadcopter navigation using aakash tablet with on board image processing

Project Overview

Page 5: Quadcopter navigation using aakash tablet with on board image processing

YAW

Page 6: Quadcopter navigation using aakash tablet with on board image processing

ROLL

Page 7: Quadcopter navigation using aakash tablet with on board image processing

PITCH

Page 8: Quadcopter navigation using aakash tablet with on board image processing

YAW CONTROL

Page 9: Quadcopter navigation using aakash tablet with on board image processing

ROLL/PITCH CONTROL

Page 10: Quadcopter navigation using aakash tablet with on board image processing

‘IF YOU WANT TO GO FORWARD, PITCH FORWARD’

Page 11: Quadcopter navigation using aakash tablet with on board image processing

ALTITUDE CONTROL

Page 12: Quadcopter navigation using aakash tablet with on board image processing

PROPELLERS

• Two clockwise and two anti-clockwise

• Need a good balance on deciding length and pitch

Courtesy : www.atomikrc.com

Page 13: Quadcopter navigation using aakash tablet with on board image processing

ELECTRONICS SPEED CONTROLLER

• Generates signals for Brushless DC motor

• Pulse duration for 1000 us – 2000us

Courtesy : www.hangarone.co.nz

Page 14: Quadcopter navigation using aakash tablet with on board image processing

ACCELEROMETER & GYROSCOPE (MPU6050)

• Accelerometer :Sensitivity to vibrations

• Gyroscope : drift

Angular rate in three axes of space in deg/s

Courtesy : https://community.freescale.com/community/the-embedded

Page 15: Quadcopter navigation using aakash tablet with on board image processing

MAGNETOMETER (HMC5883L)

• Digital-output : angular movement , magnetic field intensity

• Reliable direction for magnetic north

Courtesy : https://community.freescale.com/community/the-embedded

Page 16: Quadcopter navigation using aakash tablet with on board image processing

PRESSURE SENSOR (MS5611)

• Altitude of quadcopter

• Temperature of the environment

Pressure is our 10th axis

Courtesy : https://community.freescale.com/community/the-embedded

Page 17: Quadcopter navigation using aakash tablet with on board image processing

GPS SENSOR (MT3329)

• Triangulation Method

• Location of quadcopter

• NMEA Protocol

(National Marine Electronics Association)

Courtesy : http://www.trimble.com/gps_tutorial/howgps-triangulating.aspx

Page 18: Quadcopter navigation using aakash tablet with on board image processing

SENSOR FUSION

• It literally means ‘fusing the data of two sensors’

• Accelerometer is noisy (has spikes).

• Gyroscope output has a time varying drift.

• Sensor Fusion-We take the best of both the worlds.

Page 19: Quadcopter navigation using aakash tablet with on board image processing

EXTERNAL AUTONOMOUS NAVIGATION

• Various Flight Modes-Stabilize, Acro, Alt Hold, Loiter, Auto Mode.

• For the AUTO mode, GPS is necessary.

• Waypoints can be set by our Application on the AAKASH tablet.

Page 20: Quadcopter navigation using aakash tablet with on board image processing

INTERNAL AUTONOMOUS NAVIGATION

• GPS fails in a closed-door environment.

• Detect a door/window and go out where GPS access is present.

• In future, we hope to design a controller for navigation of quadcopter from indoor to outdoor environs.

• SONARs will be used to create a depth map of the indoor environment and for obstacle detection.

Courtesy: http://www.scientificamerican.com/

Page 21: Quadcopter navigation using aakash tablet with on board image processing

DOOR DETECTION ALGORITHMS• Various alternatives like Training by Haar cascade, Feature matching by SURF

features were explored.

• To get a reasonable FPS, we had to settle on an algorithm which exploits the geometric properties of the door.

Page 22: Quadcopter navigation using aakash tablet with on board image processing

PID TUNINGProportional(P)Integral(I)Derivative(D)

Page 23: Quadcopter navigation using aakash tablet with on board image processing

1. NEED FOR PID TUNING

• For a stable and smooth flight of the quadcopter• To get the optimum or desired behavior from it•Without this, quad may topple, become sluggish or untamable

Page 24: Quadcopter navigation using aakash tablet with on board image processing

COMMUNICATION PROTOCOL : MAVLINK

• It is a protocol for communication between a Ground Control Station (GCS) and unmanned vehicles

• Each MavLink packet has a length of 17 bytes

6 bytes header + 9 bytes payload + 2 bytes checksum

Page 25: Quadcopter navigation using aakash tablet with on board image processing

RC INTERFACE

Fast Mode Access

Navigation Menu

RC Control

Connect Button to connect with

the quad

Mode Switch

Page 26: Quadcopter navigation using aakash tablet with on board image processing

INTERFACES

Planning Interface

Flight Data Interface

Page 27: Quadcopter navigation using aakash tablet with on board image processing

INTERFACES

Charts Interface

Camera Feeds

Page 28: Quadcopter navigation using aakash tablet with on board image processing

WHAT DID WE LEARN?

• Orientation algorithms of a quadcopter.

• Aerodynamics of a quadcopter.

• Explored Image Processing Techniques in detail.

• Streaming the video-feed of a USB webcam/RaspiCam over a local area network through MJPEG streamer.

• A new way of thinking and questioning things.

• A new communication protocol-MAVLINK.

Page 29: Quadcopter navigation using aakash tablet with on board image processing

CHALLENGES FACED

• Implementation of Haar training for door detection.

• PID tuning for stable flight.

• Overlapping the RC on the video feed.

Page 30: Quadcopter navigation using aakash tablet with on board image processing

FURTHER PROSPECTS

• Making ‘Garuda’ autonomous (using GPS based navigation).

• Designing a PID controller for internal navigation by door/window detection and SONAR.

• Face Recognition in the feed received at the AAKASH end.

• Recording the video feed on AAKASH tablet and processing it.

Page 31: Quadcopter navigation using aakash tablet with on board image processing

REFERENCES

• [1] https://github.com/AngusP/SkiTrack/blob/master/documentation/MS5611-01BA03%20datasheet.pdf

• [2] http://www.invensense.com/mems/gyro/.../PS-MPU-6000A-00v3.4.pdf

• [3] http://www.adafruit.com/datasheets/HMC5883L_3-Axis_Digital_Compass_IC

• [4] JoyStickView : https://code.google.com/p/mobile-anarchy-widgets/

• [5] MjpegStream : https://bitbucket.org/neuralassembly/simplewebcam

Page 32: Quadcopter navigation using aakash tablet with on board image processing

REFERENCES

• [6] HUD : https://code.google.com/p/copter-gcs

• [7] MAVlink : Mavlink for Dummies Part 1

• [8] Barton, Jeffrey D. "Fundamentals of small unmanned aircraft flight." Johns

• Hopkins APL technical digest 31, no. 2 (2012): 132-149.

• [9] Premerlani, William, and Paul Bizard. "Direction cosine matrix imu: Theory."DIY

• Drones.[Online][Cited: 1 7 2012.] http://diydrones. ning. com/profiles/blogs/dcmimu-theory-first-draft (2009).

• [10] http://dev.ardupilot.com/

Page 33: Quadcopter navigation using aakash tablet with on board image processing

THANK YOU