Li Xiaotong

[A128] Design and Development ofa Four-wheel Educational Robot

Remote Controlled By Tablet/Cellphone

FYP Presentation

Overview of Design Process

70%

30%Time

Software

Hardware

Part 1: Hardware Conceptual Design

Electronics Functions Mechanics Functions

Part 1: Hardware Design

Section 1: Components Selection

Part 1: Hardware Design

Section 2: Electrical Connection and Circuit

Part 1: Hardware Design

Section 3: Mechanical Fabrication and Mechanism

Part 1: Hardware Design

Section 3: Mechanical Fabrication and Mechanism

Part 2: Software Conceptual Design

Part 2: Software Design

Section 1: Raspberry Pi Initialization and Server Programming

15 Steps to Initialize Raspberry Pi B+

Part 2: Software Design

Section 1: Raspberry Pi Initialization and Server Programming

Part 2: Software Design

Section 1: Raspberry Pi Initialization and Server Programming

Server receive signal with ‘\n’ attached string

Subprograms

Part 2: Software Design

Section 2:GUI Design and Functions Programming

NetIO Application and Online UI Designer

Part 2: Software Design

Section 2:GUI Design and Functions Programming

• Send/Receive data over TCP sockets

• Communication through local network

• Multiple receivers and senders

• Online GUI Designer

• Configuration cloud storage and simple synchronization

• Cross Platforms: Android/iOS/Mac OS Dashboard Widget

Part 2: Software Design

Section 2:GUI Design and Functions Programming

Control Panel: control movements and emotions

• Forward.py• Backward.py• TurnLeft.py• TurnRight.py• Stop.py• Nod.py• ShakeHead.py• Happy.py• Angry.py

Part 2: Software Design

Section 2:GUI Design and Functions Programming

Camera Panel: for real-time camera pictures streaming to tablet

• CameraOn.sh

• CameraOff.sh

Part 2: Software Design

Section 2:GUI Design and Functions Programming

Interactive Panel: music and story random play and gesture selection functions

• Story.py

• Music.py

• Stopsound.py

• GestureSelect.py

Part 2: Software Design

Section 2:GUI Design and Functions Programming

Part 2: Software Design

Section 3:OpenCV Implementation on Robot

• Extract ROI(Region of Interest) from input frame

• Find contour, draw convex hull

• Find convexity defects

Part 2: Software Design

Section 3:OpenCV Implementation on Robot

Input & Output Picture after Finding Contour

Part 2: Software Design

Section 3:OpenCV Implementation on Robot

Algorithm to calculate the convexity of defects

Further Improvements

• PCB Prototype Circuit Board

• 3D Printing Outer Body

• Reduce Using of Skeleton & Mount ComponentsDirectly onto Body

• NetIO Color Picker & OSX Dashboard Widget(Github)

• Design Own Android App and iOS App

• Add Voice Recognition Module

• Improve the Algorithm of Gesture Recognition

• Implement Interactive Games

• Facial Expression Recognition (AAM & ASM)

• Object Following and Obstacles Avoiding

NetIO color picker Point-To-Opposite

Conclusion

Conclusion

Q&A