26
January 26, 2015 Andrew H. Rawicz School of Engineering Science Simon Fraser University V5A 1S6 Re: ENSC 305W/440W Project Proposal – LumenX 3 : Projected Mobile Computer Dear Dr. Rawicz, I am writing in regards to the course requirements of ENSC 305W/440W. Enclosed with this letter is ObelXTech’s proposal for LumenX 3 . The object of this project is to design and build a screen-less Windows device that can project its user interface onto any surface the device sits on. A user’s touch and gestures are detected by an imaging system for maximum portability and versatility. The following documentation details the market need for our innovative new product, the description of the device and its features, an implementation schedule and a complete cost breakdown. We believe the strength of our planning, designing and proven work ethic, having started work well before the current semester, will allow the full potential of the LumenX 3 to be realized on schedule and according to specifications. Our eclectic team consists of 5 talented senior engineering students, ranging in concentrations from Computer Engineering, Engineering Physics, Electronics Engineering to Systems Engineering. It consists of Carmen Tang, Davin Mok, Gary Yu, Herman Mak and Michael Ng. Complete profiles are available at the end of the proposal. I appreciate your time in reviewing our proposal for the LumenX 3 . Should you have any further questions, please feel free to contact me by phone at 778-995-7858 or email at [email protected]. Sincerely, Gary (Guo) Yu Chief Executive Officer ObelXTech

letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

January 26, 2015

Andrew H. Rawicz School of Engineering Science Simon Fraser University V5A 1S6 Re: ENSC 305W/440W Project Proposal – LumenX3: Projected Mobile Computer

Dear Dr. Rawicz,

I am writing in regards to the course requirements of ENSC 305W/440W. Enclosed with this letter is ObelXTech’s proposal for LumenX3. The object of this project is to design and build a screen-less Windows device that can project its user interface onto any surface the device sits on. A user’s touch and gestures are detected by an imaging system for maximum portability and versatility.

The following documentation details the market need for our innovative new product, the description of the device and its features, an implementation schedule and a complete cost breakdown. We believe the strength of our planning, designing and proven work ethic, having started work well before the current semester, will allow the full potential of the LumenX3 to be realized on schedule and according to specifications.

Our eclectic team consists of 5 talented senior engineering students, ranging in concentrations from Computer Engineering, Engineering Physics, Electronics Engineering to Systems Engineering. It consists of Carmen Tang, Davin Mok, Gary Yu, Herman Mak and Michael Ng. Complete profiles are available at the end of the proposal.

I appreciate your time in reviewing our proposal for the LumenX3. Should you have any further questions, please feel free to contact me by phone at 778-995-7858 or email at [email protected].

Sincerely,

Gary (Guo) Yu Chief Executive Officer ObelXTech

Page 2: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

Proposal

Version 3.2.2

January 26, 2015

Team Members:

Carmen Tang

Davin Mok

Gary (Guo) Yu

Herman Mak

Him Wai (Michael) Ng

Page 3: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

i

Executive Summary The majority of technology owners today will notice that most of our electronic devices in which we

interact with display content with a screen. Physical screens tend to be one of the most fragile yet

integral parts of a portable unit. With a phone or laptop, these screens often crack from everyday

actions such as dropping it onto the ground, which render the entire product useless. We at ObelXTech

investigated to find another method of display while avoiding the downsides of a screen. Our product is

the LumenX3, a screen-less portable computing device that brings forth a unique set of properties no

modern device can compare with.

The LumenX3 boasts many capabilities that users may expect to find in a portable device, however

except in a different combination. In a sense, it can be seen as a combination of a touch-tablet and a

projector. Users will be able to view the contents displayed by the Windows OS as a projection from the

LumenX3 box onto the surface on which it is placed. They will be able to interact with the device by

touching the surface where the screen is displayed, giving a similar experience to touchscreens. Users

will be able to use gestures such as tapping, holding, and swiping with multiple fingers. This will promote

interactivity and collaboration between multiple people and is especially useful for group projects. The

LumenX3 will also be durable enough to withstand falls and rough handling with a uniform outer shell. In

essence, the LumenX3 will resemble a small, beautiful monolith. With such a robust product, users will

have much more freedom to take their device anywhere a flat surface can be found.

The LumenX3 will be running the latest version of Windows and offers the capability to support other

operating systems like Linux. The touch-friendly Windows system will be powered by a MeegoPad T01 as

its mainboard. Projection will be done via a Pico Projector and touch gestures will be recognized from

the Leap Motion Controller.

With focuses on durability and touch interactivity that encourages collaboration, the LumenX3 is a

portable device that is not meant to directly replace existing smartphones or other portable devices for

consumers. Thus, our potential market is any individual who can benefit from a portable device, such as

business professionals, young adults and students.

The ObelXTech group is a team of outstanding engineers, all of whom are completing their final year of

study in SFU Engineering in Computer, Systems, Electronics, Physics and Business specializations.

Combined, their skills and experience cover a vast range of topics including object-oriented, scripting

and app software programming, machine learning, image processing, hardware programming and

design, electronic system design, wireless data transmission, business administration and materials

fabrication. With thorough investigations and designs already completed, milestones and deadlines

already set and an effective method of communication and collaboration, we are well on our way to

making our dream, the LumenX3, a reality. The release of the unique LumenX3 projected computer will

reshape the landscape of portable technology.

Page 4: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

ii

Table of Contents Executive Summary .................................................................................................................................. i

Table of Contents..................................................................................................................................... ii

List of Figures ......................................................................................................................................... iii

List of Tables ........................................................................................................................................... iii

Glossary ................................................................................................................................................. iv

1.0 Introduction....................................................................................................................................... 1

2.0 Product Summary .............................................................................................................................. 1

2.1 Product Design  .............................................................................................................................. 1

2.2 System Overview ........................................................................................................................... 5

2.3 Component Analysis and Budget  ................................................................................................... 6

2.4 Business and Marketing ................................................................................................................. 6

3.0 Project Logistics ................................................................................................................................. 8

3.1 Scope ............................................................................................................................................. 8

3.2 Risks .............................................................................................................................................. 9

3.3 Benefits ....................................................................................................................................... 10

3.4 Implementation Schedule and Timeline ....................................................................................... 11

3.5 Funding........................................................................................................................................ 14

4.0 Company Overview .......................................................................................................................... 14

5.0 Conclusion ....................................................................................................................................... 16

References ............................................................................................................................................ 17

Appendix A ............................................................................................................................................ 18

Page 5: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

iii

List of Figures

Figure 1 - External Design of LumenX3 ..................................................................................................... 3

Figure 2 - Front View of the LumenX3 ....................................................................................................... 3

Figure 3 - Internal View of the LumenX3 and its Components   ................................................................. 4

Figure 4 - Block Diagram for the LumenX3 sub-systems ............................................................................ 5

Figure 5 - Projected Tablet and PC Sales Growth. Sourced from [9]. ......................................................... 7

Figure 6 - Simplified Gantt Chart ............................................................................................................ 11

Figure 7 - Infographic of major project deadlines and milestones ........................................................... 12

List of Tables

Table 1 - Cost Breakdown for Prototype ................................................................................................... 6

Page 6: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

iv

Glossary Bluetooth A wireless communications system and standard based on radio wave

technology used commonly for connection between mobile devices

Development Board A printed circuit board containing a microprocessor and the minimal support

logic needed for an engineer to become acquainted with the microprocessor

on the board and to learn to program it

GPIO General Purpose Input Output

HDMI High-Definition Multimedia Interface – a standard for connecting high-

definition video devices

Keystone Correction A function that allows multimedia projectors that are not placed

perpendicular to the horizontal centerline of the screen (too high or too low)

to skew the output image, thereby making it rectangular

Leap Motion Controller A small USB peripheral device for fast 3D hand tracking on x86 computers

LED Light-emitting diode, a pn-junction diode which emits light when activated

Linux An open-source operating system modelled on UNIX

Microsoft Windows An operation system made by Microsoft and is the most popular OS on x86

devices

Monolith A large structure regarded as intractably indivisible and uniform

OpenCV A library of programming functions mainly aimed at real-time computer

vision, developed by Intel, and now supported by Willow Garage and Itseez

OS Operating system

Perspective Correction The process of correcting a distorted user viewpoint through the use of

computer software and/or mechanical devices

PCB Printed circuit board

Servo Servomotor, a rotary actuator that allows the control of angular position,

velocity and acceleration

USB Universal Serial Bus, an input/output interface standard for data transmission

between electronic devices

Wi-Fi A wireless networking standard based on radio wave communication to

provide Internet and local area network connections

Page 7: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

1

1.0 Introduction Most individuals today own a variety of electronics. A desktop computer at home, a laptop on the go, a

smartphone at all times is one of the most common combinations of electronics students own.

However, one of the biggest liabilities of portable devices like laptops or smartphones is the screen.

For these portable devices, if there is no screen the device is rendered practically useless, because the

user is unable to see their interactions or feedback from the computer in order to use it effectively.

Even though many phones today are said to be shatter resistant, the screen will still easily crack if

dropped onto the floor. This motivated us to look for a more robust way to interact with a computer:

what are alternatives to having a screen that would resist falls and is still portable? As we move towards

a more touch-friendly future for computers, how can we take in gestures from fingers or pens while still

allowing users to type? As a result, we envisioned the LumenX3 (pronounced "lumen-ex-cubed").

With a sleek, portable, robust case built in a way such that it won't crack or become inoperable after

being dropped onto the ground multiple times, the LumenX3 will be known to be a durable device. Using

projection instead of a screen, the projected 'screen' size will be larger without sacrificing portability, and

there will be more room for more powerful computing components. Furthermore, since it will take in

touch input on the optical projection, it will promote interactivity and collaboration among groups

anywhere where there is a flat surface to place the LumenX3 on. The LumenX3 will be running Windows

and features an on-screen touch keyboard for typing. Eventually, it can be extended to be battery-

powered and able to switch to operating systems like Linux. The LumenX3 is not meant to be a direct

replacement for smartphones or laptops but an additional option when purchasing a portable device,

since it boasts a different and distinct set of features from handhelds with screens.

This proposal will feature the following sections:

Explanation of our product LumenX3, its features and components

The business, marketing and target users of our product

Logistics of our implementation, project scope and schedule

Risks, benefits and funding sources for our venture

The ObelXTech company make-up and team profiles

2.0 Product Summary

2.1 Product Design  Now, since the glass display screen is considered as one of the most fragile part of a portable device, our

product design completely removes the risk of it breaking. The goal of the LumenX3 is to adopt a screen-

less approach while giving users the ability to intuitively interact with a compact powerful device. Below

are the main features of our product:

Page 8: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

2

1. Screen-less Projection

The user interface is projected onto a flat surface by a tilted Pico Pocket projector [1] located

inside the LumenX3. The image distortion due to this tilted angle is corrected in real-time so that

users can interact and manipulate with the projected user interface by their fingers. The device

then automatically determines the action performed by the user and react to that in real

time. This is achieved by employing sophisticated machine learning algorithms, libraries from

OpenCV [2] and through the use of Leap Motion Controller [3] to constantly analyze the data

stream captured from the user.

2. Multi-Touch Gesture Recognition

When users interact with the projected screen on a flat surface, not only can they perform

simple touch and click action, the system within the device is able to track 10 fingers at the same

time and recognize all the different gestures user are performing [4], this enables the users to

perform actions such as tap, double tap, drag, tap and hold, and pinch or expand.

3. Mobile Operating System

Being a non-traditional computing device, like many existing mobile devices the LumenX3 does

not employ the use of mouse and keyboard for daily content consumption. In order to provide a

touch friendly environment to the users, the LumenX3 will be running Microsoft Windows 8.1 [5]

as its native operating system. Windows 8.1 features a “touch” friendly user experience that is

compatible with the Start screen and its native apps [6].

4. Ultra-Portable and Durable

As we were designing the LumenX3, we focused a lot on making the product as compact and

lightweight as possible. The designed prototype device takes on the shape of a rectangular

prism, with the outer case made of a single material. The design focus will be sleek and stylish,

adding a sense of fashion onto its durability and making the LumenX3 resemble a miniature

monolith. In order to preserve the beauty of this monolithic design, we aim to

minimize the number of openings on the surface of the LumenX3. As shown in Figures 1, 2 and 3,

there are only 2 openings on the front panel, the biggest one being the projector lens which can

project images with resolution up to 1080p. Underneath is the sensor window of the Leap

Motion controller.

We have rendered models of our device prototype and show some of its design aspects from several

views below.

Page 9: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

3

Figure 1 - External Design of LumenX3

Figure 2 - Front View of the LumenX3

Page 10: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

4

Figure 3 - Internal View of the LumenX3 and its Components  

Page 11: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

5

2.2 System Overview The LumenX3 will be composed of 4 hardware components that include: a MeegoPad T01 [7], a Leap

Motion Controller, a Pico Pocket Projector, and an Arduino Uno [8]. The MeegoPad T01 will be our

mainboard which runs the OS and outputs a modified video stream that has been compensated for

angle distortion via the HDMI port to the Pico Pocket Projector. The Leap Motion Controller will be

connected with the MeegoPad via USB 2.0 and will be responsible for the detecting the user’s hand

motions. The Arduino Uno similarly connects to the MeegoPad via USB 2.0 and serves as the system’s

interface with the outside world.

Figure 4 - Block Diagram for the LumenX3 sub-systems

Page 12: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

6

2.3 Component Analysis and Budget  In our development period, we will be working to develop the Proof-of-Concept prototype. The system

components and hardware chosen for our device are considered for their ability to fit within our

developmental budget as well as perform at the standards we expect for a commercial product. Table 1

outlines our proposed budget and expanses for completion of LumenX3 Proof-of-Concept prototype. We

have included all costs of shipping in the prices shown. The category Minor Electronics and Other

Accessories includes parts such as LED’s and servos which can be used to extend the feature set of the

device should additional development time permits. We have also set a Contingency cost of 15% in case

of unexpected expenses.

Table 1 - Cost Breakdown for Prototype

Component Price ($ CAD)

Microsoft Windows 8.1 119.99

MeegoPad T01 (small size x86 single board computer based on Intel Atom processor)

138.03

Pico Pocket Projector (compact optical projector with satisfying brightness) 184.91

Leap Motion Controller (efficient 3D gesture tracking tool) 89.59

Arduino Uno (open sourced microcontroller with huge community support) 30.00

Half-Size Breadboard (for LED and mechanical servo wiring) 5.60

Plastic Enclosure 30.00

Minor Electronics and Other Accessories 50.00

Subtotal 648.12

Contingency (15%) 100

Total Cost 748.12

2.4 Business and Marketing In today's social driven society, a top priority for people is to be "always connected". People cling to their

mobile devices like smartphones, tablets, and notebook computers like babies and their pacifiers. Of

these devices, tablets and other large screened peripherals running mobile operating systems are seeing

the largest segment growths. In fact, mobile devices like tablets have dominated the market with huge

shipment growth for the last half decade.

Page 13: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

7

Figure 5 - Projected Tablet and PC Sales Growth. Sourced from [9].

In the “Post-PC era” [10], consumers have moved away from classical mouse input to the now widely

adopted finger touch. Another innovative technology that is driving today's market is VR (virtual reality)

technology. The Oculus Rift [11] pioneered this technology using Kickstarter and the market support was

overwhelming, shattering their $250,000 funding goal by raising over $2,400,400.

The LumenX3 is a product built to bridge the gap between PC’s and Mobile Device. It offers a completely

revolutionary user experience through the synthesis of ground breaking VR-like hand tracking

technology and the now widely adopted finger touch input.

The LumenX3 will be a high end product priced USD $799 – $1199. First, we will target early adopters

with more disposable income to maximum profits. The early adopters include businesses, designers, and

tech savvy individuals. The early adopter enjoys using bleeding-edge technologies and is willing to pay

for the high cost of doing so. The early adopters are also more accepting of the fixes and updates that

are customary with completely new products, such as our LumenX3. Then, we will lower the price

through economies of scale and production efficiencies, allowing us to reach more of the consumer

market. Since the LumenX3 offers a completely unique experience that has no physical screen, it can

deliver an exceptional content consumption experience to just about anyone. It has an optimized user

interface that uses smart hand gesture tracking and a slick projector to turn most surfaces into your

computer. The LumenX3 is extremely portable and has the dimensions perfect to fit in your purse or

backpack.

Tablets and large-screened content consumption devices are one of the indirect competitors to the

LumenX3. The LumenX3 outshines tablets in two, very important aspects. Firstly, it is more durable than

tablets. In the high traffic, high mobility workplaces of today's successful companies, tablets are

extremely prone to being broken. The LumenX3 is always rested on a surface and the interaction location

Page 14: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

8

is separated from the hardware itself. This means that the LumenX3 experiences less wear and tear and

less accidental damage. This result means that less money must be spent on repairs and replacements

and more money can go to where it is really needed. Secondly, the LumenX3 is designed from the ground

up with collaboration in mind. The large screen projected on a table surface means that more people can

consume content together whereas tablets are designed for personal content consumption.

The LumenX3 has few direct competitors, but one device occupying a similar market exists called the

ODIN Android Smart projector [12]. The ODIN successfully reached their funding goal of USD $250,000

using Kickstarter on July 2014, demonstrating a clear need in the market for smart projection devices.

They utilize the effectiveness of delivering content via projector but vary in one important aspect. The

ODIN is a delivery device and it is not designed to take in inputs from users (like a computer). The

LumenX3 is designed for user interaction and it is built to facilitate collaboration with multiple users.

3.0 Project Logistics

3.1 Scope As with any product in the development stage, the array of included features and functionality can be

ever-expanding. However given our schedule, scope of the project and technical complexity, we realize it

is prudent to limit the end-goal of our project at the Proof-of-Concept phase. Of course, given time and

budget permits, we are optimistic we can move onto a second redesign iteration with refinement and

miniaturization phase, followed by eventual Manufacturing and Bring-to-Market phases.

For the scope of our project, we aim to finish a working prototype with projection of screen, touch

recognition and system boot-up. It will demonstrate the following feature deliverables as Proof-of-

Concept:

Windows system OS boots up and functions

Full connectivity functions like Wi-Fi and Bluetooth

Projection of screen onto surface before device

System recognizes single and multi-finger touch and tap

Enclosure similar to the 3D rendering shown previously

We believe these features will clearly demonstrate the functioning and appeal of our product and

remain within the capabilities of our team to accomplish them. However, with time and budget

permitting, we believe the next phase should include these stretch goals:

Drawing and Writing With Pen

Just like the computing systems from Microsoft Surface product line [7], it is natural for our

device to also provide the function for the users to take notes or drawing with their pens on the

projected surface. Therefore one of our stretch goals is to include the capability to recognize pen

gestures and movements into the LumenX3.

Page 15: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

9

Extending Supported Operating Systems to Linux

One stretch goal will be to allow users to boot the device in their favorite Linux-based operating

system, able to also dual-boot into the native Windows on the MeegoPad.

Re-scalable and Re-sizeable Projected Screens

In order to take full advantage of the fact that user are not limited by a set physical screen, we

can implement additional software design that allow for users to change the size of the

projected screen according to pre-defined gestures. The screen size and resolution are only

limited by the projector’s specifications and our device can allow dynamic re-adjustments to

suite the user’s every viewing need.

Compression and Extension of Physical Size

Due to the angle of projection and height requirements of the LumenX3, our prototype device

will be taller than what most consumers may find comfortable to carry and store in their

everyday use. One feature to address this is the ability for the device to compress to a smaller

size when not in use into essentially a cube for carrying around and storage. The casing can be

made to handle height changes, and electromechanical servos can be used to raise the projector

upon start-up of the device.

Attachment to Vertical Surfaces

For the current design, our device can only be used on a horizontal flat surface. Although this is a

great improvement over the current screen size limited tablets, it does bode well for people who

do not like to bow down their heads all the time. Therefore, we target to implement a function

such that the device will be able to attach to vertical surfaces easily, this enable users to do

presentation in a more formal style.

Unified Power Source and Battery-powered Operation

The original components we have chosen have their own power supplies, so as a stretch goal we

aim to combine the power supply cables into a single cable, and then move on further to make

the whole device battery-powered for ultra-portability.

Custom-designed and manufactured components like projector, touch sensor and PCB

As seen, our project is modular and holds great potential for expandability and increasing functionality.

Should our team find additional funding and development time, we would like to explore these goals for

greater product completeness.

3.2 Risks As with any development into a new product and new market, there exist inherent risks within our

project implementation. However, given our advanced and meticulous planning, as well as our

dedication to the project goals at hand, we believe we can accomplish the projected deliverables.

Page 16: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

10

One of the major risks is the complexity of our product coupled with the limited amount of time in which

to complete it. Meeting all of our deliverables of our system requires complete functionality for all the

modules and synchronicity of interconnections. To take on the task, we have implemented a rigorous

schedule that shows our commitment and willingness for project completion. Assigning a different team

member responsible for each module will prevent the risk having a semi-completed system, one that is

lacking a core functionality. We are also investigating multiple ways to accomplish the same task, both as

a developmental experiment and possible fail-safe for the eventual product.

In that regard, there also exists the risk of successfully connecting all the different parts together – for

even if we demonstrate individual functionality, communication between the modules can delay the

system or prevent boot-up. To accommodate this possibility, we aim to test our software and coding on

available hardware and simulated operating systems not necessarily those going into the final product to

prove functionality. Spreading out the modular development and integration as will be seen in our

schedule will mitigate this issue.

Other potential challenges we may face with the device include device heating from the boards due to

constant calculations, brightness of the projected screen, limited usage in bright environments and

accuracy in recognizing a touch. However we are confident that for the scope of our Capstone project we

will be able to produce a proof-of-concept working prototype that takes in account of these risks and

lessen their impact.

3.3 Benefits There are many benefits to the engineering community, industry and the consumer market that are

brought about by our product.

Firstly, to analyze the benefits to the engineering community, consider that engineers often have the

need to share content with team members to assist with project progression. With the creation of our

device, it will allow content sharing through another medium – projection. This useful tool produces a

method for presentations to be made on any surface by means of projection at an angle. Instead of

having to bring around a full-sized projector which also requires a wall large enough to allow projection,

individuals simply need a surface to put our light-weight portable device on. This convenient feature

goes outside of just the engineering community as people from all academic and business backgrounds

can make use of this device as an alternative to a tablet or projector during any type of collaborative

work.

The benefits to the industry cannot be overlooked as well. Currently some projectors cannot deal with

projecting at an angle because it distorts the image being projected. Those which can remedy projecting

at an angle do so via keystone correction which only compensates for up to 15° of projection distortion.

In this project, we are attempting to project at an angle of 35° which is much greater than what keystone

correction can fix. We are doing so through the use of OpenCV and if successful, we plan to implement it

for many other angles as well. This breakthrough will be huge for the industry of projectors as it frees up

the restrictions of having to project perpendicular to the wall.

Page 17: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

11

Finally, the benefits to the consumer market are evident as described in the Business and Marketing

section. For the business professional, student or technology enthusiast, a portable device that is smart,

durable and innovative will add great personal benefit and enjoyment to their lives. With the risk of

breaking their screen gone, an owner has that much more freedom to take their mobile computing

device anywhere a flat surface can be found. The great potential for interactivity, content sharing and

enhanced UI experience are key features of the product that enables any end-user to get more out of

their portable devices.

These are the main benefits to the engineering community, industry and consumer market that is

brought about by LumenX3. Once our device is produced and delivered to our potential customers, the

users will fully realize its benefits resulting in unprecedented content sharing and collaborative work

experiences.

3.4 Implementation Schedule and Timeline In keeping with the requirements of the Capstone Senior Design class, ENSC 440, our implementation

schedule will include the requirements and deadlines imposed by its rubric. However, since our team has

started our project 2 semesters ahead of time, our schedule will be elongated compared to the normal

timeframe.

To facilitate project planning and implementation, we have come up with 21 milestones to be completed

in 5 stages over the 11 month period, from June 2014 to April 2015. The critical parts of our work will be

done in the 4 month period in which all of us will be enrolled in ENSC 440, from January 2015 to April

2015. Our schedule is divided into the following 5 stages, as shown in Figure 6:

1. Pre-course Planning, Brainstorm and Permission

2. Proposal and Commencement

3. Module Implementation

4. Module Testing and Integration

5. System Testing and Functioning

Figure 6 - Simplified Gantt Chart

Page 18: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

12

To track the progress of our project, our team has identified major key milestones in the following

infographic. A placeholder date for the final demo has been set until official confirmation.

Figure 7 - Infographic of major project deadlines and milestones

Pre-course Planning, Brainstorm and

Permission

•July 11, 2014: Finalize Project Idea

•August 2, 2014: Obtain Permission

•August 24, 2014: Preliminary Research

Proposal and Commencement

•September 3, 2014: Proposal (Unofficial)

•September 23, 2014: ESSEF/Undergrad Award Funding

•December 24, 2014: Order Parts/Components

•January 2, 2014: Functional Specification Draft (Unofficial)

•January 26, 2015: Proposal (Official)

Module Implementation

•February 16, 2015: Perspective Correction

•February 16, 2015: Hand Tracking

•February 16, 2015: Arduino Interface

•February 16, 2015: Windows Driver

Module Testing and Integration

•February 16, 2015: Functional Specification

•February 24, 2015: Oral Progress Report

•March 9, 2015: System Integration

•March 16, 2015: Design Specification

•March 23, 2015: Device Bring-Up

System Testing and Functioning

•March 30 2015: Written Progress Report

•April 6, 2015: Final Testing, Debug and Enclosure

•April 13, 2015: Demo and Post-Mortem

•April 20, 2015: Wighton Funding

Page 19: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

13

For a comprehensive Gantt chart with all dates and milestones, please refer to the Appendix A.

For a description of the various stages, the following sections detail what we hope to accomplish

throughout each time frame.

Pre-course Planning, Brainstorm and Permission

The initial stages of our project consist of generating ideas and brainstorming for projects appropriate for

ENSC 440 Capstone Senior Design. The project team composition is chosen and the project idea is voted

on by all members. Meetings are set-up to discuss project goals and preliminary research is done to

determine technical and market feasibility of project ideas. Discussion with faculty, previous students

and TA’s are used in consultation. Permission to officially form group and establish project idea is

obtained. Technical and business research pertinent to project proposal is done and shared with team.

Proposal and Commencement

The proposal for ENSC 440 documenting our project ideas, group logistics and funding sources is

completed and reviewed ahead of official deadline in January 2015. A draft proposal of the functional

specifications of our product is completed and reviewed, with revisions done for the official deadline.

Various meeting protocols, documentation sharing, group software needs, group name and product logo

are resolved. Scheduling and Gantt chart is completed as a guide for project implementation and tasking.

Sources of funding are investigated and applications submitted. Upon final realization of component list

and quotes, ordering is done before the holidays to ensure delivery when term starts.

Module Implementation

The most important part of our project, implementation of each module takes the most amount of time

and has the most variability in terms of scheduling. Therefore a generous 67 days is given to this part,

accounting for the different rates at which each module will be completed. Perspective Correction

includes work with pico-projector hardware as well as OpenCV for perspective correction, written in C++

and transferred to Windows via driver code. Hand tracking refers to the work done with the Leap Motion

Controller and its hand gesture and recognition algorithms. Arduino Interface consists of the work with

programming the microcontroller and design of user interfaces for device interaction. Windows Driver is

the software and firmware coding required incorporating the previous features and integrating them for

use in the Windows OS. All these modules are scheduled to be complete before the next phase, although

we realize the possibility that some modules are completed earlier or later than predicted.

Module Testing and Integration

Here the various modules completed in the previous phrase are initially tested to see if the

subcomponents work individually. We will make sure that the fundamental features required for the

device functions successfully on their native hardware before adapting the modules for our specific

applications. Once the connections between the software and hardware are made and kinks ironed out,

we will attempt to transport the system into the Windows OS, which is our target ecosystem Once we

are sure the various modules are working together, and that they have been successfully translated into

Page 20: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

14

the Windows OS, we will integrate all the components together and start assembling the final product.

Connections will be set and the whole system should be brought up. This is a significant part of project

and efforts into this endeavor run for a period of 36 days.

System Testing and Functioning

Final testing of our device will last approximately 2 weeks to iron out any bugs and characterize our

product fully. We will test our product using real user scenarios to ensure features are high-performing

and reliable. The enclosure for the device will be designed and made at this point, possibly through 3D

printing. Preparations for demo and final course requirements are made, including presentation and

wrap-up.

3.5 Funding In striving to bring our proof-of-concept to the real world, we realize the budgetary constraints we have

for the project. Although initially our costs will be elevated due to research, components costs and

logistics, we are confident that a product in production will be financially feasible for market prices.

To cover the funding required for our project expenditures, we are looking into 3 main avenues: the

Engineering Science Student Endowment Fund, the Wighton Engineering Development Fund and the

IEEE SEC Mini-Grant. In applying to these sources we are fully committed to prepare presentations and

required proposals, such as this document. We believe starting and applying early will give us the best

chance in acquiring these funds.

In addition, we are looking into ways where our components can be obtained without purchasing them,

thus cutting back the financial requirements. We plan on evaluating equipment borrowed and donated

from friends and colleagues; an example being that we have found a lender for an Arduino and are

actively looking for other lenders to borrow hardware for testing. The ESSS also has parts for projects

which we can sign out for our needs. Beyond hardware components, many of our software requirements

are free to use and available for licensing.

In the case where our funding and awards does not cover the full amount of our project, our team has

agreed to split the remaining outstanding costs evenly among the members.

4.0 Company Overview In bringing such a groundbreaking product to market, we have assembled an eclectic team of senior

engineering students for the formation of ObelXTech. The implementation and success of our project is

heavily team oriented and requires contribution and synergy from all its members. The profile for each

member is introduced below and highlights their outstanding experience and skills.

Page 21: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

15

Carmen Tang – Chief Operating Officer

Carmen is a 5th year Computer Engineering student who has extensive software development and

project management backgrounds. She has had 3 co-op terms with Microsoft, developing Windows,

Windows Phone and ASP.NET Web applications for various company products: from business enterprise

software to consumer products to internal tools. Through these, she has developed skills in object-

oriented programming, markup and scripting languages (C, C++, C#/XAML, JS, JQuery/AJAX, HTML/CSS).

In addition, she has relevant computer science courses in data structures and algorithms. As the COO of

the company, Carmen manages the daily operations for the project, and consolidates meeting logistics,

communication and minutes, schedule adherence and project milestones, ensuring quality progress on

the product will continue to be done efficiently and effectively. With her background and skill-set,

Carmen will focus on the system integration and coding requirements for the LumenX3.

Davin Mok – Chief Financial Officer

Davin is a 5th year Systems Engineering student who is interested in hardware and system design. Having

done co-ops at Sierra Wireless in testing communication products and at Broadcom as a Hardware

Intern, Davin is adept at scripting, system bring-up, hardware design and SMT reworks through his

industry experience and from robotics and system courses. A notable past project Davin have taken part

in is building a wireless heart-rate monitor using photolytic resistors to detect heart beats and

transferring the data through an Arduino to a neighbouring smartphone via Bluetooth. In the role of

CFO, Davin is responsible for the budget and funding aspects of the project, including keeping track of

costs, expenses, assets and sources of funding. In terms of product development, Davin will be working

with Michael on the hand tracking system and projection for the LumenX3.

Gary (Guo) Yu – Chief Executive Officer

Gary is a 5th year Electronics Engineering student with a strong knowledge of analog design, sensor

systems and hardware testing. He has completed a co-op term at Broadcom where he tested the latest

Android phones and tablets, as well as a research co-op in designing optical sensors for MVA

transformers. He has taken micro-fabrication, VLSI, and electronic design courses and worked on select

projects including a NTSC video processing circuit, VLSI implementation of an image sharpening core and

a FPGA-based Mario game. He has honed skills in electronic system design, VHDL, TKL and PERL

scripting, and test equipment use. Gary will be the CEO of the company, and in this role he will lead

project direction, coordinate with group members and stakeholders as well as act as the team

representative. For the project, Gary will focus on the Arduino and other hardware components for the

LumenX3.

Herman Mak – Chief Marketing Officer

Herman is a 5th year Systems Engineering student that is interested in systems integration and project

management. He has a minor in Business Administration and has the relevant expertise to develop our

market research and business plan for the product, learning from past projects which give him

experience with the process and considerations of starting a new company. In addition, Herman had two

Page 22: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

16

co-op terms as a Software Test Developer at Sierra Wireless testing an assortment of communication

devices and interned one term as a Firmware SQA at Tesla Motors working on infotainment automation

development. He has development experience in Object Oriented programming, and scripting languages

(C++, Java, Python, and Ruby). As the CMO of the company, Herman will head the brand development

and strategy, brand image, and market analysis. As for the project, Herman will be focusing on the image

correction and projection aspects of the LumenX3.

Him Wai (Michael) Ng – Chief Technology Officer

Michael is a 5th year Engineering Physics student that has a wide range of experience from nano-

structures research to Android device development to image processing. He has extensive experience

from working with graduate students at 4D Labs and a co-op term with SAP as an agile developer. In

addition, Michael has worked on objection recognition using Python with OpenCV libraries and machine

learning techniques, and a GPU-accelerated scientific computational framework on CUDA-enabled

graphic cards to enhance matrix computation and Fourier Transformation speed. He is also well

experienced in scripting, large database applications and high performance computing. With his range of

technical expertise, Michael best serves the role of CTO: he will guide the development of the overall

system and give advice to both the hardware and software sides. In addition, Michael will be working

with Davin on the hand tracking system and overall system bring-up for the LumenX3.

5.0 Conclusion The LumenX3 will be a screen-less, robust, portable device that will allow users to easily interact with a

powerful operating system on any surface. The projection of the screen will enable users to effortlessly

share content with other people in the immediate vicinity and easily collaborate since it takes in touch

input on the surface. With this distinct set of features, the LumenX3 is an additional option in the market

for consumers to consider when purchasing a portable device. We have assembled a group of

outstanding engineers to develop the LumenX3. With thorough investigations and work already

completed, milestones detailed out, deadlines already being met and a very effective set of methods for

communication and collaboration for our specific team, we are well on our way to making the LumenX3 a

reality. The release of the LumenX3 projected computer will reshape the landscape of portable

technology as we know it.

Page 23: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

17

References

[1] A. G. a. E. Rukzio, "View & Share: Exploring Co-Present Viewing and Sharing of Pictures using Personal

Projection," in Proceedings of the Workshop on Mobile Interaction with the Real World, 2009.

[2] "OpenCV Developer Website," [Online]. Available: http://code.opencv.org. [Accessed 20 01 2014].

[3] "Leap Motion," [Online]. Available: https://www.leapmotion.com/. [Accessed 20 01 2015].

[4] L. H. J. A. R. Nakatani and J. A. Rohrlich, "Soft Machines: A Philosophy of User-Computer Interface Design," in

Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI’83): 12–15, 1983.

[5] Microsoft, "Windows 8.1 tutorial," Microsoft, [Online]. Available: http://windows.microsoft.com/en-

ca/windows/tutorial. [Accessed 20 01 2015].

[6] Microsoft Corporation, "Apps for Windows," 2015. [Online]. Available: http://windows.microsoft.com/en-

ca/windows-8/apps. [Accessed 18 January 2015].

[7] Q. C. Factories, "MeeGoPad T01 Microsoft Windows 8.1 OS TV Stick - Quad-Core CPU, 2GB RAM, 32GB

Internal Memory, Bluetooth, HDMI Interface (White)," Amazon, [Online]. Available:

http://www.amazon.com/MeeGoPad-T01-Microsoft-Windows-Stick/dp/B00RVCGNEC/ref=sr_1_1/186-

0830612-3498750?ie=UTF8&qid=1421821688&sr=8-1&keywords=meegopad. [Accessed 20 01 2015].

[8] "Arduino Uno," Arduino, [Online]. Available: http://arduino.cc/en/Main/arduinoBoardUno. [Accessed 20 01

2015].

[9] J. Donoghue, "Tired of Tablets: Questions to ask to make sure tablet PCs are the right fit," Logic Supply Blog ,

2015. [Online]. Available: http://www.logicsupply.com/blog/2013/08/29/tired-of-tablets-questions-to-ask-to-

make-sure-tablet-pcs-are-the-right-fit/. [Accessed 18 January 2015].

[10] T. Carmody, "Fighting Words: What Apple Means When It Says ‘Post-PC’," WIRED, 7 March 2012. [Online].

Available: http://www.wired.com/2012/03/fighting-words-what-apples-means-when-it-says-post-pc/.

[Accessed 18 January 2015].

[11] Oculus, "Oculus Rift: Step Into the Game," Kickstarter, 31 August 2012. [Online]. Available:

https://www.kickstarter.com/projects/1523379957/oculus-rift-step-into-the-game?ref=nav_search. [Accessed

23 1 2015].

[12] A. Yoo, "ODIN: Android 'Smart' Projector to Carry in Your Pocket," Kickstarter, 7 July 2014. [Online]. Available:

https://www.kickstarter.com/projects/832648575/odin-android-smart-projector-to-carry-in-your-pock.

[Accessed 23 January 2015].

Page 24: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

18

Appendix A

Page 25: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

19

Page 26: letter is ObelXTechs . The object of this project is to ...whitmore/courses/ensc305/projects/2015/11pro… · on the board and to learn to program it GPIO General Purpose Input Output

20