AUGMENTED REALITY FOR DRUG IDENTIFIER

(AR-DI)

NUR SYUHADAH BINTI HANIZAM

BACHELOR OF INFORMATION TECHNOLOGY (MEDIA INTERACTIVE)

FACULTY INFORMATICS AND COMPUTING

UNIVERSITI SULTAN ZAINAL ABIDIN

2019

ii

DECLARATION

I hereby declare that this project is based on my own effort with helps getting

information from sources that I have confessing. All section of the text and results

which have been obtained from other workers or sources are fully references. This

dissertation is submitted to the Faculty of Informatics and Computing, Universiti

Sultan Zainal Abidin as partial fulfilment of the requirements for Bachelor of

Information Technology (Media Interactive) with Honours.

_______________________________

Name : Nur Syuhadah binti Hanizam

Matric no. : BTDL16044361

Date : …………….………………..

iii

CONFIRMATION

The research conducted and the writing of this report was under my supervision and I

hereby declare that I have checked this project and in my opinion, this project is

adequate in term of scope and quality for the award of Bachelor of Information

Technology (Media Interactive) with Honours.

__________________________________

Name : Pn. Norkhairani binti Abdul Rawi

Date : …………………………………..

iv

DEDICATION

First and foremost, praise to Allah SWT for blessing me ad giving me the

opportunity to complete my final year project, Augmented Reality for Drug Identifier

(AR-DI).

Here I would like to take this opportunity to express my gratitude to my

supervisor, Puan Norkhairani binti Abdul Rawi for the valuable guidance, advice,

kindness and support towards this project. Under her supervision, I was able to

complete my final year project successfully. An honorable mention goes to my family

especially my parents for their understanding and encouragement advice given during

the process of completing this project.

Thank you to my beloved families and all my friends for their helps and

cooperation in the form of advice, suggestion and support during the whole semester

especially in developing the application. All of their help are meaningful to me and

without their help I would faced many difficulties in order to complete the project.

Thank you and may Allah SWT grant you His blessing.

v

ABSTRACT

Drug identifier is created to equip parents and other adult caregivers with the

tools they need toward raising a generation who will remain free from the ravages of

drug abuse. Parent nowadays are too busy to make a research about what in their

children hands, so that their children can freely take the drug. Other than that, kids and

teenagers lack of knowledge about drugs. So that they just take and try it without

knowing what they are taking until they tasted and addicted to it. This application will

ease parent to detect the type of drug either it is not for medical purpose or else. 3D

modeling will be used to create the drug model and the information.

vi

ABSTRAK

Pengenal pasti dadah dicipta untuk melengkapkan ibu bapa dan penjaga

dewasa lain dengan alat yang mereka perlukan ke arah menaikkan generasi yang akan

kekal bebas daripada kemusnahan penyalahgunaan dadah. Ibu bapa pada masa kini

terlalu sibuk untuk membuat kajian tentang apa yang dilakukan anak-anak mereka,

supaya anak-anak mereka dapat mengambil ubat secara bebas. Selain itu, kanak-kanak

dan remaja kurang mengetahui tentang ubat-ubatan. Jadi mereka hanya mengambil

dan mencuba tanpa mengetahui apa yang mereka ambil sehingga mereka merasai dan

ketagih. Permohonan ini akan memudahkan ibu bapa mengesan jenis ubat sama ada ia

bukan untuk tujuan perubatan atau lain-lain. Pemodelan 3D akan digunakan untuk

membuat model dadah dan maklumat.

vii

TABLE OF CONTENT

Content Pages

DECLARATION ii

CONFIRMATION iii

DEDICATION iv

ABSTRACT v

ABSTRAK vi

TABLE OF CONTENT vii - ix

LIST OF TABLES x

LIST OF FIGURES xi

LIST OF ABBREVIATIONS xii

CHAPTER I - INTRODUCTION

1.1 Background 1

1.2 Problem Statement 2

1.3 Objective 3

1.4 Scope

1.4.1 User scope 4

1.4.2 Application scope 4

1.5 Limitation of Work 5

CHAPTER II - LITERATURE REVIEW

2.1 Introduction 6

viii

2.2 Summary 7-8

2.3 Conclusion 8

CHAPTER III - METHODOLOGY

3.1 Introduction 9

3.2 Analysis

3.2.1 Method 10-11

3.2.2 Framework 12

3.3 Design

3.3.1 Storyboard 13-14

3.3.2 Layout design 15

3.4 Development

3.4.1 Unity 16

3.4.2 Vuforia 17-18

3.4.3 Microsoft Visual Studio 19

3.5 Implement 20

3.6 Evaluation 20

CHAPTER IV - IMPLEMENTATION AND RESULT

4.1 Introduction 21

4.2 Implementation and Output 22-28

4.3 Testing

4.3.1 Test case for Main Menu 29

4.3.2 Test case for Info 30

ix

4.3.3 Test case for Drugs 30-31

4.3.4 Test case for Drugs (Ecstacy, ‘Pil Kuda’, Erimin 5,

Methadone, Kanabis, ‘Syabu’)

31

4.3.5 Test case for Agency 32

4.3.6 Test case for Agency (State) 32-33

4.3.7 Test case for Agency (Johor, Sabah, Sarawak,

Melaka, Wilayah Persekutuan, Kelantan, Perak,

Pahang, Selangor, Negeri Sembilan, Perlis,

Terengganu, Pulau Pinang, Kedah)

34

4.3.8 Test case for AR Scanner 34

4.3 Conclusion 35

CHAPTER V - CONCLUSION

5.1 Introduction 36

5.2 Project Contribution 37

5.3 Project Constrains and Limitation 37

5.4 Future Works 38

5.5 Conclusion 38

APPENDIX xiii - xiv

REFERENCES xv

x

LIST OF TABLES

Table Content Page

4.1 Test case for Main Menu 29

4.2 Test case for Info 30

4.3 Test case for Drugs 30-31

4.4 Test case for Drugs (Ecstacy, ‘Pil Kuda’,

Erimin 5, Methadone, Kanabis, ‘Syabu’)

31

4.5 Test case for Agency 32

4.6 Test case for Agency (State) 32-33

4.7 Test case for Agency (Johor, Sabah, Sarawak,

Melaka, Wilayah Persekutuan, Kelantan,

Perak, Pahang, Selangor, Negeri Sembilan,

Perlis, Terengganu, Pulau Pinang, Kedah)

34

4.8 Test case for AR Scanner 34

xi

LIST OF FIGURES

Figure Content Page

3.1 The method 11

3.2 The framework 12

3.3 The storyboard 13

3.4 Layout design 1 15

3.5 Layout design 2 15

3.6 Unity 16

3.7 Vuforia 17

3.8 License 18

3.9 Microsoft Visual Studio 19

4.1 Main Menu 22

4.2 Info 23

4.3 Type of drugs 24

4.4 Type of drugs (Ecstacy) 25

4.5 Agency 26

4.6 Agency (Johor) 27

4.7 AR scanner 28

xii

LIST OF ABBREVIATIONS

AR - Augmented reality

AADK - Agensi Anti-Dadah Kebangsaan

app - Application

GO - Government organization

NGO - Non-government organization

1

CHAPTER I

INTRODUCTION

1.1. Background

In this increasingly advanced age, the manufacture of illicit drugs is increasingly

creative by producing drugs in various forms of interest. This is a concern for many

because there have been many cases filed involving drug addiction by underage boys.

There are many unknown illicit drugs can be found in and most of the drugs cannot be

ascertained whether they are medicines or otherwise.

Many campaigns have been made by GO and NGO agencies in calling on people

to prevent and educate them about drugs. This is one of the steps in addressing this

problem. So, people need to work together in making this effort a success. However,

there are some constraints in this area which will be explained further in the next

section.

2

1.2. Problem Statement

Nowadays, people are too vulnerable to the illicit drugs including kids and

teenagers. There are many factors that caused them to be involved with drug

addiction, such as influence of friends, curiosity and there are also some who just want

to try but end up addicted. This project was inspired due to problems that have been

identified in the area of drug identification.

Among problems that has been acknowledge by most of publics are people know

that the form of drugs is general and not too complex so easy to identify. It can be a

mistake for people who are not knowledgeable about drugs because there are also

forms that resemble medicines.

People are also less knowledgeable about drugs to identify the drug themselves.

Lack of knowledge about drugs makes people relieve all the problems and is too

dependent on government and non-governmental organizations like AADK to solve

drug-related issues. This makes residential dwellers easily carry drugs into their

homes without the knowledge of their own residents.

Other than that, people don’t know the purpose of having pills or drugs. Drug

intake of recommended quantities can prevent side effects but most people do not

know the quantity set out in their intake. Furthermore, they do not know the side

effects of taking such drugs.

3

1.3. Objectives

Generally, the objective to develop this application is to make a revolution in drug

recognition. It may help and ease people in recognizing the pills. The objective is

divided into three steps which are to design, to implement and to test and evaluate.

First is to design an application that helps people to learn about some suspicious

pills either it is an illicit drug or a medicine by showing the information of the pill

such as the name, purpose, effect, etc. In order to be able to design, we need to do

some analysis. This project actually is to analyze the requirement, the technical and

the difficulties in order to come out with an appropriate application to identify the

drugs.

Next is to implement augmented reality method to find the specific information

about the drugs. It may ease people to recognize either the pill is an illicit drugs or a

medicine. Most applications available on the internet can only identify drugs by

including features such as imprint, color, shape, form and scoring. By applying

augmented reality in recognition, one should only place a pill or tablet above the

marker and scan it using a smart phone.

The latter is to evaluate and test the functionality of the proposed application in

real condition. This app will be available to the public for ratings and reviews.

Therefore, improvements can be made to meet the needs of users and can compete

with today's technological advances.

4

1.4. Scopes

The scopes for this project are identified and will be explained about the user who

will use this application and what function involved in this system. The scope of the

application is:

1.4.1. User scope

This application can be used by the public because no age limit is set. Through

this app, the general can learn and recognize drugs more easily without expecting

anti-drug agencies. In addition, this app is also the first step in identifying a pill

whether it is an illicit drug or not before a follow-up action such as a report to the

authorities is made. With this application, false reports or misunderstandings about

drugs can be avoided.

1.4.2. Application scope

This app will interact with users by displaying user requests. The app will

identify the pills and markers. If both match, the app will display the name of the

pill. This app is specially designed to identify illicit drugs only.

5

1.5. Limitation of Work

The limitation for this app is this app is only capable for solid drugs which are

pills and tablets form only. Other than that, this app is only showed the common drugs

listed by AADK. This app limited for android smartphone users and they don’t need

an internet connection to use this app.

6

CHAPTER II

LITERATURE REVIEW

2.1. Introduction

As you can find in the internet, there are plenty websites and applications for pill

identifier but none of them can identify the pill using augmented reality method. Most

of the websites and applications identify the pills by entering the criteria of the pill

such as the imprint, shape, color, form and scoring.

7

2.2. Summary

In 2015, Shengyu Liu, Buzhou Tang, Qingcai Chen and Xiaolong Wang have

make a research in Drug Name Recognition : Approaches and Resources. It is about to

recognize drug mentions in unstructured medical texts and classify them into pre-

defined categories. The strength is user can learn about the drug names. The weakness

is the input is text that needs to insert by the user.

Huaxiu Tang has made a research on Detecting Adverse Drugs Reactions in

Electronic Health Records by using the Food and Drugs Adverse Event Reporting

System on 2016. It is about to detect adverse drug reactions (ADRs) in Electronic

Health Records (EHR) by using the Food and Drug Administration’s (FDA) Adverse

Event Reporting System (FAERS). The strength is performance of ADR identification

is better with the use of FDA ADE reports. The weakness is it is not a mobile

application.

Other than that, in 2017, Joseph S. Marilo made a research on Image-Based

Augmented Reality : Reinforcing learning in Medical School Education. It is about to

create image-based augmented reality experiences for medical students enrolled in

The Expanding Osteopathic Concept (EOC). The strength is AR experiences were

embedded in specific sections of this workbook. The weakness is limitations of image

stabilization and device compatibility.

Yuen Fei Wong, Hoi Ting Ng, Kit Yee Leung, Kan Yan Chan, Sau Yi Chan, Chen

Change Loy made a research about Development of fine-graining Pill Identification

Algorithm using Deep Convolution Network in 2017. It is about to develop

groundwork for automatic pill identification and verification using Deep

8

Convolutional Network (DCN). The strength is achieving high accuracy despite

suboptimal image quality. The weakness is the system is not a mobile application.

In 2018, Martin Ingeson has done some research in Long-Term Experience

Applications for Augmented Reality – In a Medication Adherence Scenario. It is

about to explore how long-term experience applications (LTEAs) can be designed and

implemented for augmented reality (AR)-headsets. The strength is user can experience

live medication coach. The weakness is it implement in a headset.

2.3. Conclusion

Based on the studies, AR method was founded as the most suitable method to be

used in recognition because it is more interactive. Furthermore, AR technology is one

of the growing technologies of today and has been widely used in various fields such

as medicine, education, etc. Therefore, it is appropriate to apply the use of AR in drug

identification.

9

CHAPTER III

METHODOLOGY

3.1. Introduction

This chapter focuses on methodology used in this project development. It is

important to choose a perfect methodology in developing an application because it

will concentrate to a better development and management. The methodology used to

develop this application is ADDIE, which is analysis, design, develop, implement and

evaluate. The selection of this methodology is based on the observation of the

requirements in the development of the system and its suitability. The methodology

used to develop this application will be explained more in the next section.

10

3.2. Analysis

In this section will be explained about the methods and framework to be used in

developing this application. The selected methods and frameworks are based on

observation and analysis of existing apps and websites related to pill recognition.

3.2.1. Method

The method used in this app is marker-based AR. Image recognition is an

imperative component of augmented reality systems. By use of identifying visual

markers already embedded within the system, physical world objects are detected

for superimposition of virtual elements. In order for an AR application to estimate

the orientation and position of a camera with respect to the real world frame, most

applications employ a tracking technique known as marker based augmented

reality. It will call the distinctive picture that can be recognized by the device. A

marker can be anything, as long as it has enough unique visual points.

11

Figure 3.1 shows the method for this project

12

3.2.2. Framework

Framework illustrates the flow of the application. User need to place the pill or

tablet on the marker provided and then scan it using AR-DI app. The app will

identify the marker's density with the pill in the system database. If the markers

and pills match, the system will display the name of the pill and there will be a

button to go to the next page if the user wants to know more about the pill.

Figure 3.2 shows the framework for this project

13

3.3. Design

The process of creating a design interface for this application will be described in

this section. In the storyboard will be explained about the functions of the buttons

contained in the application. Layout design will also display an overview of the

application interface.

3.3.1. Storyboard

The figure below is a rough overview of the interface for this AR-DI app. The

homepage will contain 5 main buttons namely drugs, scans, agencies, info, and

exit.

Figure 3.3 shows the storyboard for this project

14

The Drugs button will connect to the site where it will explain about the drug.

In that case, users can know more about the type of drugs, shapes, colors, etc. All

listed drug information is a drug listed by AADK. New drugs not reported to

AADK will not be listed.

The Scan button will link to AR. In this case, AR application will be used to

identify the drug. If the drug can be identified, the drug name will be displayed

and there will be a button that will link to the drug page. In this case, a search

engine will be applied to find the type of drug that matches the scanned drug.

The Agency button will bring users to a page containing a list of AADK for

every state in Malaysia. Information such as agency name, address and contact

will be listed here. This site is created to make it easier for users to get any info or

help on drugs.

The Info button links to the page where will be introduced about the drugs.

This introduction page is created for user to learn about the general information of

drugs and to understand what is the purpose on have drugs according to doctor’s

proposition.

The Exit button will get the user exit from the app. This button is specially

designed to make sure that the user can exit the app properly.

15

3.3.2. Layout Design

The figure below is an overview of the application that will be created

including a button that will link to the relevant sites. The app will be created

according to the user's suit for easy use.

Figure 3.4: Layout 1 Figure 3.5: Layout 2

16

3.4. Develop

In this section will be explained about the development process of this application.

There are three software used in the development of this app; Vuforia, Unity, and

Microsoft Visual Studio.

3.4.1. Unity

Unity3D is a commercially available multiplatform game engine used for the

production of 2D and 3D video games as well as non-game interactive simulations

and visualizations. Unity is one of the most popular game engines available due to

its combination of power, flexibility, and ease of use.

In this project, Unity is used to insert an AR element into the application. The

marker will be downloaded from the Vuforia database package and the camera

that will be used is a vuforia camera.

Figure 3.6 : Unity

17

3.4.2. Vuforia

Vuforia is an augmented reality software development kit (SDK) for mobile

devices that enables the creation of augmented reality applications. It uses

computer vision technology to recognize and track planar images (Image Targets)

and simple 3D objects, such as boxes, in real time.

The marker will be uploaded into the Vuforia database and then the database

package will be downloaded and installed into the Unity project.

Figure 3.7 : Vuforia

18

This image registration capability enables developers to position and

orient virtual objects, such as 3D models and other media, in relation to real world

images when they are viewed through the camera of a mobile device.

Figure 3.8 : License

19

3.4.3. Microsoft Visual Studio

Microsoft Visual Studio is an integrated development environment (IDE)

from Microsoft. It is used to develop computer programs, as well as websites, web

apps, web services and mobile apps. Visual Studio uses Microsoft software

development platforms such as Windows API, Windows Forms, Windows

Presentation Foundation, Windows Store and Microsoft Silverlight. It can produce

both native code and managed code. For programming, the programming language

used is C #.

Figure 3.9 : Microsoft Visual Studio

20

3.5. Implement

In this section, all the work done in the development process will be combined to

make it a complete application. Application usability will be tested and improvements

will be implemented.

3.6. Evaluate

After tested usability application, application will be launched for general use.

Feedback received will be taken and considered. The enhancement will also be done

according to the suitability to meet the user demand.

21

CHAPTER IV

IMPLEMENTATION AND RESULT

4.1. Introduction

This chapter covers the implementation and unit testing of AR-DI. Implementation

and unit testing are done just to make sure that the app works according to the

specification that has been made in the previous chapter. Also, these steps taken are to

ensure that AR-DI has met the standard before user can utilize it.

22

4.2. Implementation and Output

Implementation is the process where the physical app design is built and ensures

that the system is functioning as it should be.

Figure 4.1 shows the main menu interface design. There is no instruction needed

as the app is very easy to use. User can click at five buttons shown to get to the related

page.

Figure 4.1 : Main Menu

23

Figure 4.2 below shows the Info page interface. In this page, user will learn the

meaning of drug. There are two functional button in this page; back and home button.

User can click at the button to get to the previous page or to get to main menu page.

Figure 4.2 : Info

24

Figure 4.3 shows the interface design for Drugs page. There eight functional button

available that user can use to get to the related page. User can click at the picture in

this page and it will bring the user to the next page which is the page of drug’s type

selected.

Figure 4.3 : Type of drugs

25

Figure 4.4 show one of the type of drug page interface. In this page user can

learn about the drug. Same like Info page, there are two functional button in this page;

back and home button. Back button will get the user to the previous page which is the

Drug page.

Figure 4.4 : Type of drugs (Ecstacy)

26

The figure 4.5 shows the interface of Agency page. In this page, user can get

the information about the agency that related; in this case, I choose AADK because it

is more relevant to get direct to the right organization that the third-party organization.

There are three functional button; back, home and ‘Cawangan Negeri’.

Figure 4.5 : Agency

27

The figure below shows the interface of one of the State page. This page is

similar to the previous page (agency page) but the different is this page will show the

information about the agency for every state in Malaysia. Also same like Info and

Drug page, this page contain two functional button.

Figure 4.6 : Agency (Johor)

28

Figure 4.7 show the AR Scanner interface design. This is the main function for

this app. In this page, user can match the pill or tablet with the marker to find the

name for the drug. In this page, there are also have two functional button; back and

home button.

Figure 4.7 : AR scanner

29

4.3. Testing

Testing analysis is performed to get result for each test. This is to ensure that the

app has met the requirements and specification that have been stated before. Test used

is test case. Test conducted to make sure that the app functions as it should be.

Test case is executing action on particular features or functions of the system. This

test conducted to make sure that those functions in the system work accordingly to its

requirement.

4.3.1. Test case for Main Menu

Table 4.1 : Test case for Main Menu

Button Button Name Expected Result Outcome

Info Go to info page Success

Drugs Go to drugs page Success

Agency Go to agency page Success

AR Scanner Go to AR scanner page Success

Exit Exit the app Success

30

4.3.2. Test case for Info

Table 4.2 : Test case for Info

4.3.3. Test case for Drugs

Button Button Name Expected Result Outcome

Back Go to previous page (main menu) Success

Home Go to main menu page Success

Button Button Name Expected Result Outcome

Back Go to previous page (main menu) Success

Home Go to main menu page Success

Ecstacy Go to ecstacy page Success

‘Pil kuda’ Go to ‘pil kuda’ page Success

Erimin 5 Go to erimin 5 page Success

Methadone Go to methadone page Success

31

Table 4.3 : Test case for Drug

4.3.4. Test case for Drugs (Ecstacy, ‘Pil Kuda’, Erimin 5, Methadone,

Kanabis, ‘Syabu’)

Table 4.4 : Test case for Drugs (Type of drugs)

Kanabis Go to kanabis page Success

‘Syabu’ Go to ‘syabu’ page Success

Button Button Name Expected Result Outcome

Back Go to previous page (drug) Success

Home Go to main menu page Success

32

4.3.5. Test case for Agency

Table 4.5 : Test case for Agency

4.3.6. Test case for Agency (State)

Button Button Name Expected Result Outcome

Back Go to previous page (main menu) Success

Home Go to main menu page Success

State Go to state page Success

Button Button Name Expected Result Outcome

Back Go to previous page (agency) Success

Home Go to main menu page Success

Johor Go to Johor page Success

Sabah Go to Sabah page Success

Sarawak Go to Sarawak page Success

33

Table 4.6 : Test case for Agency (State)

Melaka Go to Melaka page Success

Wilayah

Persekutuan Go to Wilayah Persekutuan page Success

Kelantan Go to Kelantan page Success

Perak Go to Perak page Success

Pahang Go to Pahang page Success

Selangor Go to Selangor page Success

Negeri

Sembilan Go to Negeri Sembilan page Success

Perlis Go to Perlis page Success

Terengganu Go to Terengganu page Success

Pulau Pinang Go to Pulau Pinang page Success

Kedah Go to Kedah page Success

34

4.3.7. Test case for Agency (Johor, Sabah, Sarawak, Melaka, Wilayah

Persekutuan, Kelantan, Perak, Pahang, Selangor, Negeri

Sembilan, Perlis, Terengganu, Pulau Pinang, Kedah)

Table 4.7 : Test case for Agency (Johor, Sabah, Sarawak, Melaka, Wilayah

Persekutuan, Kelantan, Perak, Pahang, Selangor, Negeri Sembilan, Perlis,

Terengganu, Pulau Pinang, Kedah)

4.3.8. Test case for AR Scanner

Table 4.8 : Test case for AR Scanner

Button Button Name Expected Result Outcome

Back Go to previous page (state) Success

Home Go to main menu page Success

Button Button Name Expected Result Outcome

Back Go to previous page (main menu) Success

Home Go to main menu page Success

35

4.4. Conclusion

The conclusion here is AR-DI app is fully functional and ready to be used by the

public. Every buttons and every page have been tested and checked to make sure that

the app is working properly according to the specification required. This app also has

been test to make sure that is it user friendly and easy to use.

36

CHAPTER V

CONCLUSION

5.1. Introduction

In this chapter will be discussing about the overall project contribution, constrain

and other possible improvements of AR-DI.

37

5.2. Project Contribution

Augmented Reality for Drug Identifier (AR-DI) is developed to help people

finding the answer for their curiosity about the unknown pills or tablets. By scanning

the pill or tablet using this app, people will get to know the name and type of the pill

or tablet. It also helps people to learn more about drugs listed by AADK in easiest and

fastest way from nowadays technology.

Augmented reality (AR) is applied in image detection which it was the main

function in this app. The result for the image detection will be the name of the drug

that been scanned by the user. I can say that this app has successfully developed and

met the objective stated in Chapter I.

5.3. Project Constrains and Limitation

Throughout the development of this project, there are a few obstacles and

difficulties happened. After the implementation of AR function, the marker cannot be

detected so that the result is not show up. There also some changes on the design of

the app to make it look better, more attractive and easy to use. A lot of changes have

been made to make sure that the app fully functional before the deadline.

38

5.4. Future Works

For upcoming upgrades for this app, a lot more future will be added such as search

engine, direct link to contact the agency and many more. Few algorithms will be used

for image detection to be more effective on detecting the drugs. Also it will be a

marker-less AR to ease people not to bring the marker everywhere.

5.5. Conclusion

As conclusion, the user for Augmented Reality for Drug Identifier (AR-DI) app is

public. This app may be the great platform for public to learn about suspicious drugs

and gain knowledge about the drugs because this app is user friendly, easy to use, fast

respond and full of information needed.

APPENDIX FYP1

Activity Milestone Weeks

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Project Title proposal Abstract about project.

Proposal writing - Introduction

Project background, problem

statement, objective, scope and

limitation of work.

Proposal writing – Literature

review Do research from previous work.

Proposal progress - Presentation

& Evaluation Present the proposal.

Discussion & Correction proposal Discuss with supervisor and make

correction for the project.

Proposed solution - Methodology

Proof of Concept

Drafting report of proposal Contain introduction, literature

review and methodology.

Submit Draft of report to

supervisor Submit for checking.

Preparation for Seminar

Presentation

Seminar Presentation With the apps simulation

Final Report Submission Full project report

APPENDIX FYP2

Activity Milestone Weeks

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Project meeting with Supervisor Discussing about the project.

Project development Starts develop the project.

Proposal progress - Presentation

& Evaluation Present the proposal.

Project development (continued) Continue the development of the

project.

Project testing Discuss with supervisor and make

correction for the project.

Submit draft Report and

Documentation of the Project

Submit draft report to supervisor

for checking.

Seminar presentation Present the fully functional

project.

Discussion & Correction Report Discuss with supervisor and make

correction for the project’s report.

Final Thesis Submission Full project report submission.

xv

REFERENCES

[1] Shengyu Liu, Buzhou Tang, Qingcai Chen, Xiaolong Wang (November 2015).

Drug Name Recognition: Approaches and Resources. Retrieve from

https://www.researchgate.net/publication/284765165_Drug_Name_Recognition_Appr

oaches_and_Resources

[2] Huaxiu Tang (July 2016). Detecting Adverse Drugs Reactions in Electronic

Health Records by using the Food and Drugs Adverse Event Reporting System.

Retrieve from

https://etd.ohiolink.edu/pg_10?0::NO:10:P10_ACCESSION_NUM:ucin1470753258

[3] Yuen Fei Wong, Hoi Ting Ng, Kit Yee Leung, Kan Yan Chan, Sau Yi Chan,

Chen Change Loy (April 2017). Development of fine-graining Pill Identification

Algorithm using Deep Convolution Network. Retrieve from

https://www.ncbi.nlm.nih.gov/pubmed/28923366

[4] Joseph S. Marilo (Spring 2017). Image-Based Augmented Reality:

Reinforcing learning in Medical School Education. Retrieve from

http://broncoscholar.library.cpp.edu/handle/10211.3/194695

[5] Martin Ingeson (June 2018). Long-Term Experience Applications for

Augmented Reality – In a Medication Adherence Scenario. Retrieve from

http://umu.diva-portal.org/smash/record.jsf?pid=diva2%3A1223912&dswid=-4034

[6] Referenced from https://visualstudio.microsoft.com/

[7] Referenced from https://www.ptc.com/en/resources/iot/product-brief/vuforia-

studio

[8] Referenced from https://unity3d.com/learn/tutorials/s/scripting