HERBS DICTIONARY WITH

AUGEMENTED REALITY

MUHAMMAD AIMAN BIN ABD GHANI

BACHELOR OF INFORMATION TECHNOLOGY

(INFORMATIC MEDIA) WITH HONOURS

UNIVERSITI SULTAN ZAINAL ABIDIN

2018

ii

DECLARATION

I hereby declare that this report is based on my original work except for quotations

and citations, which have been duly acknowledged. I also declare that it has not been

previously or concurrently submitted for any other degree at Universiti Sultan Zainal

Abidin or other institutions.

________________________________

Name : Muhammad Aiman Bin Abd Ghani

Date : 23 December 2018

iii

CONFIRMATION

This is to confirm that:

The research conducted and the writing of this report was under my supervision.

________________________________

Name :Pn. Rohana Binti Ismail

Tarikh : 23 December 2018

iv

DEDICATION

In the Name of Allah, the Most Gracious and the Most Merciful.

Alhamdulillah, I thank God for His grace and grace, I can prepare and

complete this report successfully.

First of all, I would like to thank my supervisor, Pn. Rohana Binti Ismail

because with guidance, the advice and the thoughtful ideas given g me the opportunity

to prepare this report successfully.

In addition, my gratitude is also to my colleagues who share ideas, opinions,

knowledge and reminders. They helped me answer every question that was important

to me in completing this report.

Thanks also to my beloved mother and father always encouraged me and

motivated me to prepare for this report.

I would like to take the opportunity to thank all lecturers of the Informatics and

Computing Faculty for their attention, guidance, and advice in helping and sharing

ideas and opinions in making this report successful.

May Allah SWT bless to all the efforts that have been given in completing this

report.

Thank you.

v

ABSTRACT

Herbs Dictionary with Augmented Reality has been developed for students and

lecturers to manage learning more efficiently. Existing learning methods are more

efficient. Existing learning methods changed by AR technology and using

smartphones. This app may be able to help students learn more interesting and

engaging object types. In addition, this app uses interactive 3-dimensional objects,

sound and display information for students interested in using this app. The ADDIE

method is divided into five main parts, namely the beginning of the analysis phase, the

design phase, the development phase, the implementation phase and the evaluation

phase. The use of the ADDIE method ensures the smooth development of the system

and according to planning.

vi

TABLE OF CONTENT

PAGE

DECLARATION ii

CONFIRMATION iii

DEDICATION iv

ABSTRACT v

CONTENTS

LIST OF TABLES

vi

viii

LIST OF FIGURES ix

CHAPTER I INTRODUCTION

1.1 Introduction 1

1.2 Background 1

1.3 Problement Statement 3

1.4 Objectives 4

1.5

1.6

Scopes

Activities, Milestone (Gantt Chart)

4

5

1.7 Limitation of work 6

1.8 Expected Result 6

1.9 Conclusion 6

CHAPTER II LITERATURE REVIEW

2.1 Introduction 7

2.2 Related Product 8

2.2.1 Kamus Bergambar Bestari AR 3D 8

2.2.2 Herbs List 9

2.2.3 Culpeper’s Herbal 10

2.3 Comparison table of the existing product with

5 element of multimedia

11

2.4 Comparison table of existing product 11

2.5 Conclusion 12

vii

CHAPTER III

METHODOLOGY

3.1 Introduction 13

3.2 Methodology Model 14

3.2.1 Analysis phase 15

3.2.2 Design phase 17

3.2.3 Development phase 21

3.2.4 Implementation phase 21

3.2.5 Evaluation phase 22

3.3 Hardware and Software Requirement 23

3.3.1 Hardware requirement 23

3.3.2 Software requirement 23

3.4 Conclusion 24

REFERENCE 25

viii

LIST OF TABLES

TABLE TITTLE PAGE

1.1 Gantt Chart 5

2.1 Comparison table of the existing products with 5 element

of multimedia

11

2.2

3.1

Comparision table of existing product

Comparison of AR picture dictionary applications and

existing herbs dictionary

11

15

ix

LIST OF FIGURES

FIGURE TITLE PAGE

2.1 Kamus Bergambar Bestari that using AR 3D 8

2.2 Herbs List 9

2.3 Culpeper’s Herbal 10

2.4 Kamus Bergambar Bestari AR 3D 10

3.1 ADDIE Model 14

3.2 Analysis Phases 16

3.3 Storyboard appllication 19

3.4 Storyboard book design 20

1

CHAPTER 1

INTRODUCTION

1.1 INTRODUCTION

This section is the introduction to the report for developed system. It will provide a basic

overview of the whole system. This chapter presents about the project background, problem

statement objectives, scope and project planning. Background of the system discuss about basic

information about this system. Problem statements discuss about related issues of the system.

Objectives state all main goal of this system. The scope shows who are using the system and

what the user can do

1.2 BACKGROUND

Augmented Reality (AR) hasbeen an emerging technologies in these recent years. AR

defined as immersion of virtual environment to the real environment which it enriches the vision,

audition or even taste, touch and smell (Daponte, et al., 2014). The significant timeline of AR

technology begun from a cinematographer, Morton Heiling which he thought cinema should

enable interaction between a human and the environment covering all the senses (Daponte, et al.,

2014). The first AR Head Mounted Display was developed by Sutherland (Sutherland, 1968)

2

while the ability to interact with virtual objects was first introduced by Myron Krueger (Golan,

2006).

Nowadays, smartphones have the core features to develop an AR applications such as

camera, touch screen, Inertia Measurement Unit (IMU), internet access and so forth (Daponte, et

al., 2014). The advancement of smartphone technologies which enable real-time image

processing camera and powerful performance from built-in Central Processing Unit (CPU) and

Graphics Processing Unit (GPU) made basic AR application development easier without external

supporting device.

This new technology, called augmented reality is a combination of what's real and what's

computer-generated by enhancing what we see, hear and feel. Its combines real and virtual

images both can be seen at the same time. When compared to other reality technologies,

augmented reality lies in the middle of the mixed reality spectrum between the real world and the

virtual world. Furthermore, augmented reality is changing the way we view the world or at least

the way its users see the world. Additionally, augmented reality adds graphics, sounds and haptic

feedback to the natural world as it exists. In contrast to the synthetic environment rendered onto

a virtual reality (VR) system, an AR system augments the physical environment (as seen through

the camera lens) with a synthetic representation. Thus, the environments co-existing together can

be viewed as a hybrid environment–one completing the other, and vise versa.

3

Herbal Dictionary With Augmented Reality Enhanced using AR technology is an

interactive dictionary that uses new era technology to help people, especially students and

teachers as an interesting dictionary reference. This Herbal Dictionary With Augmented Reality

is specially created for students at secondary and university level as well as to teachers and

lecturers. In addition, Herbal Dictionary With Augmented Reality is focused on some herbs that

can be used for health and in medicine. Users need to scan the images of the herbs found in the

dictionary using their mobile phones. Then, the herbal pictures and their description will appear

on the phone automatically. Additionally, users can click on the audio button available to hear

the herb name's correctly.

1.3 PROBLEM STATEMENT

As we can see, people today are too open to the technology around them. Therefore, it

makes the book or dictionary no longer main focus as their reference material. In addition, books

or dictionaries that exist especially about herbs have only words and pictures, this makes the

reader feel bored because it unattractive. In addition, scientific names of herbs that are hard to

read cause readers do not know how to spell it properly .Beside, not many mobile apps provide

for herbs reference. Ultimately, the previous herbal dictionary is no longer the main reference for

people especially for students and teachers.

4

1.4 OJECTIVE

The objectives of the Herbal Dictionary With Augmented Reality are:

1. To study the AR technology to be used in Herbs Dictionary With Augmented Reality.

2. To design and develop Herbs Dictionary that enable users can learning with augmented

reality.

3. To evaluate function augmented reality of Herbs Dictionary.

1.5 SCOPE

The main scopes of the system:

1. Admin

The admin can use this interactive dictionary to make a maintenance on the application and

update a new version. Next, the admin also needs to look the responses to the feedback which

comes from the users.

2. User (Students)

This interactive dictionary is invented especially for student on school and university.

Students can use this Herbs Dictionary with AR as reference about herbs in an interesting

way.

5

1.6 ACTIVITIES, MILESTONE (GANTT CHART)

Task name

SEPTEMBER OCTOBER NOVEMBER DECEMBER

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Topic Discussion and

Determination

Project Title Proposal

Proposal writing

Proposal writing –Literature

Review

Proposal Progress

Presentation & Evaluation

Discussion

Correction Proposal

Proposed Solution

Methodology

Proof of Concept

Drafting Report of the

Proposal

Submit draft of report to

supervisor

Seminar Presentation

Correction Report

Final Report Submission

6

1.7 LIMITATION OF WORK

There are several limitations and constraint that occurred throughout the development of this

interactive flashcard. These problems and limitations in conducting this study are:

1. The user can use Herbs Dictionary With Augmented Reality using mobile phone only.

2. This Herbs Dictionary With Augmented Reality is build only for android version.

3. This Herbs Dictionary With Augmented Reality is developed exclusively for Herbs

that can use in medicine only.

1.8 EXPECTED RESULT

At the end of this project, the expected result following the development of the proposed project

is as follows:

1. The user will be able to gain herbs knowledge with the AR support.

2. System will be function after developed.

1.9 CONCLUSION

With the technological advances of today’s increasingly fast-growing, it is hoped that this

project will help to learn for a student to get gain knowledge. I hope this picture dictionary can

get more published in markets shop.

7

CHAPTER 2

LITERATURE REVIEW

2.1 INTRODUCTION

Augmented reality is a combination of what's real and what's computer-generated by

enhancing what we see, hear, feel and smell. Its combines real and virtual images both can be

seen at the same time. When compared to other reality technologies, augmented reality lies in the

middle of the mixed reality spectrum between the real world and the virtual world. Furthermore,

augmented reality is changing the way we view the world or at least the way its users see the

world. Additionally, augmented reality adds graphics, sounds and haptic feedback to the natural

world as it exists.

This chapter will focus on literature study of related works from other researcher. This

helped to generate ideas on how to carry out this project with reference to researchers’ study.

Then will be comparing existing augmented reality and herbs Dictionary.

https://www.realitytechnologies.com/mixed-reality#sec2

8

2.2 RELATED PRODUCTS

2.2.1 Kamus Bergambar Bestari AR 3D

Figure 2.1 : Kamus Bergambar Bestari that using AR 3D Technology

This dictionary can enhance the mastery of the three-language vocabulary (BM-BI-BA)

as well as advanced jawi texts according to the latest spelling. Preschoolers and primary schools,

teaching staff or parents can use this dictionary as a complete supplementary reference as it

relates to the current learning process. The index along with the page number is provided as the

fastest reference to find the desired entry without having to flip the sheet on the sheet. Beside

that, this dictionary also have Illustration and colorful picture, clear and interesting for kids. It

consists of 16 major themes covering daily themes and there is an Augmented Reality (AR) for

the selected entries.

9

2.2.2 Herbs List

Figure 2.2: Herbs List

This Herbs List Dictionary focus on herbs that can be used for health and medicine only. This

dictionary contains information on herbs that are very comprehensive where it has a very clear

scientific name, common name, type of herb family, part used, habitat and description of the

herb and the warning that the reader should know. But unfortunately it does not have the pictures

of the herbs, so it difficult for people to identify the types of herbs contained in this dictionary.

10

2.2.3 Culpeper’s Herbal

Figure 2.3: Culpeper’s Herbal

Culpeper's Herbal book is a very popular herbal reference book. This is because the book is

written by a very popular herbalist named Nicholas Culpeper who lives in Spitalfields. The

Culpeper herb has been continuously printed since he published it in the seventeenth century. In

Culpeper's Herbal book there are 456 types of herbs and herbal names. However, he has no

detailed description of the herbs. It makes hard for people to know the advantages and uses of the

herb.

11

2.3 COMPARISON TABLE OF THE EXISTING PRODUCTS WITH 5 ELEMENT

OF MULTIMEDIA

Title text image video audio animation

Kamus Bergambar Bestari -

Herbs List - - - -

Culpeper’s Herbal - - - -

2.4 COMPARISON TABLE OF EXISTING PRODUCT

Product Platform function Method Advantage Drawback

Kamus

Bergambar

Bestari

Android /IOS

phone

Creative learning

with 3D

Augmented

Reality.

Marker based

method

The pictures are brightly coloured

Versatile and multi-functional

No specific topic

Herbs List Book Reference - Have detail description about

herbs

Don’t have herbs

picture

Culpeper’s

Herbal Book Reference - Have a lot of

herbs picture

Don’t have details and description about

herbs

12

2.5 CONCLUSION

In this whole chapter, this chapter discusses a product that uses a picture dictionary to

develop an augmented reality. This chapter also discussed the technique used in the new system

and the technique used in the previous research articles and journal. The comparison with the

previous research is done so that the right choice will be selected. The weaknesses of the three

product are solved in this project.

13

CHAPTER 3

METHODOLOGY

3.1 INTRODUCTION

In this chapter, will talk about methodology and the process of developing “Herbs Dictionary

With Augmented Reality”. By the way, the methodology that has been used to develop this

interactive flashcards is described. The methodology will guide the system to solve the problem

smoothly and complete the project within the given time. There are many types of methodology

that can be applied and used in the development of AR technology. The approach must be

chosen correctly for the project. It is important to guide the researcher to manage the given task.

Hence, the ADDIE model is used for this project. Furthermore, every details about each phase

that involve in the development of this project will be explained later in this chapter. Beside that

also rates this chapter describes the software and hardware requirement that will be used for

development process.

14

3.2 METHODOLOGY MODEL

It is important to know and understand the ADDIE model if a developer want to develop

a successful project. The ADDIE model is the generic process traditionally used by instructional

designers and training developers. The five phases are Analysis, Design, Development,

Implementation, and Evaluation. ADDIE is an extremely effective tool in training development

that addresses instruction. Therefore, the ADDIE model could be quite helpful for many in

planning a course of action that would lead to the successful implementation of a project. When

dealing with projects that involve instruction or steps, the approach fits nicely.

In order to ensure effective learning outcomes from augmented reality (AR) education

development, careful planning are required before the development process begins. ADDIE

Instructional Design Model is used in this mobile AR application development methodology.

The ADDIE model for instructional system design (ISD) is a basic model that can be applied to

any kind of learning solution. The ADDIE model has five steps processes as illustrated in the

Picture 3.2.

Figure 3.1 : ADDIE Model

ANALYSIS

DESIGN

DEVELOPMENT

IMPLEMENTATION

EVALUATION

15

3.2.1) Analysis Phase

In this phase, an analysis has been done to identify the need to develop the Herbs

Dictionary With AR. The analysis phase involves requirement analysis, task analysis and

teaching analysis. Activities involving identifying problem statements, goals and goals of mobile

AR applications to be developed, student needs, existing knowledge and any other relevant

features and content of AR mobile applications. Mobile AR applications are developed by

focusing on herbal content that can be used in specialized health for students and lecturer

references. This analysis is also done by making a research on the application of the AR picture

dictionary and the existing herbs dictionary. Through analysis, the weakness of the dictionary

and existing product can be identified. Comparison of AR picture dictionary applications and

existing herbs dictionary as illustrated in Table 3.1. All the information collected is used to

develop goals and objectives for developing mobile AR applications. Software and hardware

requirements are also specified in this phase. The flow analysis phase is shown in Picture 3.2.1.2.

EXISTING

PRODUCT

MEDIUM AUGMENTED

REALITY

CONTENT WEAKNESS

Kamus

Bergambar

Bestari

Mobile App Yes colorful picture -

Herbs List Book No Detail about

Hebrs

No Herbs

Picture

Culpeper’s

Herbal

Book No Picture of Hebrs No Herbs

Description

Table 3.1

16

Figure 3.2

Analysis Problem

Statement

Objective

Target User

Content

Strategy

Requirement

1) The existing dictionary is unattractive

2) Nott many mobile apps provide for Herbs

Reference

1) To approve AR method for learning

2) To attract more user to learn about herbs

1) Student

2) Lecturer

1) Herbs Picture and Description

1) Use Augemented Reality

Software :

1) Unity 3D

2) Adobe Illustrator

3) Adobe Photoshop

Hardware :

1) Laptop

17

3.2.2) Design Phase

The Design phase endeavors to identify specific learning objectives, topic content, presentation

methods and media, learner exercises and assessment criteria to be used. During the design

phase, the information gathered during the analysis phase is reviewed and compiled to build the

project. In design phase, flowchart and storyboard were developed.

Flowchart

Start

Home Page

SCAN

EXIT

Herbs

Picture &

Description

Choose Herbs

Herbs

Dictionary

Choose Audio

Scientific

Name of

Herbs

End

Yes

Yes

Yes

Yes

Yes

No

18

Figure 3.3 Storyboard Application

Code 01

Title Home page

Code 02

Title Help page

Description:

A: Button - Help

B: Apps logo

C: Button- Scan

D: Button- Exit

A

B

Herbs

Dictionary

Logo

C

D

B

A

Description:

A: Button - Home

B: Help information

19

Code 03

Title Before scan page

Code 04

Title After scan page

A

D

C

B

Description:

A: Button - Help

B: Button -Home

C: Scan

D: Button- Scan

C

Herbs

Picture

D

Description of

Herbs

A

E

B

F

Description:

A: Button - Help

B: Button – Home page

C: Herbs Picture

D:Herbs Description

E: Button – Audio

F: Button - Back

20

Figure 3.4 Storyboard Book Design

Code 05

Title Book page

A

Herbs

Picture

A

Herbs

Picture

A

Herbs

Picture

A

Herbs

Picture

B B

B B

Description:

A: Herbs Picture

B: Herbs Name

21

3.2.3) Develop phase

Development is the third phase of the training planning process. During the development phase,

the actual course materials are created. A successful development phase uses the information

collected in the analysis phase and the decisions made in the design phase.

3.2.4) Implement phase

The Implementation phase refers to the actual delivery of the instruction, whether it's classroom-

based, lab-based, or computer-based. The purpose of this phase is the effective and efficient

delivery of instruction. This phase must promote the students 'understanding of material, support

the students' mastery of objectives, and ensure the students' transfer of knowledge from the

instructional setting to the job.

i) Test Run Project

The developer test runs the project herself. This is to ensure that the project can be used

and is running accordingly.

ii) User Test Run

Developer give to the user to test the project and give the feedback before the presenting

the final product. Criticisms and constructive feedback is taken to be implemented later

on.

22

3.2.5) Evaluate phase

This phase consists of formative and summative evaluation. Formative evaluation is present in

each stage of the ADDIE process. Summative evaluation consists of tests designed for criterion-

related referenced items and providing opportunities for feedback from the users. Revisions are

made as necessary. Rapid prototyping (continual feedback) has sometimes been cited as as a way

to improve the generic ADDIE model.

23

3.3 HARDWARE AND SOFTWARE REQUIREMENTS

This section will show that the all hardware and software that involve in the development

process. All of these elements are important in the process of development of the system. List

of hardware and software are shown as below:

3.3.1 Hardware requirement

i. Laptop ACER

• To create the sketches for the characters, background and create scripts or documents

related to “Mercy”. Also used for on the go coding and 3D modelling.

• Processor : Intel Core i5-2450M CPU @ 2.50GHz

• Operating System : Windows 10 Pro – 64 bit

• Memory : 8GB RAM

ii. WACOM Tablet

• For drawing and digital painting on the Laptop or PC. Also used to design

merchandise.

iii. Pen drive

• To store the backup file

• Storage : 32GB

iv. Printer Canon MP287

• To print out the documentation

• To print picture dictionary

vi. Android Mobile Phone: Huawei nova 2 lite

• Used to run and testing the application

24

3.3.2 Software requirement

i.Unity3D

• Used to create the Virtual Reality app and overall project and modelling 3D object

ii. Autodesk Maya

• Used to create 3D character models

iii. Vuforia

• To create augmented reality

• Detects and tracks the features of images. For best result, aim for target with 4 or 5 stars

3.4 CONCLUSION

Methodology is very important in a system development. It helps to make sure the system

develop correctly from phases to phases. In this system, ADDIE Model had been chosen as a

guide to build system. It also helps to ensure all the objectives can be achieved. Besides, this

chapter also explains the hardware and software requirements for this system.

25

REFERENCE

1. Nicholas Culpeper’s. (1998). Culpeper’s English Physician & Complete Herbal. 4

Stationer’s Court: C. Stalker Publications.

2. Miranda & Bill Barros. (2008). Healing Herbs and Medicinal Plants List. Nottingham:

Delectable Publications.

3. Alan B. Craig. (2007). Understanding Augmented Reality Concepts and Application.

United State of America: Library of Congress Cataloging in Publication Data.