BY TEMTIM ASSEFA

REVISED SEPTEMBER, 2013

Research Methods for Computer Science,

HILCO

Learning Objectives

Explain the purpose of researchUnderstand basic concepts in research

(constructs, relationship, indicators, research model, theory, etc)

Understand research as a scientific method to acquire knowledge

Acquire skill to formulate researchable research problems

Identify major research problems in computer engineering

Explain the different research approaches and methods (Quantitative, qualitative and design science)

Objective …

Justify the rational for selecting a particular research method to solve computer Science problems

Able to design research projects or research proposal

Able to collect data relevant to the research problem

Undertake validity and reliability tests of research instruments

Objective …Able to interpret data into meaningful

informationAcquire skill to plan, execute, and

implement research projects in computer science

Able to review research articles Able to produce publishable research

articles (conference or journals, etc) Contribute new knowledge to your

discipline

Meaning, objective and Overview of research

What Research Is Not

Gathering information from resources such books or magazines isn’t a research.

It has no contribution to new knowledge.Merely transporting facts from one resource to

another doesn’t constitute research.It has no contribution to new knowledge,

although this might make existing knowledge more accessible.

Research is not

Research is not simply learning about something Gathering information to know more about

a certain area is different from looking at a body of data and deciding how it contributes to the solution of a problem

Research problems do not simply result in a “yes” or a “no” answer Should able to explain why something is

happened - e.g computer increases organizational efficiency but add how ?

Research: A Definition

“…the systematic process of collecting and analyzing information (data) in order to increase our understanding of the phenomenon about which we are concerned or interested.”

an activity that contributes to the understanding of a phenomenon [Kuhn, 1962; Lakatos, 1978]

Research ...

Research: phenomenon: a set of behaviors of some

entity(ies) that is found interesting by a research community

understanding: knowledge that allows prediction of the behavior of some aspect of the phenomenon

activities considered appropriate to the production of understanding (knowledge) are the research methods and techniques of a research community

Research Characteristics

1. Originates with a question or problem.2. Requires clear articulation of a goal or

objective.3. Follows a specific plan or procedure.4. Often divides main problem into sub-

problems.5. Guided by specific problem, question,

proposition or hypothesis.6. Accepts certain critical assumptions.7. Requires collection and interpretation of

data.8. Cyclical (helical) in nature.

Types of Research

1. Basic Research its main purpose is the disclosure of fundamental

truths or principles Focuses the testing and development of theory To extend existing human understanding Has no immediate application to real world problems

Example - Physists are interested in understanding basic

elements that make up matter Computer scientist are interested to create an efficient

algorithm to process data, retrieve information, etc

Cont’d

2. Applied research To solve existing societal problems

Example - software automation like Developing a SW that convert word files into database format

Doing payroll processing by a computer

Developing a program that copys files from a computer to a mobile phone

BASIC CONCEPTS IN RESEARCH

Epistemology of Knowledge

is the branch of philosophy concerned with the nature and scope (limitations) of knowledge

It answers the following questions What is knowledge?How is knowledge acquired?To what extent is it possible for a

given subject or entity to be known?

Continued …

There is a debate between 1. Knowledge as objective Truth2. Knowledge as subjective truth

Objective Truth

Knowledge exists independent of the knower Knowledge can be measured by measuring

instrumentsObserved independent of the researcherCan be quantified using different statistical

methodsIt is constructed by deductive methods Research is targeted to falsify an existing

truth or theory

Knowledge is constructed mainly through observation and experience.

Aristotle is the main supporter of this view

Subjective truth

Knowledge is a human construct People born with some thought constructs

that are used to interprate and give meaning what we experience

It is the human that gives meaning to real world objects

It is a social construct and exits in the language, text, etc by the human being

Cont’d

Knowledge is constructed by reflection, interpretation what respondent says

The researcher is part of the knowledge construction process

It is constructed by inductive methodFrom observations, general truths are

drawnThere are as many truth as the there are a

number of human beings

Theory

An abstraction of realities that serve as a guide for future practice

You may think theory as an absolute truth, such as the theory of gravity or the theory of relativity

Actually a changing phenomenon, especially in the soft or social sciences. 

Theories are developed based on what is observed or experienced, often times in the real world. 

Changed as we gather new facts and observe new relationship

Theory -- Cont’d

Dubin (1978) notes theory contains three main elements: A set of well-defined concepts (or units); Laws of interaction (or interrelationships

between the units); A boundary within which the theory holds.

Example Theory of planned behavior Design theory Communication theory Human Computer Interaction theory (HCI), etc

Theory of Planned Behavior

Attitude

Subjective Norms

Intention Behavior

Controlling Variables

Source – Ajzen, 1991

Conceptual Framework

It is the researchers understanding of the Research Problem

It contains variables and their relationship to be investigated in the research

It serve as a guide for the research processIt is build from existing theory or prior

experience of the researcher It is accepted or modified after the collected

empirical data is analyzed and interpreted

Conceptual Framework – uses …

are analytical schemes; simplify reality to make it easer to discuss,

analyze or research; simplify reality by selecting certain

phenomena/variables and suggesting certainrelationships between them; are judged in terms or utility, not

correctness.

Types of Conceptual Framework

Cause and Effect – explanation …

seeing other people being rewarded for acting well (vicarious reward)

and punished for acting badly (vicarious punishment);

whether people believe they control their own destinies or are at the mercy of forces beyond their control (locus of control)

and their level of moral developmentincreases the likelihood that people will make

decisions that are ethical rather than pragmatic.

Type of CF … Stages in a Process

the concepts are related because they are stages in a process.

Example Project Management Problem 1. It starts with planning and 2. then proceeds through the stages of doing, 3. monitoring and 4. Revising the plan.Here the theory is represented as a circle that flows in a cycle. What about software development theory?

Type of CF … Hierarchical relationships

In many conceptual frameworks, concepts are related because they occupy higher or lower positions on a scale or in a hierarchy.

Example Maslow’s (1954) Need Hierarchy 1. physiological needs2. safety needs3. belongingness needs4. esteem needs5. self-actualisation.

Type of CF … Map and coordinates

You can define the relationships between concepts by plotting

them against a series of coordinates.

User requirement Elicitation Low High

SW T

estin

g

High SW success

Low SW success

Theory visa-vis Conceptual Framework

Conceptual frameworks provide generalisations about processes, about the interaction of the concepts,

whereas theories provide hypotheses about the outcomes of these processes.

A conceptual framework might identify persistence, graphical buttons, user experience, etc linked with good user interface design

Theory would show how these factors can increase use of the software by different groups of users

Proposition

Predictions about the world are made using propositions, that is, conclusions that may be deduced logically from the theory.

It establishes one construct with another construct

It guides the research process in data collection and data analysis

Used in qualitative research methods especially in case study research

Proposition … Example

Proposition #1 --- ERP implementation can be successful only if there is a strong and committed leadership guiding the initiative” (Sarker and Lee 2000, p416)

“Proposition #2 ----ERP implementation can be successful only if there is open and honest communication among the stakeholders” (Sarker and Lee 2000, p416)

“Proposition #3 --- ERP implementation can be successful only if the implementation team is empowered and balanced” (Sarker and Lee 2000

Hypothesis

A hypothesis is an empirically testable statement that is generated from a proposition

Hypothesis is a tentative solution forwarded by the researcher based on previous theory or experience

It is expressed in terms that support collection and analysis of empirical data

Terms used in the hypothesis are “things observable” (Dubin 1978)

One proposition may generate many hypotheses

Cont’d

Begins with theory to identify variables

Both hypothesis and research questions are used to guide the researcherTo collect what type of dataHow to analyze the collected

evidences

Hypothesis …

Example1. Graphical software interface increases SW

learnability.2. Cloud service reduces IT operation costs 3. Component based SW development increases SW

project successThe deductive testing of hypotheses involves

looking for disconfirming evidence to falsify hypotheses (Lee 1989).

Falsified hypotheses are then refined based on the reasons for falsification and subjected to further empirical testing.

Methodology

A methodology is “a system of principles, practices, and procedures applied to a specific branch of knowledge

A methodology might help researchers to produce and present high quality research results that is accepted as valuable, rigorous, and publishable in Computer Science research outlets.

Method is one component in the Methodology Data collection method like interview Data analysis method like open coding, correlation,

regression, etc Method of prototype system evaluation – how do you

evaluate it

Definitions of Terms

Define each technical term as it is used in relation to your research project. Resource – how is defined in the context of

library and computer system This helps remove significant ambiguity

from the research itself by ensuring that reviewers, while they may not agree with your definitions, at least know what you’re talking about.

.

Metrics in Research

Metrics are measures used to represent the variable

For example: a sex variable is measured by Male or

Female Attitude is measured by likearte scale

(Very strongly disagree <->Strongly Agree)

How do you measure CPU performance?Clearly state how you measure your

research variable

Scales of variable measurement

There are four measurement scales1. Nominal – which does not show

magnitude like male or famale2. Ordinal – which measure magnitude but

cannot quantify difference e.g poor and rich

3. Interval - measures magnitude and the difference between the two values

1. e.g age -- 10 years and 20 years4. Scale – measures which has vales below

zero e.g temperature

Know your Research Contributions

In what way(s) does your study add significant contribution(s) to: Extant Theory? Relevant Practice?

Free Access Journals

http://www.springer.com/computer/hci?SGWID=0-154-12-116377-0

http://ocw.mit.edu/courses/mathematics/18-996-topics-in-theoretical-computer-science-internet-research-problems-spring-2002/lecture-notes/