University of Cardiff

Brian LingsMay 2005

Research Methodology

Aim

To highlight the role of Research Methodology with regard to research planning, execution and research claims, for Computer Science postgraduates in UK universities.

Objectives

To consider the role of research methodology in developing a research proposal, and formulating and then defending a thesis statement

To consider practical aspects of the research process towards a PhD

Postgraduate Requirements (UK)

Original, significant contribution, knowledge of field, critical judgement, unified work

Contribution to learning, systematic study related to a body of knowledge

Research Methodology

Philosophy

Research Methodology

Research Process

underlies

guides

Scientific Method (Traditional)

1. observation and experiment2. inductive generalization3. hypothesis4. attempted verification of hypothesis5. proof or disproof6. knowledge

Scientific Method (Popper)

1. problem2. proposed solution (new theory)3. deduction of testable propositions4. tests: attempted refutations5. preference established between

competing theories6. knowledge

Qualitative Research Methods

1. identify phenomenon and context of interest

2. theoretical basis and methodology3. identify sample for research4. data collection5. data analysis and theory formulation6. knowledge in context

Research Project: initial questions

Which research community do you identify with and wish to contribute to?

What problem(s) have you identified with existing theories or techniques?

OR

What have you observed that is worthy of investigation?

A Good Research Project

tackles a significant issue of interest to the chosen research community

is related to other work and offers scope for originality, but can be focused to allow planning and management

will result in a significant contribution whatever the outcome of the research

can be investigated in the time and with the resources available

Research Project: Questions for the end of year 1

Can you succinctly express the aim of your research in two paragraphs to someone familiar with the domain? (What are you doing?)

Can you justify the importance of your research in a few sentences to someone unfamiliar with the domain? (Why is it worth doing?)

Have you expressed your intended doctoral project in a full research proposal based on sound research method? (How will you do it?)

The Research Proposal includes...

an unambiguous statement of the identified research question and its importance to the chosen research community

a critical review of the relevant literature, positioning the research question and including a statement of method for the review

a statement of the proposed research process, including a critical review of the strengths and weaknesses of the chosen research method for each step

The Research Proposal includes...

a schedule to completion, including regular deliverables and identifying possible threats to completion, with options for limiting the scope

a clear line of argument which links all elements of the research program into a cohesive defence that the thesisquestion can be answered within clearly expressed limitations

Research Project: Questions for the end of year 2

What research results are you ready to report to your community? (What have you done?)

Can you justify the validity and significance of these results to your community? (Are your methods valid and is the work interesting?)

Has your full research proposal been updated in such a way that a cogent plan to completion can be made? (How will you complete?)

Research Project: Questions for the end of year 3

Do you have a challenging thesis statement? (Have you done enough, and is it coherent?)

Can you defend it to your community? (Are your arguments valid?)

Have you reported them appropriately in a thesis? (Have you related the work to existing knowledge?)

Do you know where your research may lead? (Does the work open up further ideas for research?)

A Good Thesis Statement

is falsifiable

is related to other work in the field

makes a claim which is of interest to an identified research community

can be defended

Potential threats to defence

The thesis statement cannot be defended effectively using the chosen research methods and resources

Methods (or fragments) have been applied in inappropriate ways, endangering validity

Limitations of methods have not been fully considered, so claims are too strong

The research is fragmented: the various results cannot be put into a single coherent claim

So, how should you manage your PhD?

Research Process

Basic Principles Write early, write often Regularly review your thesis statement Continually study and discuss research

methods Maintain contact with your community Have regular deliverables Always have a schedule to completion Maintain an annotated bibliography

Months 1-2

Identify your topic Identify initial relevant papers and study

them Become familiar with any technologies to

be used Write something an initial position paper Attend research seminars Draw up a schedule for year 1

Months 3-6

Do a systematic literature search Write your own introduction to the field of

study Draft a thesis question Attend research seminars Refine your schedule for months 7-12

Months 7-12

Complete a critical review of the literature Refine your thesis question; clarify

objectives and justify the research Write a critical review of research methods

to be used, how they will contribute to the overall argument, and limitations expected

Months 7-12 cont.

Make contact with your community

Attend a workshop or conference Present something at a workshop

(poster?)

Draw up a plan to completion, including thesis skeleton and schedule for years 2-3

Questions for the end of the year

Who are the 7 2 key researchers in your field?

What are the 7 2 papers which best define your research area?

Which are the 7 2 recent and future workshops which define your research community?

Which 7 2 Conferences/Journals will you target with your work?

Months 13-30

Apply research methods to reach

objectives

Report on research results at conferences

Update drafts of early chapters

Draft a full argument in defence of your

thesis statement, and keep this updated

Months 31-36

Finalise your thesis statement

Finalise your detailed research argument

in an analysis chapter

Write conclusions and future work sections

Plan journal papers

References

`Popper; Bryan Magee, Fontana Press, 1985

various websites, including`Questions to Ask of AI Research and `A Scientific Checklist; Alan Bundy, DAI Edinburghhttp://homepages.inf.ed.ac.uk/bundy/

References (cont.)

The Research Students Guide to Success, Pat Cryer, OU Press, 1996

Supervising the Ph.D.: A guide to success, Sara Delamont et al, OU Press, 1997

see also: `Planning and Implementing your Final Year Project, Berndtsson, M et al., Springer, 2002.