Refining Your Research Question

In this session, we will…

• Discuss guidelines for creating a ‘good’ research question

• Provide time to revisit and revise your research questions and plans

• Consider appropriate methods for investigating your research question(s)

Guiding Principles forScientific Research in Education

1. Question: pose significant question that can be investigated empirically

2. Theory: link research to relevant theory3. Methods: use methods that permit direct

investigation of the question4. Reasoning: provide coherent, explicit chain of

reasoning5. Replicate and generalize across studies6. Disclose research to encourage professional

scrutiny and critiqueNational Research Council, 2002

Why are research questions important?

“Well-crafted questions guide the systematic planning of research. Formulating your questions precisely enables you to design a study with a good chance of answering them.”

-- Light, Singer, Willett, By Design (1990)

A good research question will…

• be clearly linked to overall project goal

• allow the target population to be identified

• guide the appropriate level of aggregation (e.g. class, course, curriculum, institution)

A good research question will…

• identify the outcome variables and key predictors of those variables

• determine what type of study is needed (e.g. descriptive, relational, experimental)

• identify background characteristics that might influence outcomes

A good research question will…

• raise questions about how to best collect data

• influence the number of participants in the study

Writing a good question…

• What do you want to learn about?

• Draft and redraft with increasing specificity using the 8 guidelines listed earlier

• Ask for feedback from colleagues

• Build on the work of others by conducting a systematic literature review

•What is the question?•What research and instructional designs?•What data collection methods?•How to analyze and interpret data?•Are findings valid and generalizable?•What are the next questions?•WHO?

What evidence will we accept?

Causation vs. Correlation

• Correlation – association between independent and dependent variables

• Causation – relationship between independent and dependent variables such that a change in an independent variable (predictor) will change the dependent variable (outcome) in a known way

An Example

• Many studies have established a direct relationship between student height in elementary school and reading level

• Correlation?

• Causal effect? – look for factors not included in the correlation

Research Methods

Data collection approaches

Multiple Choice … … Concept Maps … … Essay … … Interview

high Ease of Assessment low

low Potential for Assessment of Learning high

Theoretical Framework• Ausubel 1968; meaningful learning• Novak 1998; visual representations• King and Kitchner 1994; reflective judgment• National Research Council 1999; theoretical frameworks for assessment

Assessment Gradient

“Few faculty members have any awareness of the expanding knowledge about learning from psychology and cognitive science. Almost no one in the academy has mastered or used this knowledge base. One of my colleagues observed that if doctors used science the way college teachers do, they would still be trying to heal with leeches."

J.J. Duderstadt (2001), president emeritus of the University of Michigan, in "A University for the 21st Century."

Exercise

• Individually, for each of the research questions in the handout, determine:– if the question meets the 8 guidelines discussed

earlier – suggestions for improving the question

• Share your results with a neighbor

• Be prepared to report to the full group