Research Methods for Counselors

COUN 597

University of Saint Joseph

Class # 8

Copyright © 2015 by R. Halstead. All rights reserved.

Class Objectives

A Review of Just How Far We have All ComeSalkind Chapter 12 - Analysis of Variance

Review

The field of Counseling deals with various concepts that are called constructs (e.g., Depression, Anxiety, Intelligence, etc.).

Constructs can be quantified and then measured using valid and reliable assessment tools (tests).

Once a group of individuals have been tested a numbers of test scores are created.

Because we are often interested in nature of a whole group of individuals, once with have their scores we perform procedures that help describe the group.

Review

Descriptive Statistics – provide a picture of the group we have tested. Central tendency – Mean, Median, Mode Variability – Range and Standard Deviation

If the group was administered two measures (Depression and Anxiety) we can calculate a correlation coefficient that captures the strength and direction of the relationship that exists between Depression and Anxiety within the group.

Review Once we have tested and describe a group it is always fun

to divide the whole group into two smaller groups to see and do different things to them to see if we can change them in some way. This process involves using a research design.

R O x O R O O When dividing the groups we want to do so randomly so as

to not enter a bias we can control into the mix. We also always want to use valid and reliable measures to

that when we eventually arrive at findings we know that they are in fact as accurate as possible – knowing full well that there will always be limitations to any findings that we may generate.

Review When conducting research using the design below – or a variation of

it - we are always looking for differences between group means. R O x O R O O We start by: 1. Writing a Null Hypothesis (which assumes no

differences between groups) and an alternative hypothesis and then 2. Next we setting our p level (.05 or .01 – the level of probability of

being wrong or rejecting the null hypothesis when it is true – Type I error).

Thus far we have used the t-test to establish if any difference between the means exist they are statistically significant differences. We have done this by calculating the t statistic (our obtained value) comparing it with our critical value (found in the Table of Critical Values for t) – and if our obtained value is more extreme than the Critical Value – we reject the null and accept our alternative hypothesis.

Analysis of Variance - ANOVAAgain, empirical research often operates from a

framework of establishing comparisons between groups (differences or lack of differences) and drawing a conclusion about those findings.

We have also discussed that when we find a difference between the means of two or more groups we need to be concerned about whether those differences are statistically significant or not.

ANOVAWe have seen in how we can test for significant

differences between two group means using the t-test.

Now we will move forward one more step to look at a situation were we need to test for significant differences between the means of more than two groups.

Use the test chart in your text to determine the form (simple or repeated measures) analysis of variance we should perform given certain circumstances.

The Simple ANOVAThe simple analysis of variance (a.k.a. - the one-

way analysis of variance) is used when an examination of differences on one or more variables is being conducted and the same participants are not tested more that once.

Does that last part sound familiar?It should. It is the same criteria we used for

determining independent and dependent means.In fact it is very similar to the t-test only in this case

we have more than two groups being tested.

A More Complex Simple ANOVAWhat?Well it is true. We can make the simple ANOVA

more complex by not only testing for differences between groups but also by different factors across groups. Below is a 3X2 factorial design.

Group 1 Group 2 Group 3

Female Dep. Score Dep. Score Dep. Score

Male Dep. Score Dep. Score Dep. Score

Steps in Computing the F Statistic

Step 1: A statement of the null hypothesis and research hypotheses - no difference between the means Group 1, Group 2, Group 3 and Alternative.The Null Hypothesis Ho: 1 = 2 = 3 The

Research Hypothesis H1: X1 = X2 = X3

Step 2: Set the level of risk (or level of significance) upon which your decision will be made to accept or reject the null hypothesis and risking Type I Error.

Step 3: Select the appropriate F test statistic base on need for Simple or Repeated Measures ANOVA.

Steps in Computing the F Statistic

Step 4: Compute the test statistic value (a.k.a. the Obtained Value).

Step 5: Consult the appropriate table to determine the Critical Value needed for rejecting the null hypothesis for the statistic you are using.To use the table you must determine the Degrees

of Freedom (df). For the F statistic there are two sets of degrees of freedom. For the numerator it is k-1 where k = the number of groups and the df for the denominator is n-k (n = participants).

Steps in Computing the F Statistic

Step 6: Compare the Obtained Value (F Statistic) and the Critical Value.

Step 7: Commit to a decision. If the Obtained Value is more extreme than the critical value (further in the tail of the normal curve) the test has been met. We can reject the null hypothesis and conclude that the difference between the means of our groups are Significantly Different and willing to risk saying the differences observed are not do to factors other than true difference in our variables of interest.

F(2,27) = 8.80 p < .05So what does that mean?The statement above says that the differences that

exist between the three groups are 8.80 times as extreme as the differences within in the three groups.

“Houston we have a problem!”

Omnibus TestsThe F test is an omnibus test - it tells us whether or

not there are significant differences but not where those differences actually occurred.

To find where the significant differences lie, we have to perform other specialized tests to tease out those significant differences.

You will learn more about these tests in your next course in research and statistics.