S TATISTICS Part IIIA. Hypothesis Testing. 3A.2 Hypothesis Testing n Similar techniques to last block of study on estimation procedures. There, we made

SSTATISTICSTATISTICS Part IIIA.

Hypothesis TestingHypothesis Testing

3A.2

Hypothesis Testing Hypothesis Testing

Similar techniques to last block of study on estimation procedures. There, we made interval estimates of parameters without preconceptions.

In Hypothesis testing someone is making a claim or challenging a proposition about a parameter’s value.

Examples:

What is the mean weight of a medium-sized box of Cheerios? Build a C.I.!

General Mills claims a medium-sized box of Cheerios has a mean weight of 16 ounces. You wish to challenge this claim. Do hypothesis testing!

3A.3

Two Opposing HypothesesTwo Opposing Hypotheses

The null hypothesis, symbolized by HO , is a

description of the status quo, or what people have long believed to be true. If the null hypothesis is not rejected, no action needs to be taken.

The alternative hypothesis, symbolized by

HA, is a vehicle for challenging or contradicting

the conventional wisdom. Accepting the alternative hypothesis calls for action.

3A.4

ExamplesExamples

HO : Autonetics meets our quality specifications

HA : Autonetics doesn’t meet our quality specifications

HO : Cancer rates for people who live close to high

voltage power lines are not greater than for people who don’t.

HA : Cancer rates for people who live close to high

voltage power lines are greater than for people who don’t.

3A.5

The key to setting up hypotheses:The key to setting up hypotheses:

That which is contrary to what is commonly believed or accepted goes into the Alternative.

That which calls for action goes into the Alternative.

That which you are trying to demonstrate or that which you, the researcher, believe goes into the Alternative.*

“Everything else” goes into the Null. The “equal” sign always goes with the Null.

3A.6

One-sided versus two-sidedOne-sided versus two-sided

HO : μ = 63.25

HA : μ 63.25 (A two-sided or two-tailed test)

HO : μ ≥ 30.0

HA : μ < 30.0 (A one-sided or one-tailed test, also called

a left-tailed test)

HO : μ ≤ 4.0

HA : μ > 4.0 (A one-sided or one-tailed test, also called

a right-tailed test)

3A.7

ExamplesExamples One of your suppliers claims that he fills and ships orders, on average,

within six days of receipt. You believe his average time is longer than six days.

HO : μ ≤ 6.0

HA : μ > 6.0 A manufacturer claims that a bottling machine fills each bottle

precisely with 2000 cubic centimeters of cola. You want to test his claim.

HO : μ = 2000

HA : μ 2000

Research shows that Web surfers will lose interest in a Web page if downloading takes more than 6 seconds at 56K. You wish to test the effectiveness of a newly designed Web page in regard to its download time.

HO : μ ≤ 6

HA : μ > 6

3A.8

The Nature of Hypothesis TestingThe Nature of Hypothesis Testing

We formulate two opposing hypotheses We develop sample information We assess whether sample information is

sufficiently strong to allow us to reject the null.

This process is very similar to the American system of jurisprudence . . .

3A.9

Citizens are presumed innocentCitizens are presumed innocent

HO : The defendant is innocent

HA : The defendant is guilty

If, based upon evidence during the trial, the jury cannot find the defendant guilty beyond a reasonable doubt, what do they declare?

“We find the defendant not guilty.”

Does the jury accept the null hypothesis?

3A.10

In hypothesis testing, we never accept the null hypothesis! We may fail to reject it but we never accept it.

We simply state, “Based upon sample information I cannot reject the null hypothesis beyond a reasonable doubt.”

Note: When we reject the Null, we do accept the alternative.

3A.11

‘‘The Reasonable Doubt’The Reasonable Doubt’

Let HO : μ = 400.0 Let’s assume that this null really is true. Let’s take a sample of size 36 from this population What’s the expected value of X? What if X turns out to be 396.9? 401.4? 407.0? 382.1?

The crux of hypothesis testing: How far must a sample statistic be from the null hypothesis before we go beyond ‘reasonable doubt’ and reject the null?

We define beyond ‘reasonable doubt’ by setting up “tails of rejection.”

3A.12

““Alpha” ( Alpha” ( ) defines tails of rejection ) defines tails of rejection

.025.025

μ = 400 407382.1

Let = .05

If X = 407 we would not reject the null

If X = 382.1 we would reject the null

X

3A.13


.025.025

μ = 400 407382.1

Let = .05

What is the probability of rejecting a true null?

X

3A.14


.025.025

μ = 400 407382.1

Let = .05

Larger values of α make it easier to reject the null

X

3A.15

Type I and Type II ErrorsActual Situation

Ho True | Ho FalseConclusion

Fail to Reject Ho

Reject Ho

Correct decision

Correct decisionType I error

Type II error

= probability of rejecting the Ho when Ho is true (Type I error) = probability of failing to rejecting the Ho when Ho

is false (Type II error)

Introduction to Business Statistics, 5e

Kvanli/Guynes/Pavur

(c)2000 South-Western College Publishing

TYPETYPE I I and TYPE and TYPE IIII Errors Errors

3A.16

Review of the four possible outcomes of hypothesis testing:Review of the four possible outcomes of hypothesis testing:

The Null Hypothesis is true but we reject it. What is the type of error and what is the probability of this occurrence?

Type I error. Probability is and is called the level of significance.

The Null Hypothesis is true and we fail to reject it. What is the type of error and what is the probability of this occurrence?

No error! The probability of failing to reject a true null is 1 - and is called the level of confidence.

The Null Hypothesis is false but we fail to reject it. What is the type of error and what is the probability of this occurrence?

Type II error. Probability is . The Null Hypothesis is false and we reject it. What is the type of

error and what is the probability of this occurrence? No error! The probability of rejecting a false null is 1 - and is

called “the power of the test.”

3A.17

The Trade-off Between Type I & Type II ErrorThe Trade-off Between Type I & Type II Error

Fail to reject Ho

3A.18

Relationship between Relationship between αα andand ββ

The “teeter totter”

αβ

This relationship holds for a given sample size.

3A.19

Relationship between Relationship between αα andand ββ

Why not set α at zero?

We would never reject the null whether it be true or false!

In this case only, α and β add up to 1.0

Setting α influences β but knowing α does not reveal β (except when α is 0.0).

We can reduce the risks of both Type I and Type II errors at the same time by increasing sample size.

3A.20

Where should we set Where should we set αα ?? If the risk of a Type I error is greater than the risk

of a Type II error, set α small, .01 for example. If the risk of a Type II error is greater, make α

relatively large, .10 for example. If the risks of the two types of errors are equal, set

α at .05 (most common).

S’pose we are testing the average tensile strength of a batch of bolts to see if it meets or exceeds minimum specified. It is very expensive to adjust the machine if the manufactured strength of these bolts does not meet standard. What level of α would we use if these bolts are used to secure lids on trash cans? If these bolts are used on the space shuttle?

3A.21

The null would be that the bolts meet standard The alternative would be that they don’t meet

standard. A Type I error would occur if they meet standard

and we conclude they don’t. Then we’d go through an expensive machine adjustment process that really wasn’t necessary.

If these bolts are used on trash cans, we’d want a small alpha—reduce the risk of a Type I error!

If these bolts are used on the Shuttle, we’d want a small Beta—which we would get with a larger alpha!

3A.22

Hypothesis Testing Hypothesis Testing

Hypothesis testing involves five major steps:

1. Formulating two opposing hypotheses

2. Setting α (and thereby defining the regions of rejection)

3. Collecting sample information

4. Using sample data to compute a test statistic

5. Make a decision based upon whether the test statistic is in a tail of rejection (defined by α)

3A.23

Computing a Test StatisticComputing a Test Statistic Using z or t values

Remember that we can convert any normally distributed random variable to z or t values.

use X

Xz

0

in the large-sample case

and X

s

Xt 0

in the small-sample case

3A.24

Two-tailed vs. One-tailed Hypothesis TestTwo-tailed vs. One-tailed Hypothesis Test

3A.25

Example: Large sampleExample: Large sample

Ever-Glo advertises that their 100 Watt bulbs last an average of 400 hours. You wish to challenge that claim. You test the lifetimes of 100 bulbs and get a sample mean of 411 hours and a sample standard deviation of 42.5 hours. What conclusion would you reach using a level of significance of .05?

Use the five step process to work this problem.

3A.26

Five step process:Five step process:

1. HO : μ = 400.0

HA : μ 400.0 (Note: A two-tailed test)

2. α = .05 (which defines the rejection region as ± 1.96)

3. n = 100 X = 411.0 s = 42.5

59.2100/5.42

400411 Z

5. 2.59 > 1.96. Therefore we are in the right tail. We reject the null!

4.

3A.27


.025.025

μo = 400 +1.96-1.96 X2.59

3A.28


.025.025

μo = 400 +1.96-1.96 X2.59

How do we interpret the 2.59?

3A.29


.025.025

μo = 400 +1.96-1.96 X2.59

For a normal distribution with a mean of 400 and a standard deviation of 4.25, 411 is 2.59 standard deviations to the right.

3A.30


.025.025

μo = 400 +1.96-1.96 X2.59

For a normal distribution with a mean of 400 and a standard deviation of 4.25, 411 is 2.59 standard deviations to the right.

Our decision rule: Reject the Null for any test statistic beyond ± 1.96 standard deviations.

3A.31


.025.025

μo = 400 +1.96-1.96 X2.59

We are at risk for committing what kind of error?

What is that risk?

3A.32

Another Large Sample Problem:Another Large Sample Problem:

Honda claims its Pilot SUV obtains an average of at least 22 mpg for highway driving. I’m skeptical. I had an independent research firm drive 50 identical models of the Pilot under identical and controlled highway conditions. The sample mean was 20.9 mpg. The sample standard deviation was 5.1 mpg. What conclusion can be drawn at the .05 level of significance?

3A.33

Is Honda likely telling the truth?Is Honda likely telling the truth?

HO : μ ≥ 22.0

HA : μ < 22.0 (Note: A left-tailed test)

The tail of rejection (the Z value that puts .05 in the left tail) is defined by –1.645.

The test statistic is

525.150/1.5229.20 Z

3A.34

A left-tailed test:A left-tailed test:

.05

μo = 22-1.645 X

-1.525

We fail to reject the null. These results are not statistically significant. We may, however, be committing a ________error.

3A.35

A left-tailed test:A left-tailed test:

.05

μo = 22-1.645 X

-1.525

We fail to reject the null. These results are not statistically significant. We may, however, be committing a TYPE II error.

3A.36

Try Problem Set 3Try Problem Set 3

3A.37

Another Large Sample Problem:Another Large Sample Problem: A venture capitalist believes that funding the

development of a new remote control lawn mower will be a profitable investment if the average price paid for a standard, self-propelled lawn mower is more than $450.00. A random sample of 46 people who recently purchased high-end mowers was obtained. The mean was $465.70. The standard deviation was $76.00.

Based upon a significance level of .05 should the venture capitalist invest in developing the new lawn mower? (Use MINITAB)

3A.38

Small sample problemsSmall sample problems

Remember for small samples, the parent population must be normally distributed.

Use the t statistic instead of Z

use X

Xz

0


and X

s

Xt 0


3A.39


Remember for small samples, the parent population must be normally distributed.

Use the t statistic instead of Z

Go into the t table at n-l degrees of freedom to get the tail of rejection. (Split the alpha for a two-tailed test.)

use X

Xz

0


and X

s

Xt 0


3A.40


HO : μ ≥ 30.0

HA : μ < 30.0

Suppose n= 14 and the “t” computed from sample data is -1.84.

What is the tail of rejection at .05 according to the t table and what is your decision?

-1.771 defines the tail of rejection. We are in the tail. We would reject the null.

3A.41


HO : μ = 32 inches

HA : μ 32 inches

Suppose n = 26 and the “t” computed from sample data is 1.44.

What is the tail of rejection at .05 according to the t table and what is your decision?

+2.060 defines the tail of rejection. We are not in the tail. We would fail to reject the null.

3A.42

The p-Value conceptThe p-Value concept S’pose, in a two-tailed test of hypotheses, I

obtained a test statistic (Z value) of 1.85.

Would I reject the Null at a .10 level of significance?

The tail of rejection would be defined by 1.645. The Z value of 1.85 would be in a tail of rejection.


The tail of rejection would now be defined by 1.96. I would not be in a tail of rejection with a Z=1.85.


The tail of rejection would now be defined by 1.85—the Z value!

3A.43

The p-Value conceptThe p-Value concept S’pose, in a two-tailed test of hypothesis, I

obtained a test statistic (Z value) of 1.85.


The tail of rejection would be defined by 1.645. The Z value of 1.85 would be in a tail of rejection.


The tail of rejection would now be defined by 1.96. I would not be in a tail of rejection with a Z=1.85.


The tail of rejection would now be defined by 1.85—the Z value!

3A.44

The p-value is the level of The p-value is the level of alpha alpha at which the decision changes at which the decision changes

.025.025

+1.96-1.96 X1.645

1.85

If Z = 1.85, we would reject the null at .10. We would not reject the null at .05. The decision changes at an alpha of .0644

As alpha gets smaller and smaller, it becomes harder and harder to reject the null. What is the lowest level of alpha at which we can still reject the null in this example?

3A.45

The p-value is the level of alphaThe p-value is the level of alpha at which the decision changes at which the decision changes

.025.025

+1.96-1.96 X1.645

1.85

If Z = 1.85, we would reject the null at .10. We would not reject the null at .05. The decision changes at an alpha of .0644

As alpha gets smaller and smaller, it becomes harder and harder to reject the null. What is the lowest level of alpha at which we can still reject the null in this example? .0644 and that is the p-value!

3A.46

p-Valuep-Value

The p-value is the value of at which the hypothesis test procedure changes conclusions based on a given set of data.

P-value conceptualization I: It is the lowest value of for which you will be able to reject Ho.

P-value conceptualization II: It is the probability of getting the sample result that you obtained or something more extreme, given that the null is true.

3A.47

Procedure for Finding the p-ValueProcedure for Finding the p-Value

Obtain the area in the tail(s) at Z

For a two-tailed test (Ha: o)

p-value = 2 * (area outside Z) For a right-tailed test (Ha: > o)

p-value = area to the right of Z For a left tailed test (Ha: < o)

p-value = area to the left of Z

3A.48

Examples of computing p-value:Examples of computing p-value:

1. For HO : μ ≥ 22.0 HA : μ < 22.0

and Z = -1.5 what is the p-value?

.0668

2. For HO : μ ≤ 6.0 HA : μ > 6.0

And Z = 4.9 what is the p-value?

0.00

3A.49

Examples of computing p-value:Examples of computing p-value:

3. For HO : μ = 2000 HA : μ 2000

and Z = 1.85 what is the p-value?

.0644

4. For HO : μ ≤ 34,000 HA : μ > 34,000

And Z = .84 what is the p-value?

0.20

What does the .20 mean in plain English?

3A.50

Work this problem:Work this problem:

Consumer Reports magazine claims that the good negotiator can get at least 7% off the sticker price of a new car. I send out skilled negotiators to 36 randomly selected new car dealers to test this claim. I find they average a negotiated discount of 6.32% with a sample standard deviation of 1.7%.

What are the hypotheses? What is the lowest level of alpha at which I

can reject the null?

3A.51

SolutionSolution

HO : μ ≥ 7%

HA : μ < 7%

40.236/7.1732.6 Z

The p-Value is the area to the left of –2.40, which is .0082

3A.52

Interpreting the p-ValueInterpreting the p-Value

Classical Approach reject Ho if p-value ≤ fail to reject Ho if p-value >

Fisher’s rule of thumb Strongly reject Ho if p-value is small (p < .01)

Tend to reject Ho if p is between .01 and .05

Tend not to reject Ho if p is between .05 and .1

Strongly fail to reject Ho if p is large (p > .1)

3A.53

Looking at the p-value in MINITABLooking at the p-value in MINITAB

A federal bankruptcy court wants to see if statistical evidence indicates the average salary of store managers at K-Mart is more than $100,000 per year. The analyst generally uses a 5% level of significance but also wants to look at the p-value.

Using MINITAB, assess these hypotheses: HO : μ ≤ 100,000

HA : μ > 100,000

What Z value defines the tail of rejection for .05 in the right tail?

+1.645 But this is a t problem! Tail of rejection is +1.753

3A.54

The K-mart problemThe K-mart problem The sample mean salary is $102,159. Certainly the point

estimate is greater than $100,000. But this sample result is not statistically significant. The probability of getting this sample result or something

more extreme if the true mean salary is $100,000 or less is 22% (the p-value in this particular problem).

The lowest level of alpha at which we could reject the null is .22

If we use an alpha of .05, we would fail to reject the null in this problem.

We don’t “accept” that K-Mart managers on average are paid $100,000 or less but this sample evidence is not strong enough to reject that proposition.

3A.55

Practice comparing Practice comparing to the p-Value to the p-Value

For a right tailed test, alpha is .05 and the p-value is .11 Fail to reject null

For a two-tailed test, alpha is .10 and the p-value is .04 Reject null and accept alternative

For a left-tailed test, alpha is .01 and the p-value is .008 Reject the null and accept alternative

HO : μ ≤ 150

HA : μ > 150 and the Z value has been calculated as 2.2

What is the p-value and what is your decision on these hypotheses?

The p-value is .0139.

If my company uses an alpha of .05, I would reject the null. If my company uses an alpha of .01, I would not reject the null.

According to Fisher’s rule of thumb, I would tend to reject the null but not strongly.

3A.56

Hypothesis tests on proportionsHypothesis tests on proportions

Example: HO : ≤ .40

HA : > .40S’pose n = 500 and x = 229; hence P = .458

022.500

)6(.4.)1(p

no

65.2022.

4.458.p

o

PZ

P-Value is .0041. We can assuredly reject the null.

3A.57

SummarySummary Hypothesis testing is a systematic approach to

assessing beliefs. That which requires action, or that which we are

trying to demonstrate goes into the Alternative Hypothesis.

Hypotheses can be one-tailed or two-tailed We can assess sample information and the

associated test statistic with one of two approaches: A pre-determined level for or by a p-Value.

Judgments on hypotheses can lead to either a Type I or a Type II error.

Documents

S TATISTICS Part IIIA. Hypothesis Testing. 3A.2 Hypothesis Testing n Similar techniques to last block of study on estimation procedures. There, we made