35
Basic Statistical Concepts & Decision-Making DATA ANALYSIS 17 September 2015

WF ED 540, Class Meeting 4, 17 September 2015

Embed Size (px)

Citation preview

Page 1: WF ED 540, Class Meeting 4, 17 September 2015

Basic Statistical Concepts& Decision-Making

DATA ANALYSIS17 September 2015

Page 2: WF ED 540, Class Meeting 4, 17 September 2015

Basic statistical conceptsTERMS, DEFINITIONS, AND APPROACH

Page 3: WF ED 540, Class Meeting 4, 17 September 2015

Basic statistical terms

Population versus sample.

Parameter versus statistic.

Inference of population parameters from sample statistics.

Page 4: WF ED 540, Class Meeting 4, 17 September 2015

Population & sample Population• Any complete group with at least one characteristic in

common. • Not just people, but any entity. • Might consist of, but not limited to, people, animals,

businesses, buildings, motor vehicles, farms, objects, or events.

Sample• A group of units selected from a larger group (the

population). • Generally selected for study because the population is

too large to study in its entirety. • Good samples represent the population.

Page 5: WF ED 540, Class Meeting 4, 17 September 2015

Work within groups…

List 10 examples of

population/sample pairs.

Page 6: WF ED 540, Class Meeting 4, 17 September 2015

Parameters & statistics

Parameter• Information about a population.• Characteristic of a population.• A population value.• The “truth.”

Statistic• Information about a sample.• An estimate of a population value.

Page 7: WF ED 540, Class Meeting 4, 17 September 2015

Work within groups…

List 10 examples of

parameters and associated statistics

Page 8: WF ED 540, Class Meeting 4, 17 September 2015

Statistical reasoning Data usually are available from a sample, not a

population. That is, sample statistics are available, not

population parameters. We wish to infer (or estimate) parameters from

statistics. Because data are available from a sample, not the

population, error occurs when inferring (or estimating) population parameters from sample statistics.

Data analysis techniques help us make decisions under error and uncertainty.

Page 9: WF ED 540, Class Meeting 4, 17 September 2015

Hypothesis testingTHEORY, PROPOSITIONS, LOGIC

Page 10: WF ED 540, Class Meeting 4, 17 September 2015

Scientific theories…

Are composed of propositions that explain the empirical, observable world. A proposition is an “if–then” statement

Are networks showing relationship and causality among propositions.

Must have“empirical import.”

Page 11: WF ED 540, Class Meeting 4, 17 September 2015

Hypotheses are…

The foundation of theory-building.

Statements of testable scientific propositions.

The focus for empirical work.

Page 12: WF ED 540, Class Meeting 4, 17 September 2015

Well-stated hypotheses…Examine propositions in theory that

require verification.

Are specific.

Are testable.

Page 13: WF ED 540, Class Meeting 4, 17 September 2015

Hypotheses are testedto build a “nomological network”

The term "nomological" is derived from Greek and means "lawful.”

A nomological network is a"lawful network,” a network of propositions that describe how things work.

Page 14: WF ED 540, Class Meeting 4, 17 September 2015

“Nomological net” of theory

Page 15: WF ED 540, Class Meeting 4, 17 September 2015

“Nomological net” of theory

Page 16: WF ED 540, Class Meeting 4, 17 September 2015

“Nomological net” of theory

Page 17: WF ED 540, Class Meeting 4, 17 September 2015

Good (not easy) explanation Chapter 1 treats

concepts in the philosophy of science

Page 18: WF ED 540, Class Meeting 4, 17 September 2015

Work within groups…

Describe 1 example of

theory and 1 example of a

pseudo-theory

Page 19: WF ED 540, Class Meeting 4, 17 September 2015

Language of hypothesis testing… Hypotheses are“tested”

Hypotheses are never“proved”

Hypotheses only are“rejected”

Theories are built and verified by testing hypotheses

Page 20: WF ED 540, Class Meeting 4, 17 September 2015

An example…

Research is designed to evaluate whether on–the–job training reduces cycle time in product manufacturing.

Two groups of subjects:• One group receives on-the-job training.• The other group receives classroom

training.Dependent variable is cycle time;

independent variable is group membership.

Page 21: WF ED 540, Class Meeting 4, 17 September 2015

A word about notation

Greek letters used to designate parameters.

Letters of English alphabet used to signify statistics.

Page 22: WF ED 540, Class Meeting 4, 17 September 2015

An example…

Null hypothesis is H0: m1 - m2 = 0 stated about parameters.• Equivalent to m1 = m2

• Estimated by testing whether mean1 = mean2.• E.g., estimated by testing if mean cycle timeon-the-

job training = mean cycle timeclassroom training.Alternate hypothesis is H1: m1 - m2 not

equal 0.• Equivalent to m1 ≠ m2.

Page 23: WF ED 540, Class Meeting 4, 17 September 2015

Work within groups…

Formulate 1 statistical null hypothesis &

and its alternative

Page 24: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth tableD

ecis

ion Fail to

reject Ho

Reject Ho

Page 25: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth tableTruth

Ho true Ho falseD

ecis

ion Fail to

reject Ho

Reject Ho

Page 26: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth tableTruth

Ho true Ho falseD

ecis

ion Fail to

reject Ho

Reject Ho

Where are errors?

Page 27: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

Error

Error

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

Page 28: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

Error

Error

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

What do the errors cost?

Page 29: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

Type 1error

Error

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

Page 30: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

Type 1error

Type 2error

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

Page 31: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

Minimize Type 1error by selecting

low error rate

Type 2error

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

Page 32: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

Minimize Type 1error by selecting

low error rate

Minimize Type 2error by

increasing sample size

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

Page 33: WF ED 540, Class Meeting 4, 17 September 2015

Decision-by-truth table

TRADITIONALLY, probability of Type 1

error set at .05

Minimize Type 2error by

increasing sample size

TruthHo true Ho false

Dec

isio

n Fail to reject Ho

Reject Ho

Page 34: WF ED 540, Class Meeting 4, 17 September 2015

Work within groups…In a decision-by-

truth table, describe possible

outcomes of a statistical null

hypothesis test

Page 35: WF ED 540, Class Meeting 4, 17 September 2015

Basic Statistical Concepts& Decision-Making

DATA ANALYSIS17 September 2015