Thursday, January 12, 2012 1

Implementation of Blended Learning for the Improvement of Student Learning (IBIS)

inPOM 212 Business Statistics course

by

Bharatendra RaiDepartment of Decision and Information Sciences

Charlton College of BusinessUniversity of Massachusetts - Dartmouth

2011 IBIS cohort #2

2

Outline

Overview of POM 212 Business Statistics course

F2F components

Blended components

SLO Assessment plan

SLO measurement

Data collection/analysis of F2F Vs Blended

Results and conclusion

Overview of POM 212 Business Statistics course

Offered both as blended & online courseCore course for business studentsSmall population of students from liberal arts, computer science, electrical engineering, biology, etc.Sophomore and junior11 chapters covered4 tests

3

Overview of POM 212 Business Statistics course

Course descriptionExamines both descriptive and inferential statistics as applied to business. Topics include graphical and tabular methods of data presentation, probability theory and distributions, hypothesis testing, analysis of variance, regression and forecasting. Emphasis is placed on concepts, applications, and the proper use of statistics to collect, analyze, and interpret data. Throughout this course students will use computer software to perform statistical analyses. Students will learn how to make decisions using facts and the techniques of data analysis. Students will also use the internet to supplement classroom learning.

4

Overview of POM 212 Business Statistics course

Course objectivesBe introduced to statistical thinking and the ethical use of statistical methodsBe able to use Microsoft Excel to conduct statistical analysesBe able to work with tables and charts for business and industrial dataUnderstand basic probability and probability distributionsBe able to calculate measures of central tendency and dispersionBe introduced to the methods of regression & correlation analysisUnderstand how to utilize hypothesis-testing techniques to test business assumptionsBe able to apply tests of goodness of fit and independence to dataBe able to apply statistical techniques to real-life applied casesUnderstand how to use the regression model for prediction and forecasting in business.

5

Overview of POM 212 Business Statistics course

SLO identified for assessmentStudents will be able to understand statistical concepts and find solutions to data-based business problems.

6

F2F componentsControllable

lecturein-class team activitiesin-class report preparation and presentation

UncontrollableAbsenteeism

7

Blended components

Controllableonline quiz for each chapter – 3 attempts allowedpractice testarchives of recorded lecturesPowerPoint slides

Uncontrollableself-study by students

8

SLO Assessment planX Pre-course performanceY Performance based on F2F componentsZ Performance based on Blended (includes F2F)Z-Y Performance based on Blended only (excludes F2F)

9

SLO measurement

Data for X Based on a random sample of question from four tests administered during the semester

10

SLO measurement

Data for YFall 2011 class and Test-4 is used. Sample consists of 49 students.Test-4 with higher difficulty level offers better discriminative power.The test is administered online and will be available to students for two hours.Each student would receive 30 questions randomly from 40 which is one combination from over 847 million different combinations. Only F2F components will be used for Test-4 that will be based on chapters 10, 12, and 14.

11

SLO measurement

Data for Z Spring 2011 class for Test-4 will be used. Data already available with a sample of 44 students.

12

Data collection/analysis of F2F Vs Blended

13

X: Spr-2011 Pre-courseAverage = 28.7

X: Fall-2011 Pre-courseAverage = 28.8

Z: Spr 2011 Test-4 (Blended)Average = 79.4

Z: Fall 2011 Test-4 (F2F)Average = 86.9

Data collection/analysis of F2F Vs Blended

14

Spring 2011 Fall 2011

X: Pre-course Z: Blended X: Pre-course Y: F2F

Number of students 44 44 49 49

Average 28.7 79.4 28.8 86.9

Standard Deviation 15.7 13.8 16.6 8.8

95% confidence interval 28.7 + 4.8 79.4 + 4.2 28.8 + 5.0 86.9 + 2.7

Results and conclusion

15

The incoming student quality is assessed by administering a pre-course online quiz.No difference in the incoming student quality observed. (95% confidence interval: Spring 2011 28.7% + 4.8%; Fall 2011 28.8% + 5.0%).No statistical difference in the incoming student quality between two semesters under study makes the comparison between ‘blended’ and F2F valid.95% confidence interval for blended and F2F offering is 79.4% +4.2% and 86.9% + 2.7% respectively.Statistically significant difference in student learning for blended versus F2F is observed.Students offered F2F only scored about 7% higher than blended offering on a comparable test.

Peer-mentor Experience

16

Mentor: Chan DuProvided access to myCourses website for POM 212 course.Class visit by mentor - November 30, 2012.Meetings during IBIS sessions and several informal meetings during Fall 2011.Didn't work well: class visit planned during last week of the semester.