SITE Conference – 3/2003 1 Successful Online Assessment, Evaluation, and Interaction Techniques Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State

SITE Conference – 3/2003

1

Successful Online Assessment, Evaluation, and Interaction

Techniques

Presented by:Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State University of Dr. Barbara K.Mckenzie – Dept. of MIT, State University of

West Georgia (West Georgia ([email protected]@westga.edu)) Dr. Nancy G.Mims – Dept. of Educational Leadership and Dr. Nancy G.Mims – Dept. of Educational Leadership and

Foundations, Western Carolina University (Foundations, Western Carolina University ([email protected]@wcu.edu)) Dr. Elizabeth Bennett – Dept. of MIT, State University of West Dr. Elizabeth Bennett – Dept. of MIT, State University of West

Georgia (Georgia ([email protected]@westga.edu ) )


2

Introduction Accountability increasingly Accountability increasingly

importantimportant DL classes must be held DL classes must be held

accountable for student accountable for student learning learning

3 areas that impact success of 3 areas that impact success of any DL courseany DL course

Assessment Assessment

EvaluationEvaluation

InteractionInteraction


3

Focus To describe a variety of successful To describe a variety of successful

assessment, interaction and evaluation assessment, interaction and evaluation techniques used by distance instructorstechniques used by distance instructors

Techniques - extracted from multiple Techniques - extracted from multiple sourcessources

Review of the literatureReview of the literatureConversations with expertsConversations with expertsCollective experiences of the authorsCollective experiences of the authors


4

Assessment

A way of determine learning gains A way of determine learning gains (Simonson, 2003)(Simonson, 2003)

Identifies gaps between what is Identifies gaps between what is expected and what is taking place in expected and what is taking place in classesclasses


5

Assessment Techniques

Students complete online learning styles Students complete online learning styles questionnairesquestionnaires

Creates greater awareness of students’ Creates greater awareness of students’ backgrounds and how they learn the bestbackgrounds and how they learn the best

Example: Example: http://tunis.commnet.edu/told/orientation/0ld_onlihttp://tunis.commnet.edu/told/orientation/0ld_onlineLearning.htmlneLearning.html

Design your own needs assessment instrumentDesign your own needs assessment instrument


6


Create your own online Create your own online technology needs technology needs assessment or use an online assessment or use an online version with students the version with students the first week of classfirst week of class

Have students apply class Have students apply class concepts to projects to concepts to projects to projects and post them for projects and post them for reviewreview


7

Assessment Techniques Create web quests for students to access online Create web quests for students to access online

resources resources (e.g., Track Star -- (e.g., Track Star -- http://trackstar.hprtec.orghttp://trackstar.hprtec.org))

Assign students to virtual learning groups to do Assign students to virtual learning groups to do projects that demonstrate their skills in utilizing projects that demonstrate their skills in utilizing course contentcourse content

Track students online to determine how Track students online to determine how frequently they are participating in the course frequently they are participating in the course


8


Design and administer formative Design and administer formative assessments during the course assessments during the course

to determine how students are doing to determine how students are doing suggestions for improvementssuggestions for improvements

Require reflective journals during the Require reflective journals during the course course

to demonstrate students’ to demonstrate students’ understanding and overall growth understanding and overall growth during the courseduring the course


9


Have students write one minute papers Have students write one minute papers

describing what they have just learneddescribing what they have just learned Require students to post a certain Require students to post a certain

number of times during the coursenumber of times during the course

Include participation as part of their Include participation as part of their gradegrade


10

Interaction

Two way communication activities that take Two way communication activities that take place in the course:place in the course:

Student to studentStudent to studentStudent to instructorStudent to instructorStudent to virtual learning group and other virtual Student to virtual learning group and other virtual learning groupslearning groupsInstructor to studentInstructor to studentInstructor to virtual learning groupInstructor to virtual learning group


11

Interaction Techniques: Getting to Know Each Other

Students design and display self Students design and display self introduction PowerPoint pres.introduction PowerPoint pres.

Students share information about Students share information about themselves and others introduce themselves and others introduce them to the class on the BBthem to the class on the BB

Students take a digital photo, type Students take a digital photo, type selected information, and post selected information, and post online online

(e.g., Name, e-mail address, where (e.g., Name, e-mail address, where employed, goals of course, hobbies, employed, goals of course, hobbies, something unique)something unique)


12

Interaction Techniques: Group Projects

Assign students to virtual Assign students to virtual learning groups and have them learning groups and have them complete a required group complete a required group projectproject

Have virtual learning group Have virtual learning group complete a group selected complete a group selected projectproject


13

Interaction Techniques: Synchronous Sessions

Participate in online chats after Participate in online chats after being introduced to netiquette being introduced to netiquette

Debate activities between virtual Debate activities between virtual learning groupslearning groups


14

Interaction Techniques: Group Discussions

Have students post reactions to Have students post reactions to required readings and respond to required readings and respond to others postingsothers postings

Interview an expert and post Interview an expert and post information online for class to reviewinformation online for class to review


15

Interaction Techniques: Instructor Feedback

Poll students onlinePoll students online

Yes/No and Multiple Choice questionsYes/No and Multiple Choice questions Speak to students online and have them Speak to students online and have them

respond by speakingrespond by speaking File sharing and feedback from the instructor File sharing and feedback from the instructor Have virtual office hoursHave virtual office hours


16

Interaction Techniques: Student Centered

Cyber caféCyber café Provide anonymous BB Provide anonymous BB

for students to post for students to post commentscomments

Online games (e.g., Online games (e.g., crossword puzzles)crossword puzzles)


17

Interaction Techniques: Frequently Asked Questions

Information on questions of Information on questions of concern to studentsconcern to students

Days & times for OL supportDays & times for OL support How to attach documentsHow to attach documents Continue to enhance as Continue to enhance as

neededneeded


18

Evaluation

To answer questions focusing on the To answer questions focusing on the “value” of the class“value” of the class

How effective was the class?How effective was the class?

Should class be continued or not?Should class be continued or not?

What changes are needed? What changes are needed?

Is the class worth the time and Is the class worth the time and expense?expense?


19

Evaluation Techniques

Develop an online Develop an online summative evaluation summative evaluation survey that asks students survey that asks students to report on the value of to report on the value of

Course contentCourse contentTechnology usedTechnology usedOverall satisfaction Overall satisfaction with the coursewith the course


20

Evaluation Techniques

Interview students online or by phone Interview students online or by phone at the end of the course for feedbackat the end of the course for feedback

Interview students a semester or a year Interview students a semester or a year after the course to determine its impactafter the course to determine its impact

Use the institution’s summative Use the institution’s summative evaluation surveyevaluation survey


21

Evaluation Techniques Create your own summative evaluation Create your own summative evaluation

surveysurvey Use course reflectionsUse course reflections Focus group discussions with students after Focus group discussions with students after

course to evaluate effectiveness of the course to evaluate effectiveness of the course course

Give an open book exam at end of course to Give an open book exam at end of course to evaluate students’ critical thinking skillsevaluate students’ critical thinking skills


22

Acknowledgement

This presentation was made possible This presentation was made possible

through funding by the PT3 Grant at through funding by the PT3 Grant at

the State University of West Georgiathe State University of West Georgia


23

Successful Online Assessment, Evaluation, and Interaction

Techniques

Presented by:Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State University of Dr. Barbara K.Mckenzie – Dept. of MIT, State University of

West Georgia (West Georgia ([email protected]@westga.edu)) Dr. Nancy G.Mims – Dept. of Educational Leadership and Dr. Nancy G.Mims – Dept. of Educational Leadership and

Foundations, Western Carolina University (Foundations, Western Carolina University ([email protected]@wcu.edu)) Dr. Elizabeth Bennett – Dept. of MIT, State University of West Dr. Elizabeth Bennett – Dept. of MIT, State University of West

Georgia (Georgia ([email protected]@westga.edu ) )

Documents

SITE Conference – 3/2003 1 Successful Online Assessment, Evaluation, and Interaction Techniques Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State