Melissa Merritt 2011 Program Eval Doc

8/7/2019 Melissa Merritt 2011 Program Eval Doc

http://slidepdf.com/reader/full/melissa-merritt-2011-program-eval-doc 1/21

Melissa Merritt

FRIT 7338

Dr. Elizabeth Downs

Technology Program Administrator

Georgia Southern University Center for Online Learning Program Evaluation

Executive Summar y

After evaluating Georgia Southern University’s Center for Online Learning, I found the

center to be sufficient according to their mission statement in providing services to faculty. The

quality of their services to students is a little more difficult to gauge because anonymous studentsare serviced through a call center. There are some adjustments that could be made to the current

way of doing things, but the feedback from those who utilize the services of the Center for

Online Learning was overwhelmingly positive.

Center for Online Learning Staff

The Center for Online Learning consists of Deborah Champion who is the Program Coordinator.

Raleigh Way is the Lead Instructional Designer. David Lloyd is the Instructional Technologist /

Trainer. Louise Fechter and Susan Creasy serve as Instructional Design Support Specialists.There are five student assistants and two graduate assistants.

Methods

I used two methods of gathering data for this evaluation: interviews and survey data reports. I

interviewed Deborah Champion and Susan Creasy of the Center for Online Learning.

Information from the interviews was qualitative data, while the information from the survey

reports was quantitative.



Center Context and Goals

The Center for Online Learning provides “comprehensive design, management, and

administrative services for online learning at Georgia Southern University.” The center’s

mission is to “manage, enhance, and develop strategies and technologies for the online delivery

of courses.” (http://academics.georgiasouthern.edu/col/index.php). The center aims to do this in

a myriad of ways. The center offers trainings in online course design and faculty development as

well as providing students with an orientation for taking online courses. The center offers help

with GeorgiaView which is a Learning Management System currently used as Georgia Southern.

They offer assistance with using technologies such as Web 2.0, Wimba, html, and other online

course software tools. They assist faculty members in locating the proper technology to

effectively deliver online instruction.

The Center for Online Learning is a very important resource in a time of recession and budget

cuts in educational spending. Educational services can be offered at a lower cost to more

students via the online medium. Georgia Southern has gradually added more and more online

courses to their rosters. They currently offer a few fully online degrees including a new

Bachelors of General Studies and degrees in the education field including a Masters of

Instructional Technology.

Center Activities

http://academics.georgiasouthern.edu/col/index.php

http://academics.georgiasouthern.edu/col/index.php



The Center for Online Learning consists of three components. The first component is a

student worker operated call center. Any prospective student who has a question about online

courses calls the Center for Online Learning for assistance. The student operators must be well

trained and well versed in various aspects of online programs. If an operator does not know an

answer, they will route the caller to the appropriate place or find the answer.

The second component of the Center for Online Learning consists of trainings led by David

Lloyd. These trainings are offered every month and listed on the Georgia Southern Campus

Calendar. Mr. Lloyd offers trainings on how to use various aspects of the Learning Management

System GeorgiaView. He is also knowledgeable about higher end technology capabilities and is

available for questions and trainings about those sorts of things, too.

The final component of the Center for Online Learning involves training instructors on how

to teach in the online setting. A certain number of instructors must be selected to be a part of a

cohort of instructors who go through the training each semester. The training process starts

about six months to a year before an online class will actually go online. The cohort begins by

learning pedagogical learning theories and styles through an online course. This gives the

instructors the opportunity to have the students’ point of view. The instructors participate in

modules, do activities, and interact on the discussion board. As the instructors develop their

online courses, the Center for Online Learning is there for them to help guide the process.

Evaluation

After interviews and survey analysis, I conclude that the Center for Online Learning operates

successfully within the parameters of its mission. The survey feedback was overwhelmingly



positive. The Center offers several trainings each month to help faculty with GeorgiaView. The

Center is also very responsive to the needs of their cohorts.

Conclusions and Recommendations

Though the feedback was generally positive, based on the evaluation, there are some changes

that could be implemented in the Center for Online Learning. The workspace is very small and

could be expanded. The Center is also hidden away in the Nesmith Lane Building and could

have a bigger office in a more prominent building where one might expect to find this center.

Advertising of services would also benefit the COL. I have worked at Georgia Southern for

three and a half years and I only learned of the existence of this Center due to my pursuing a

degree in Instructional Technology.

The Center offers a myriad of trainings, but many of them are not online. More faculty

members could access these trainings if they were asynchronous. All faculty members would

not prefer an online environment for trainings, so there should be more flexibility in when the in-

person trainings are offered. The GeorgiaView trainings are normally offered on the same days

at the same times. Instructors have full class loads, office hours, and other responsibilities and

thus trainings should be offered on different days at different times to accommodate different

schedules. The trainings also often tend to cover the same topic. More training topics should be

covered and they should not focus solely on basic knowledge, but should also deliver

information on higher end technologies for those faculty members who have advanced

technological skills.

Technology Center Events / Highlights Spring Semester 2011



– Cohort training

January

May

– Georgia View Trainings :

January 24

9 AM GeorgiaView: Building a Learning Module

1:30 PM GeorgiaView: Image and File Editing

January 27

1:30 PM GeorgiaView: Assessments

February 1

9 AM GeorgiaView: Assignments and Safe Assign

February 7

1:30 PM GeorgiaView: Building a Learning Module

February 15

9 AM GeorgiaView: Assessments

1:30 PM GeorgiaView: The Buzz on Social Networking

February 21


February 22




February 23

9 AM GeorgiaView: Audio Visual Workshop

1:30 PM GeorgiaView: Grading and Grade Books

February 24


1:30 PM Image and File Editing

March 1

9 AM GeorgiaView: The Buzz on Social Networking


March 2

9 AM GeorgiaView: Grading and Grade Books

1:30 PM GeorgiaView: Selective Release and Other Advanced Features

March 15


1:30 PM GeorgiaView: The Buzz on Social Networking

March 16



9 AM GeorgiaView: Selective Release and Other Advanced Features


March 18


1:30 PM GeorgiaView: Discussions

March 21


March 29

9 AM GeorgiaView: The Buzz on Social Networking


March 30

9AM GeorgiaView: Grading and Grade Books

1:30 PM GeorgiaView: Selective Release and Other Advanced Features

March 31

3 PM GeorgiaView: Misc. Topics

April 1

1:30 PM GeorgiaView: Audio Visual Workshop

April 4





April 5

9AM GeorgiaView: Misc Topics

1:30 PM GeorgiaView: Audio Visual Workshop

April 12


9 AM GeorgiaView: Misc Topics


April 13



April 14

9 AM GeorgiaView: Discussions

1:30 PM GeorgiaView: Google Docs Inside GeorgiaView

April 18

9 AM GeorgiaView: Discussions

1:30 PM Image and File Editing

April 19

1:30 PM GeorgiaView: Misc Topics

April 22



April 26




1:30 PM Google Docs Inside GeorgiaView

May 3

9 AM GeorgiaView: Google Docs Inside GaView

1:30 PM Assignments and Safe Assign

May 4



May 9

9 AM GeorgiaView: Grading and Grade Books1:30 PM GeorgiaView: Discussions

May 12



Appendices

Appendix A: Faculty Survey

1. Have you received services from the Center for Online Learning this semester?

Yes



No

2. For what have you received or requested assistance?

3. Please estimate the number of times you have requested assistance from the

Center for Online Learning?

4. On a scale of 1-5, 5 being MOST effective and 1 being LEAST effecive, please

rate the effectiveness of the services you received from the Center for Online

Learning.

1

2



3

4

5

5. The Center For Online Learning's mission statement is to "manage, enhance,

and develop strategies and technologies for the online delivery of courses."

Please rate the Center on how they are achieving their mission with 1 being I Do

Not Agree and 5 being I Strongly Agree that they are achieving their mission.

1

2

3

4

5

6. What aspect of the Center for Online Learning do you most like?

7. If you could change or improve any aspect of the Center for Online Learning,

what would you do?



Appendix B: Survey Results

1. Have you received services from the Center for Online Learning this semester?

Yes

. No

87.1% Yes

12.9% No

2. For what have you received or requested assistance?

Designing and/or adopting online courses

4/9/11 4:06AM

Online course development

4/9/11 4:10AM

Development of an online class

4/9/11 4:13AM

Training for preparing for an online class.

4/9/11 4:22AM

Online course

4/9/11 4:25AM

questions about GAView

4/9/11 4:25AM

Cohort



4/9/11 4:39AM

last semester I received training in online course development.

4/9/11 4:49AM

Cohort training for online course development

4/9/11 4:52AM

Online course development

4/9/11 6:18AMAnswers and help for solving certain problems that occasionally come up with my online course.

4/9/11 6:27AM

Course development

4/9/11 6:36AM

GAView, podcasting, multimedia functions

4/9/11 7:21AM

Course development

4/9/11 6:08PM

Online course templates, design consulting, new apps.

4/9/11 7:33PM

The COL has helped me with learning the LMS since it is different from the one I left at my old school. They have

also helped connect me with others on campus who are also designing online courses.

4/10/11 1:20AM

Guidance with finishing up the online course being offered in the summer.

4/10/11 11:14PM

Does it include phone calls as well? Without phone calls for quick questions, I received assistance on how to make

modules.

4/11/11 12:10AM

training to develop an online class

4/11/11 1:05AM

Preparing a class

4/11/11 3:42AM

Online course development.

4/11/11 6:03AM

online course preparation4/11/11 6:21AM

Course development using GeorgiaVIEW

4/11/11 11:13AM

developing an online course

4/11/11 9:23PM

Instructions on how to copy a learning module

4/11/11 10:04PM

I'm adopting an online class

4/12/11 12:41AM

georgiaview technical, assistance with google apps, assistance with course structure

4/12/11 5:38AM

for teaching my FRCT 7130 class

4/12/11 8:33PM

For the mainetenance of online course that I developed last summer.

4/12/11 10:19PM

Online class help - GaVIew.

4/13/11 1:32AM V

Online course development and training

4/13/11 2:54AM



3. Please estimate the number of times you have requested assistance from the

Center for Online Learning?

Three

4/9/11 4:06AM

4

4/9/11 4:10AM

5

4/9/11 4:13AM

104/9/11 4:22AM

Attended several learning sessions (2-3).

4/9/11 4:25AM

5

4/9/11 4:25AM

10

4/9/11 4:39AM

none really. Had to go through with it to make an online course.

4/9/11 4:49AM

3

4/9/11 4:52AM

4

4/9/11 6:18AM

Numerous

4/9/11 6:27AM

Six

4/9/11 6:36AM

10

4/9/11 7:21AM

Six

4/9/11 6:08PM

What's the time frame? This semester? (need to be explicit in the question) 6-7 times . . . or, if you need one whole

number (be explicit), make it 7 . . . .

4/9/11 7:33PM

44/10/11 1:20AM

2-3

4/10/11 11:14PM

My Answer: I received and requested assistance about 10 times for the last 8 years. However, received about 4

times for the last 12 months. It would be nice to have these as a multiple choice question.

4/11/11 12:10AM

3

4/11/11 1:05AM



10

4/11/11 3:42AM

0

4/11/11 6:03AM

2

4/11/11 6:21AM

5 - 104/11/11 11:13AM

it was a course

4/11/11 9:23PM

1

4/11/11 10:04PM

This semester? Maybe a dozen times

4/12/11 12:41AM V

500+

4/12/11 5:38AM

5

4/12/11 8:33PM

2

4/12/11 10:19PM

5

4/13/11 1:32AM

15-20

4/13/11 2:54AM

4. On a scale of 1-5, 5 being MOST effective and 1 being LEAST effective, please

rate the effectiveness of the services you received from the Center for Online

Learning.



1

2

3

4

5

ResponsePercent

1 3.3%

2 3.3%

3 6.7%

4 30.0%

5 56.7%



5. The Center For Online Learning's mission statement is to "manage, enhance, and

develop strategies and technologies for the online delivery of courses." Please rate

the Center on how they are achieving their mission with 1 being I Do Not Agree and

5 being I Strongly Agree that they are achieving their mission.

1

2

3

4

5

ResponsePercent

1 0.0%

2 3.2%

3 6.5%

438.7%

551.6%



6. What aspect of the Center for Online Learning do you most like?

The staff!

4/9/11 4:06AM

The organization, friendliness, well conceived tasks, knowledge of the staff.

4/9/11 4:13AM

COL has a template driven course prep objective. This means that it is readily applicable to other courses. In addition,

the COL strives to relate the online course structure to learning taxonomies such as Bloom's. In addition, the COL is

quick in response and clear in their directions.

4/9/11 4:22AM

Tips and tools for online teaching.

4/9/11 4:25AMtraining and individual help - David Lloyd, Rowley, and Lou are very knowledgeable and helpful

4/9/11 4:25AM

friendly peeps

4/9/11 4:39AM

They seem to be organized.

4/9/11 4:49AM

Personalized help, especially from David Lloyd.

4/9/11 4:52AM

Their promptness to questions and complaints, their knowledge and expertise, and their friendliness.

4/9/11 6:27AM

The people I worked with were great, especially Jessica.

4/9/11 6:36AM

Staff responsive and accommodating.

4/9/11 6:08PM

Responsiveness, willing to think out of the box with me, most of the time. (BTW, in Q#5, second sentence, the pronoun

should be "its" and not "they."

4/9/11 7:33PM

The friendliness and availability of staff.

4/10/11 1:20AM

Willingness to help

4/10/11 11:14PM



They do have people who know the materials. They are putting new available programs for the faculty.

4/11/11 12:10AM

the folks are COL are very helpful and competent

4/11/11 1:05AM

Consistent helpfulness and patience

4/11/11 3:42AM

Good people.4/11/11 6:03AM

short courses course templates peer interaction

4/11/11 6:21AM

Calling for help and receiving it - voice contact with someone

4/11/11 11:13AM

Friendly people who know what they are doing

4/12/11 12:41AM

accesability and helpfulness of staff, I like the training classes as well

4/12/11 5:38AM

Readiness to help. I wish I knew more exactly when is the best time to come to them....

4/12/11 8:33PM

The staff are very friendly and everyone is assigned a personal assistant. They answer all our questions to our

satisfaction, no matter how silly the question might be.

4/12/11 10:19PM

The people are very knowledgeable and friendly.

4/13/11 1:32AM

The personal attention combined with quality asynchronous work that I can do and read through on my own. Their

quick responsiveness; their ability to anticipate questions and problems.

4/13/11 2:54AM

7. If you could change or improve any aspect of the Center for Online Learning,

what would you do?

For the CATS and COL to combine

4/9/11 4:06AM

Nothing that I can think of except perhaps give them larger quarters.

4/9/11 4:13AM

Improvements might be locally stationed course advisors. In addition, a management by walking around style - by

being on site and always inquiring of the online courses, they could be more proactive and provide more pressure for

people (such as me) to complete their tasks.

4/9/11 4:22AM

Would prefer instruction to be online via webinar or wimba.

4/9/11 4:25AM

Move it to a better location

4/9/11 4:39AM



Don't talk down to people. And quit with the power trips.

4/9/11 4:49AM

Customize online training by type of course and give more time for course development.

4/9/11 6:18AM

Nothing, it's great just the way that it is.

4/9/11 6:27AM

I think it would be beneficial to have a vocabulary list with definitions so that the non-techie could actually understandwhat the techie is saying. Most of the difficulties I have had revolved around terminology.

4/9/11 6:36AM

I would like to see all involved parties in one location.

4/9/11 7:21AM

Scheduling flexibility, day of the week course offerings could be more varied. Individual courses are often scheduled for

the same day of the week. Thus, a recurring conflict precludes taking the course.

4/9/11 6:08PM

Higher physical profile, accessibility, not hidden in Nesmith-Lane cubicles. . . . .

4/9/11 7:33PM

Have the second level and third level of the COL online learning program be more advanced than the first level. There's

really no point in going through the same level of training three times. Maybe in the next level, there could be more in

terms of pedagogical dynamics of teaching online, engaging online learners, etc.

4/10/11 1:20AM

Scheduling. Sometimes the same available training is on the same day. One who can't attend a wed training never has

a chance to attend this training. We need higher level for technically savvy instructors.

4/11/11 12:10AM

the opening training is sort of inefficient. I am not interested in learning about pedagogical matters from COL, I am

merely interested in the nuts and bolts of an online class

4/11/11 1:05AM

One size does not fit all when it comes to online course development. I'd like to see more flexibility in LMSs.

4/11/11 6:03AM

make all courses read-only to all faculty at georgia southern

4/11/11 6:21AM

not sure

4/11/11 11:13AMIt's not their fault, but streamlining every course for looks and using gaview isn't the most effective way to design

courses.

4/11/11 9:23PM

I think they are probably doing the best they can with the technology they are using

4/12/11 12:41AM

more 'Mini" workshops about online teaching: getting students involved in the learning process etc.

4/12/11 5:38AM

overall good job!

4/12/11 8:33PM

I cannot think of any improvement. It is already very good.

4/12/11 10:19PM

There was a workshop that they brought to campus that looked very interesting but the hours were limited and

conflicted with my schedule. So my suggestion would be to have things like that offered at a greater variety of times.

4/13/11 1:32AM

Pay them more! They deserve great salaries!

4/13/11 2:54AM



Documents

Melissa Merritt 2011 Program Eval Doc