WPD2.2 Staff capacity building programmecompeten-sea.eu/wp-content/uploads/2018/04/WPD2.2... · MOOC-based educational services through three dimensions: (1) acquisition of technological

COMPETEN-SEA Capacity to Organize Massive Public Educational Opportunities in Universities of Southeast Asia

(574212-EPP-1-2016-1-NL-EPPKA2-CBHE-JP)

WPD2.2

Staff Capacity Building Programme

Universidad Carlos III de Madrid March 2018

2

TABLE OF CONTENTS 1. INTRODUCTION .................................................. 32. SCHEDULE AND RESOURCES FOR THE WORKSHOPS ........................ 43. PARTICIPANTS ................................................. 144. RESULTS...................................................... 165. CONCLUSIONS .................................................. 29ANNEX I ........................................................ 30

3

1. INTRODUCTION

Deliverable WPD2.2 “Staff Capacity Building Programme” is part of work package 2

(WP2), “Development: Capacity Building Programme”, whose objective is to

significantly increase the capacity of the Partner Universities in Malaysia, Indonesia

and the Philippines to design, develop, deliver and evaluate various types of

MOOC-based educational services through three dimensions: (1) acquisition of

technological infrastructure, (2) upgrade of knowledge and skills of teaching and

technical staff, and (3) definition of administrative procedures allowing service

provision for outreach. The results of the feasibility study on MOOCs for Southeast

Asia (see WPD1.1), and the local contexts of the three partner countries and six

partner Universities lead the building of capacities on the three aforementioned

dimensions. This deliverable presents the results of the workshops which took

place in Malaysia, Indonesia and the Philippines from November 2017 to February

2018, and whose aim was to upgrade the knowledge and skills of local teaching and

technical staff.

Three workshops of three days each were held in Malaysia, Indonesia and the

Philippines. The dates of these workshops are detailed in the following table.

Number Dates Location

1 November 6-8, 2017 Penang (Malaysia)

2 January 10-12, 2018 Manila/Pangasinan (Philippines)

3 February 12-14, 2018 Malang (Indonesia)

Table 1. Dates and locations of the workshops

4

2. SCHEDULE AND RESOURCES FOR THE WORKSHOPS The agendas for the three workshops are shown below, as well as the links to the

materials used in each of the workshops.

Malaysia COMPETEN-SEA Capacity Building

(http://competen-sea.eu/workshop-malaysia/)

November 6-8, 2017 Dewan Persidangan Universiti (DPU)

Chancellory building C22 Universiti Sains Malaysia 11800 Penang, Malaysia

Monday, November 6, 2017

TIME ACTIVITY

8:30 – 8:50 Registration

8:50 – 9.00

Arrival of The Honourable Prof. Dr. Ahmad Farhan Bin Mohd Sadullah Deputy Vice-Chancellor (Academic & International)

9:00 – 9:05 Negaraku and Menara Ilmu

9:05 – 9:10 USM corporate video

9:10 – 9:15 Welcoming Speech by the Director National Advanced IPv6 Centre Of Excellence, Professor Dr. Rosni Abdullah

9:15 – 9:45 Opening Speech by the Deputy Vice-Chancellor (Academic & International), Professor Dr. Ahmad Farhan Bin Mohd Sadullah

9:45 – 10:00 Photo session & Tea Break

5

10:00 – 11:30

Session 1: Presentation of the Project and status of MOOCs • Presentation of COMPETEN-SEA (OUNL) • Context and status of MOOCs (UC3M) • Feasibility study applied to the local country with the

vision and policy context (USM)

11:30 – 13:00 Session 2: Instructional Design Basics (USAAR)

13:00 – 14:00 Lunch break

14:00 – 15:30

Session 3: Producing a MOOC in Open edX (UC3M) • What is Open edX? • CMS (Studio) • LMS

15:30 – 15:45 Coffee/Tea break

15:45 – 17:30 Session 3: Producing a MOOC in Open edX (UC3M) (continued)

• Hands-on workshop – exploring an already implemented MOOC on the Open edX platform

Tuesday, November 7, 2017

TIME ACTIVITY

9:00 - 10:30 Session 1: Motivational Design (USAAR)

• MOOC-specific design challenges and learners’ autonomy


10:45 – 12:30 Session 2: E-moderating (USAAR)


6

14:00 – 15:45

Session 3: Microdesign in edX (UC3M) • Video • Best practices for video production • Phases of video production • Speaking in front of the camera • Copyright issues


16:00 - 17:30

Session 3: Microdesign in edX (UC3M) (continued) • Problem-types in edX • Formative and summative activities • Communication with learners • Social tools • Community building

Wednesday, November 8, 2017

TIME ACTIVITY

9:00 - 10:30 Session 1: Learning analytics and evaluation (OUNL)

• Learning analytics and evaluation, Ethics (led by OUNL + others)


10:45 – 12:30 Session 1: Learning analytics and evaluation (OUNL) (continued)


14:00 – 16:00

Session 2: The role of the university (U3CM lead, all partners contribute)

• Management of a MOOC project within an institution (setting up a supporting unit)

• Evaluation of the training and feedback (all)


7

16:15 – 17:30

Session 3: Business modelling and business planning for MOOCs development (GIRAF)

• Initial business modelling with Osterwalder Business Model Canvas

• SWOT analysis for projects on MOOC development • Stakeholders mapping and profiling • Costs/revenues analysis • Structure of the MOOC business plan • User-oriented marketing strategy

8

Philippines COMPETEN-SEA Capacity Building (http://competen-sea.eu/workshop-in-the-philippines-january-2018/)

January 10-12, 2018 University of the Philippines System and

Ateneo de Manila University-Institute of Philippine Culture Katipunan Ave, Quezon City, 1108 Metro Manila, Philippines

In collaboration with the Provincial Government of Pangasinan Pangasinan Training and Development Center,

Maniboc, Lingayén, Pangasinán, Philippines

Wednesday, January 10, 2018

TIME ACTIVITY

8:45 – 9:30

Opening Program with National Partners • Welcome Remarks from AdMU, UP and EU representative • Opening remarks from OUNL, project lead • Presentation of AdMU IPC publication to project partners • Ceremonial MOA signing with DOH • Group Photo

9:30 – 10:30

Session 1: Presentation of the project and status of MOOCs • Presentation of Competen–SEA (OUNL) • Context and status of MOOCs (UC3M) • Feasibility study applied to the local country with the

vision and policy context (AdMU PHL-Dr. Marita Concepcion Castro Guevara)


11:00 – 12:30

Session 2: The role of the university (U3CM lead, all partners contribute)

• Management of a MOOC project within an institution (setting up a supporting unit)


9

13:15 – 14:45

Session 3: Business Model for MOOCs (GIRAF) • Initial business modelling with Osterwalder Business

Model Canvas • SWOT analysis for projects on MOOC development • Stakeholders mapping and profiling • Costs/revenues analysis • Structure of the MOOC business plan • User-oriented marketing strategy

14:45 - 15:00 Coffee/Tea break

15:00 – 19:30 Travel to Pangasinan

Thursday, January 11, 2018

TIME ACTIVITY

8:45 - 9:30

Opening Program with Local Partners • Welcome Remarks from AdMU, UP and EU representative • Welcome Remarks by Gov. Amado Espino, Governor of

Pangasinan • Opening remarks from OUNL, project lead • Presentation of AdMU IPC publication to project partners • Ceremonial MOA signing with DOH • Group Photo

9:30 – 10:30

Session 1: Instructional design basics (USAAR and AdMU) • Analyses and macrodesign (procedures, tools) (USAAR) • Discussion on the advance materials provided • Presentation of the Philippine MOOC Design Concept Map

(AdMU PHL- Dr.Dennis Batangan)


11:00 – 12:30

Session 2: Microdesign (USAAR) • MOOC-specific design challenges and learners’ autonomy • Presentation of the Prototype Philippine MOOC for Rural

Health Workers of Pangasinan province (UP Prof. Peter Sy)


10

13:15 – 14:45

Session 3: Learning analytics and evaluation challenges (OUNL)

• Application of data-driven approaches and learning analytics in (open) education

• Evaluation challenges for MOOCs

14:45 - 15:00 Coffee/Tea break

15:00 – 17:30

Session 4: Producing a MOOC in Open edX (U3CM) • Introduction to Open edX • Instructions on the exercises • Expected outputs from the exercises

Friday, January 12, 2018

TIME ACTIVITY

8:45 - 9:30

• Recap of Day 1 and Day 2 • Review of the schedule for Day 2 • Proposed coordination process after the training • Schedule of the COMPETEN-SEA project activities for 2018

and 2019 • Instructions on the evaluation of the training program

9:30 – 10:30

Session 1: Microdesign in edX (UC3M) • Video • Best practices for video production • Phases of video production • Speaking in front of the camera • Copyright issues


11:00 – 12:30



13:15 – 18:00 Travel back to Manila

11

Indonesia COMPETEN-SEA Capacity Building (http://competen-sea.eu/workshop-in-indonesia-february-2018)

February 12-14, 2018 Ruang mc 1.1, Lantai 1

Fakultas mipa Gedung mipa center

Universitas Brawijaya Malang Malang, Jawa Timur 65145, Indonesia

Monday, February 12, 2018

TIME ACTIVITY

11:30 – 12:00 Registration


13:30 – 14:00

Opening Ceremony: • Welcoming Speech by Dr. Achmad Basuki • Opening Speech by Vice Rector UB on Academic Affairs,

Prof. Dr Ir. Kusmartono • Photo Session

14:00 – 15:30

Session 1: Presentation of the project and status of MOOCs • Presentation of COMPETEN–SEA (OUNL) • Context and status MOOCs (UC3M) • Feasibility study applied to the local country with the

vision and policy context (UB and UNSRAT)

15:30 – 16:30

Programs and policies of the Ministry of Research and Technology and Higher Education on applying hybrid/blended learning system (Dr. Paristiyanti Nurwardani, Director of Learning)


16:45 – 17:30 Session 2: Instructional Design Basics (USAAR)

12

Tuesday, February 13, 2018

TIME ACTIVITY

8:30 – 10:00 Session 1: Instructional Design Basics (USAAR) (continued)


10:15 – 11:45 Session 2: Producing a MOOC in Open edX (UC3M) • What is Open edX • CMS and LMS


12:45 – 14:15 Session 2: Producing a MOOC in Open edX (UC3M) (continued)

• Hand-on workshop: exploring an already implemented MOOC on the Open edX platform

14:15 – 15:45 Session 3: Motivational Design (USAAR)


16:00 – 17:30 Session 4: E-moderating (USAAR)

Wednesday, February 14, 2018

TIME ACTIVITY

8:30 – 10:00

Session 1: Microdesign in edX (UC3M) • Best practices for video production, • Phases of video production • Speaking in front of the camera • Copyright Issues


13

10:15 – 12:00



13:00 – 15:00 Session 2: Learning Analytics and evaluation (OUNL)

• Learning analytics and evaluation, Ethics • Quality Assurance


15.15 – 16:45

Session 3: Business modelling and business planning for MOOCs development (GIRAF)

• SWOT analysis for projects on MOOC development • Stakeholders mapping and profiling • Costs/revenues analysis • Structure of the MOOC business plan

16:45 – 17:30 Closing Ceremony

14

3. PARTICIPANTS

The total number of participants in the three workshops was 264, including 88

attendees in the workshop in Malaysia, 86 attendees in the workshop in the

Philippines, and 90 attendees in the workshop in Indonesia.

The following tables show the distribution by category and gender, indicating if

they are part of Higher Education Institutions (HEI) or not.

Participants in Penang (Malaysia), November 6-8, 2017:

Males Females Total by category

Academic staff from partner country HEI

25 34 59

Non-academic staff from partner country HEI

7 10 17

Staff from partner country non-HEI

7 5 12

TOTAL 39 49 88

Table 2. Participants in the workshop in Malaysia

Participants in Manila/Pangasinan (Philippines), January 10-12, 2018:



9 6 15


6 5 11


34 26 60

TOTAL 49 37 86

Table 3. Participants in the workshop in the Philippines

15

Participants in Malang (Indonesia), February 12-14, 2018:



47 21 68


11 9 20


1 1 2

TOTAL 59 31 90

Table 4. Participants in the workshop in Indonesia

16

4. RESULTS

After each workshop, participants had the opportunity to complete a short survey

with 10 questions about the training received. In total, 79 participants completed

the survey. This information is of great value for knowing the immediate impact

achieved, as well as for getting feedback to improve local training in the future.

The results obtained for each of the questions are shown below. Comparing the

results obtained from the three workshops, the following findings are obtained.

1) The main method through which the attendees of the workshop in Malaysia

knew about the event was by e-mail, with a 66% informed through this method.

Regarding the workshop in the Philippines, the majority of the attendees got to

know the event through the word of mouth. The Indonesian workshop was more

effectively promoted through WhatsApp groups.

2) All those attending the sessions were satisfied or very satisfied with the training

received. The best results were obtained for the event in Indonesia, where 55.6%

of participants assessed their satisfaction with the workshop with the highest score

(5 points), and 38.9% awarded 4 points out of 5. All those attending the event in

the Philippines gave 4 points or above, while in the workshop held in Malaysia

87.1% of the participants gave 4 points or above.

Figure 1. Participants’ satisfaction level in the workshop in Malaysia

17

Figure 2. Participants’ satisfaction level in the workshop in the Philippines

Figure 3. Participants’ satisfaction level in the workshop in Indonesia

3) All those attending the workshops considered that the training received was

useful, quite useful or very useful for their work. The best results were obtained in

the workshop held in the Philippines where 72.7% of the attendees awarded the

highest score, considering the training very useful and relevant for their work.

18

Figure 4. Usefulness and relevance for the work of attendees to the workshop in Malaysia

Figure 5. Usefulness and relevance for the work of attendees to the workshop in the

Philippines

Figure 6. Usefulness and relevance for the work of attendees to the workshop in Indonesia

19

4) The key takeaways of the event reported by the attendees in the workshop of

Malaysia were mainly Design and development of MOOCs (54%), and Using the

Open edX platform (29%).

Figure 7. Key takeaways of the event reported by the attendees in the workshop in

Malaysia

Likewise, the key takeaways for the attendees in the workshop of the Philippines

were mainly the Design and development of MOOCs (55%), and Application of

MOOCs to develop continuing education programs for health workers (36%).

Figure 8. Key takeaways of the event reported by the attendees in the workshop in the

Philippines Finally, the key takeaways indicated after the event in Indonesia were mainly the

Design and development of MOOCs (36%), and Making e-learning effective (36%).

20

Figure 9. Key takeaways of the event reported by the attendees in the workshop in

Indonesia

5) Concerning logistics, the best satisfaction rates were obtained for the venues

selected, especially in the workshop in Malaysia, and the Food & Beverages offered

in the workshop in the Philippines and Indonesia. Communication emails also

obtained a high rating in Malaysia.

Figure 10. Satisfaction rates (1=Very dissatisfied, 5=Very satisfied) on the logistics in the

workshop in Malaysia

21


workshop in the Philippines


workshop in Indonesia

22

6) The majority of the attendees considered that the logistics and organization of

the events were correct. However, while some suggested a longer duration of the

workshop, other attendees preferred to concentrate it in two intensive days

instead of in three. Some comments and suggestions on the logistics and

organization from the participants of the three workshops are as follows.

Workshop in Malaysia:

- “Will be better to concentrate the workshop in 2 days”

Workshop in the Philippines:

- “Make the Wi-Fi faster”

Workshop in Indonesia:

- “We need more days, I think, to learn more about some technical

necessities on producing learning materials for MOOCs, such as, video

production etc.”

- “The venue could be located on an out-of-campus area to gain full

attendance of the participants”

23

7) Attendees considered that the most relevant sessions during the workshop of

Malaysia were: 4. Exercises - Hands-on with Open edX, 6. E-moderating and 8. Part

1: Learning analytics and evaluation, where 28 of the 39 participants who

responded the survey found these sessions very relevant.

Figure 13. Session relevance during the workshop in Malaysia

From Left to Right:

1. (Day 1) Part 1: Presentation of the project and status of MOOCs 2. (Day 1) Part 2: Instructional Design Basics (USAAR) 3. (Day 1) Producing a MOOC in Open edX (UC3M) 4. (Day 1) Exercises - Hands-on with Open edX (UC3M) 5. (Day 2) Part 1: Motivational Design (USAAR) 6. (Day 2) E-moderating (USAAR) 7. (Day 2) Part 2: Microdesign in edX (UC3M) 8. (Day 3) Part 1: Learning analytics and evaluation (OUNL) 9. (Day 3) Part 2: The role of the university (UC3M and others) 10. (Day 3) Business modelling and business planning for MOOCs development (GIRAF)

24

Attendees to the workshop in the Philippines considered that the most relevant

sessions were: 6. Learning analytics and evaluation, 7. Producing a MOOC in Open

edX, and 8. Microdesign in edX, where at least 18 of the 20 attendees who

responded the survey considered these sessions very relevant.

Figure 14. Session relevance during the workshop in the Philippines

From Left to Right:

1. (Day 1) Presentation of the project and status of MOOCs 2. (Day 1) The role of the university 3. (Day 1) Business modelling and business planning for MOOCs development (GIRAF) 4. (Day 2) Instructional Design Basics (USAAR) 5. (Day 2) Microdesign (USAAR) 6. (Day 2) Learning analytics and evaluation (OUNL) 7. (Day 2) Producing a MOOC in Open edX (UC3M) 8. (Day 3) Microdesign in EdX (UC3M)

25

Likewise, attendees considered that the most relevant sessions during the

workshop in Indonesia were: 3. Producing a MOOC in Open edX, 4. Exercises -

Hands-on with Open edX and 5. Motivational Design, where at least 13 of the 18

attendees who responded the survey found these sessions very relevant.

Figure 15. Session relevance during the workshop in Indonesia

From Left to Right

1. (Day 1) Presentation of the project and status of MOOCs 2. (Day 1 and 2) Instructional Design Basics (USAAR) 3. (Day 2) Producing a MOOC in Open edX (UC3M) 4. (Day 2) Exercises - Hands-on with Open edX (UC3M) 5. (Day 2) Motivational Design (USAAR) 6. (Day 2) E-moderating (USAAR) 7. (Day 3) Microdesign in EdX (UC3M) 8. (Day 3) Learning analytics and evaluation (OUNL) 9. (Day 3) Business modelling and business planning for MOOCs development (GIRAF)

26

8) All the attendees who responded the surveys were satisfied, quite satisfied or

very satisfied with the content of the sessions. The majority of the participants

marked “Quite satisfied”, in each workshop.

Figure 16. Content satisfaction rate in the workshop in Malaysia

Figure 17. Content satisfaction rate in the workshop in the Philippines

Figure 18. Content satisfaction rate in the workshop in Indonesia

27

9) Most of the attendees agreed on how interesting the sessions were and the

quality of the material used. However, some suggestions made were:

Workshop in Malaysia:

- “Showing real examples of assessments in MOOC”

- “Could have a set induction and an overall snapshot of the general steps;

i.e. the ADDIE could be introduced first and work from the Analysis

component to set the stage.”

- “Subsequent workshop on micro aspect of MOOC”

- “Suggestion of video production hands-on session”

- “More hand-on on using Open edX”

Workshop in the Philippines:

- “We can perhaps make it more relevant with the audience by discussing

the main key points and components for the MOOCs and exercises on

which the audience will have to think of an appropriate MOOCs course

for their profession”

Workshop in Indonesia:

- “Since the title of the event is very specific about the MOOC training

being intended for the rural community project, it would have been

better if the presentations were contextualized or at least related to the

project. The training was for "standard" MOOC implementation, but I

think given the context of the project, the implementers will have to do

a lot of tweaking for the program to be effective.”

- “Please consider the schedule of the event to ensure full attendance of

the participants”

28

10) The attendees were grateful for the realization of these events, highlighting

the quality of the workshops and lectures, and also made the following comments:

Workshop of Malaysia:

- “Hoping to have more hands-on”

- “A very comprehensive workshop that covers everything on MOOC -

concept, design, development, management, implementation and

evaluation”

- “Lively, hands-on, relevant, practical, useful”

- “Hopefully there will be another session focusing only on content

development in edX”

Workshop in Philippines:

- “Having some ice breakers (dance/stretching) in between, most

especially during the holy hour”

- “I definitely enjoyed the event however I had hard times understanding

the accent of the other speaker, but I really love this informative

discussion”

Workshop of Indonesia:

- “Workshop like this should be carried out more frequently, with

different participant, for lecture and for the leader of the University”

- “There should be a further workshop focusing on the hands-on examples

and activities on how MOOC is used”

29

5. CONCLUSIONS

This report compiles the organizational information of each of the training events

carried out in Malaysia, the Philippines and Indonesia, and presents the results

obtained based on the surveys completed by the attendees after the workshops,

confirming the interest and success of the Staff Capacity Building activities.

Training has been provided to staff of the six institutions in South-East Asia that

have participated in the project. Representatives of the respective institutions

who attended the workshops will organize local training based on the materials

used during the three workshops in those places which were not been visited by

the European partners (Manado in Indonesia and Kota Samarahan/Kuching in

Malaysia).

In addition, training workshops in Malaysia and Indonesia have been recorded so

that they can be reviewed and subsequently consulted by partners and staff of

other interested institutions.

30

ANNEX I COMPETEN-SEA Capacity Building: Designing MOOCs -- Event feedback (Malaysia) * Required 1) Where do you first hear about this program? *

E.g FB, Personal email, email list, WhatsApp message/group, word of mouth, website, etc -----------------------------------------------------------------------

2) How satisfied were you with the event? *

3) How relevant and helpful do you think it was for your job? *

4) What were your key take aways from this event? * Text of short answer

--------------------------------------------------------

31

5) How satisfied were you with the logistics? *

6) Additional feedback on logistics*

Text of short answer

--------------------------------------------------------

7) Which sessions did you find relevant to you? *

32

8) How satisfied were you with the session content? *

9) Any additional comments regarding the sessions or overall agenda? *


--------------------------------------------------------

10) Any overall feedback for the event? *


--------------------------------------------------------

11) Name (optional)


--------------------------------------------------------

33

COMPETEN-SEA Capacity Building: Designing MOOCs -- Event feedback (Philippines)

* Required 1) Where do you first hear about this program? *

E.g FB, Personal email, email list, WhatsApp message/group, word of mouth, website, etc -----------------------------------------------------------------------



4) What were your key take aways from this event? *


--------------------------------------------------------

34




--------------------------------------------------------


35




--------------------------------------------------------



--------------------------------------------------------

11) Name (optional)


--------------------------------------------------------

36

COMPETEN-SEA Capacity Building: Designing MOOCs -- Event feedback (Indonesia) * Required 1) Where do you first hear about this program?

E.g FB, Personal email, email list, WhatsApp message/group, word of mouth, website, etc Text of short answer

-----------------------------------------------------------------------



4) What were your key take aways from this event? *


--------------------------------------------------------

37




--------------------------------------------------------


38




--------------------------------------------------------



--------------------------------------------------------

11) Name (optional)


--------------------------------------------------------

Documents

WPD2.2 Staff capacity building programmecompeten-sea.eu/wp-content/uploads/2018/04/WPD2.2... · MOOC-based educational services through three dimensions: (1) acquisition of technological