‘DIGITAL MEDIA TRAINING’ PROJECT EVALUATION REPORT

MARCH 2015

This report was produced by Carolina de Oteyza from GAP Unit

The evaluation was commissioned by the Community Audit and Education Centre

of Manchester Metropolitan University.

Manchester, March 2015

Acknowledgements

We would like to acknowledge all the people who have contributed in different ways

to this evaluation and the compilation of this report.

We want to thank, in particular, the project coordinator Tony Reeves and all the

participants of the project who agreed to share their views and opinions with all

honesty, as well as to be interviewed and surveyed. We are very grateful for their

invaluable contribution.

Table of Contents

Introduction

Project Description

Evaluation Process

Participants’ views

Conclusions and Recommendations

2

3

4

5

13

2

Introduc�onThe ‘Digital Media Training Project’, funded by an European Social Fund

Community Learning Grant, was a 6-month project run by First Cut Media

& Performing Arts in Hulme, Manchester.

The project ran from September 2014 to February 2015 and aimed

to work with 15 local people helping them to gain confidence and skills

in digital audio-visual production, scriptwriting and vocational training. It

additionally provided advice and guidance on further education and the

media industry.

Manchester Metropolitan University, a project partner, commissioned GAP

Unit to carry out an evaluation of the ‘Digital Media Training Project’. The

purpose of the evaluation was to asses the achievement of the training from

the perspective of the participants.

The evaluation explored the impact of the courses delivered and how they

were perceived by training participants; their views were the main

component of the evaluation.

This report encloses the main findings of the evaluation. Overall the

participants had a highly positive view of the project, which exceeded their

expectations, and considered they had gained confidence, achieved

important learning outcomes and acquired useful skills. They all would have

wanted a longer course that would allow them to go further in their learning

process, “It left me wanting more”.

“For someone who has little or no knowledge but is interested infilming this course is ideal. Taught very well and set good

foundations to progress the correct way!”

“I have learnt lots of new things, very informative, yet easy to digest”

“I have found the course to be inspiring. I am more confident usinga camera. I believe I have gained a creative eye”

“Get on it! Quick time �I would do it again!”

3

AimsThe project aimed to provide digital media training and personal support to

people with no formal qualifications or who have been unemployed long

term, so they develop skills, learn techniques and build confidence that will

enable them to advance their search for jobs, further education and

training, apprenticeships or voluntary work.

CoursesThe project provided 3 different but interconnected training courses:

Scriptwriting, Video Production Techniques and Digital Post-production

Techniques. These courses were delivered over 23 weeks from September

2014 to February 2015. A total of 36 4-hour sessions were run over the 6

month period. During that time, advice, support and one-to mentoring was

also provided.

The trainees were encouraged to enrol on all three subject areas, but this

was not compulsory, so they could choose to do all three, two or one

subject.

At the end of the project, the films produced by the participants were

presented at the MMU campus in Hulme to an audience of MMU

Students, family and friends.

Despite the high quality of the training, the courses were not formally

accredited. Participants received First Cut/WFA/MMU certificates of

achievements.

Par�cipants17 local people registered and attended the courses. The majority (15) were

male and most of them were from Black community origin. Their previous

education and levels of important prior knowledge and skills varied widely.

TutorsThe courses were delivered by qualified and experienced tutors whose

knowledge, expertise, dedication, professionalism and continuous advice

were highly appreciated by the participants.

PartnersFirst Cut Media & Performing Arts developed and maintained good and

positive partnership links with MMU Community Audit and Education

Centre, the Workers Film Association, Moon Vision Media and other local

providers. The WEA ESF Grants Team supported the overall organisation

of the project, guiding the team through the financial and administrative

requirements.

Project descrip�on

4

Evalua�on process The main purpose of this qualitative evaluation was to asses the

achievement of the objectives of the project and the impact that the

training had on participants in terms of their reactions and learning.

The views and perspectives of the different partners and participants were

the main component of the evaluation. A variety of oral and written,

individual and group methods were used during the evaluation process.

Feedback/evaluation data was gathered prior to, during and after the

delivery of the courses.

Prior to the course:An evaluation session using participatory techniques was held at the

beginning of the project. Participants were asked about their expectations

for the course and what they hoped to learn. Information about their

previous knowledge and experience and their level of confidence was also

gathered at this session.

During the training:Open-ended questions on questionnaires allowed respondents to talk about

their thoughts, opinions and feelings in their own words. Individual

Learning Plan forms (ILPs), provided by the ESF Community Learning

Grants team, were also filled by the participants at the beginning, middle

and end of the project. These forms enabled measuring the participants’

progress and helped record some of the participant’s perceived

achievements as a result of the training. Group evaluation discussions held

during the project helped to go more in depth in certain aspects.

End of training evaluation:A more detailed evaluation of the course, written and oral, was completed

at the end of the project. Achievements of expectations, confidence levels

and outcomes were measured. The participants also evaluated different

aspects of the course.

Every care was taken during the evaluation process to retain an objective

stance, to balance the opinions expressed and explore the justification for

the comments made.

5

Par�cipants’ views High ra�ngParticipants described the training as ‘very relevant’, ‘well delivered’, ‘inspirational’, ‘high level/ top notes’ and ‘very useful’ giving it a high

overall rating of 4.9 / 5 in a scale of 1 (poor) to 5 (very good).

Expecta�ons reached At the beginning of the project, the participants expressed their

expectations, sharing what they wanted to get from the training. Most

expectations had to do with increasing the understanding and acquiring/

improving technical skills related to video production and scriptwriting, being

better prepared to express their ideas in a creative form, and to gain

confidence using cameras and skills gained.

Overall all the participants felt that their expectations had been reached to

a great extent and some had been exceeded. They all felt that they had

gained new skills, knowledge and confidence.

“Gained greater understanding of putting a script together, e.g. logline, character biography, plan, etc”

“I have learnt how to film a clip taking into account the sound, lightand angles ready for editing”

“I’m now able to come up with an idea and develop it with confidence into a script”

“I have achieved some new skills – eg group dynamics,camera and audio techniques.

I’ve got greater confidence to assume related roles”

Increased confidenceIn addition to providing training on video production techniques and skills,

one of the aims of the course was to help build the confidence of the

participants and to help them develop motivational skills.

In the first session, the participants were asked to measure their level of

confidence in general and in relation to producing videos rating it from 0 to

10. This exercise was done again at the end of the project, in order to

compare the results and assess the increase, or not, of their level of

confidence.

All the participants of the training felt that their confidence had improved

6

considerably. Some of their marks increased from 2 or 3 in the first session

to 7 or 8 at the end of the course. Some felt that they needed more

practice, more hands-on work with equipment.

At the final group discussion exercise, the participants reaffirmed that their

confidence had improved as a result of the course and their aspirations had

widened. Most expressed their desire to continue their learning and to put

into practice the skills learnt.

“The course gave me confidence. Helped me to believe in my personal ability to achieve my goals using the skills I have learnt”

- “More confident on how to handle video, uses of sound,focus, white balance, lightening “

“From knowing very little about filming I now feel confident to film/direct my own small/amateur productions”

“The course has given me the confidence and experience to startmy community video work. It has boosted my confidence greatly. I

have learnt teamwork skills and how to edit in-camera”

7

Individual Learning Outcomes achieved As a helpful aid for self-evaluation, at the beginning of the training, each

participant completed an Individual Learning Plan where they stated what

they expected to be their Learning Outcomes (LOs). They then indicated

their starting level for each statement using the following scale: A= I can do

this well; B= I can just do this; C=I can nearly do this and D=I cannot do this.

At the middle and the end of the course participants assessed their own

progress in relation to the LOs using the same scale.

At the end of the training, all the participants felt that they had made

significant personal progress through learning. Most of them indicated that

they had achieved their expected learning outcomes to a high degree. Many

of the marks passed from D (I cannot do this) to A (I can do this well).

Below are some examples of Learning Outcomes progress from different

participants:

Individual Learning Outcomes Start Mid End

Learn practical video filming techniques

D C A

Identify appropriate resources for filming

community videos D C A

Gain underpinning knowledge/theory in

film making D C A

Individual Learning Outcomes Start Mid End

Learn about stories, concepts, genres,

themes, characters and ideas for stories

C B A

Research, plan, write a log line C B A

Research, plan, write a character biography C B A

Write a summary of a story (one paragraph) C B A

Individual Learning Outcomes Start Mid End

Learn quality video camera production techniques D D B

Learn about sound for video D C B

Learn basic lighting techniques D C B

Learn the theory and practice, research knowledge D C B

8

LearningIn addition to the learning outcomes mentioned above which were assessed

during the training using a scale, participants also shared and expressed

other learning as knowledge, new skills and attitudes.

Most of their learning stated was very technical and specific, including

things like “keeping camera focus”, “when to zoom, when not to zoom”,

“Understanding about using different angles and light” or “putting a script together”, but social and working aspects were also mentioned “generalnetworking of meeting others”, “team work”, “group dynamics” or “workingwithin a team where different personalities can clash over topics”. Personal

learning included ‘planning ahead’, ‘researching’ and ‘time management’.Some people also mentioned a getting a wider concept of film making and

how to use the skills learnt.

“It helped me to consider the importance of filming and how it canbe used to document activities such as planning meetings and

helped me to understand the importance of different media forms”

Liked about the trainingWhen asked what they had liked about the training, the majority of the

participants highlighted the overall well structured delivery of the training

that was pitched at the right level, the high level of technical information

that was kept simple and the professionalism, experience and openness of

the tutors. They particularly enjoyed the hands-on with using cameras and

equipment and being able to produce short videos. They all felt that they

had got a lot out of the training.

Examples of the answers given by participants are shown below.

9

What did you like about the training?

“The training was very well structured, I got a lot out of it”

“Working with the camera, filming �simple scenes and the result is magic, something special”

“The training was inspiring. It was aimed at the appropriate level. Ilearnt new things each week”

� I liked everything, was left wanting more

� It was a real test of production set reality

� The hands-on with using the relevant equipment and learning theprofessional principles

� The tutors skills

� The one to ones and the hands-on with the cameras

� The overall delivery of the training by tutors has been to a high structured level. They are dedicated and knowledgeable.

� Openness, courtesy, good knowledge base/content

� The breakdown of technology

� Keeping it simple

� Weekly overviews

� Time to talk on aspects that you may not first understand

� Meeting new people

� Level of information very high, backup with handouts

� Structured free flow conversation

� I have learnt lots of new things, very informative, yet easy to digest

� Enjoyed the hands-on filming

� Written and oral information conveyed very effectively

� Teacher and student conversation

� Networking, meeting others

� All aspects of the training were valuable, in particular Tony’s experience and advice

10

Things that could be improvedMore time, a longer course

When asked what could be improved, all of the participants said that they

would have liked the course to be longer. They felt that 12 weeks per course

were not enough. They wanted to have more time to learn things in more

depth and practice the techniques and skills learnt.

More hands-on with relevant equipment

Linked to the lack of time many also mentioned that they would have liked

more practice, more hands-on experience with the different equipment.

Better connection with Manchester Metropolitan University

Some also mentioned, as an aspect to be improved, the limited access to

Manchester Metropolitan University, they expected more connection and

the University to be more involved in the training. In particular they expected

to have access to the Media suite of the University.

What could be improved?

� To have more time to master filming techniques and to learn morein-depth in all areas. The course was a good taster but it left me wanting more

� A longer duration of the course

� Longer course with advice to go further

� More time to be bale to use equipment. As the interviewer, the timebehind the camera and the time on sound and lighting were limited

� More hands on work with equipment

� More hands-on such as teaching us the one-day reporter shooting

� More time to practice techniques – filming and interviewing

� Better access to University media suite

� The connection with the university as from the first introduction I thought we would be more involved but this didn’t happened.

Most and least useful aspects of the trainingWhen asked about the most useful aspects of the training, the participants

reiterated the personal experience on filming and quality of the tutor (Tony

Reeves). “Tony’s advice, his personal experience at filming”

“The facilitator was clear and knowledgeable, patient and motivated;

brought the course to life”

11

Many stated that all aspects of the training were valuable and some

mentioned specific techniques and skills acquired.

Light/sound and camera angles, what NOT to do when filming”

“Economising with recording”

“Learning how to structure and developing a script”

“All was important...knowing the basics, camera, sound, lightingalso working as a team”

“I would like to move on to intermediate/advanced level for consolidating skills”

“I will spend a good amount of time mastering using thecamera/angles; different sound devices and lighting”

“I hope to make creative documentaries”

“There is talk about producing all 5 short stories we’ve written in‘script writing’ sessions �so ...”

“Group production with students on course”

“I would love to take this course to a level where I could be self employed and produce documentaries, plays,

write sitcoms, etc”

“I would like to use these new skills to highlight struggles and triumphs within the community, create products which inspire and

build confidence and strength”

“I can now start to introduce new elements to my media/websitedesign business.

Still more to learn but I know now what is involved”

The majority considered that all the training had been useful and struggled

to mention a least useful aspect. Two participants mentioned again the

difficulties accessing the university.

Plans for the future At the end of the course participants expressed their desire of continuing

practicing the skills learnt and, if possible, to get more training.

People also talked about plans and ideas of how to use the skills they have

learnt.

12

Final comments from par�cipants about the courseThe participants rated the courses very highly in all aspects. They

encouraged other people to do the training and in a few words described

what they thought about the training process:

Well deliveredLearning and experience

Very relevantExcellent, inspirational

Top notesImbedded learning

Good productionI would highly recommend this course. It is a good induction, well structured.

You get loads of information, you learn by practicingIt gives you a broad overview, it covers a lot,

it is an excellent inductionGood networking

It should continueGood opportunity to study access to filming

Go for it! it is a good course, you will enjoy it!

13

Conclusions and Recommenda�ons

The reflections and feedback given by the participants through out the

evaluation process, as well as the level of interest and motivation shown

during the training clearly indicate that the ‘Digital Media Training Project’

was a very successful project that achieved its main objectives and reached

the expectations of all those involved.

Some findings:� The courses were very successful with regard to content, addressingthe needs of participants and overall quality.

� The training proved to be relevant and was very well received by participants.

� Enrolment on the courses was good with consistent attendance and avery good retention rate.

� Participants gained a variety of useful skills on video production andscriptwriting and raised their confidence and motivation.

� Individual Learning Outcomes set up by participants were achieved.

� Participants considered that the courses were very well structured anddelivered.

� There was an excellent and fluid communication between tutors andtrainees.

� Tutors managed to transmit high technical information in a simple, accessible way.

� The experience, dedication and professionalism of the tutors were a keyelement for the success of the project.

� Participants valued the lectures and also the handouts and supportmaterials provided.

� The course allowed participants to learn by doing – they produced goodquality scripts and short films during the time of the courses.

� Creativity was promoted and enhanced.

� The students were able to work on their own as well as in groups.

� In addition to technical video production skills, the participants gainedother important skills such as teamwork, time management and planning.

� A successful and extensive recruitment process helped to obtain a mix of motivated participants coming from a variety of backgrounds.

� The course provided new networking opportunities.

� Lack of clarity about MMU role in the project generated false expectations and dissatisfaction among the participants. Participants

encountered difficulties accessing the University services. This was partly

solved with students been able to use their temporary student MMU pass

to access the facilities across all campuses.

� Staff from CAEC at MMU made considerable efforts to improve the

14

connection between the University and the participants, responding to their

requests.

� Participants appreciated being given an ID student card and a MMU certificate.

� The final event held at MMU where participants presented their videosand were given certificates was a success and helped improved the link

between the University and the community.

� Partnership working was very positive, brought benefits to all involvedand allowed achieving improved outcomes.

� Participants were supported and encouraged to progress on the HE/FEstudies and apprenticeships. Some felt inspired to consider further

education and to use and put into practice the skills learnt. After finishing the

training, some of the students started their application process to FE/HE

colleges for further studies.

� An unexpected outcome of the project was the initiative taken by someof the students of the Script Writing course to form an amateur writing group

that meet on a regular basis to continue development of their scripts, as

well as making links with other local writers.

Digital Warriors

Hello all, well done, you've got through, with flying colours, new skills, new knowledge, new everything.

It's been a positive journey, an abundance of learning, a challenge to the mind.

You have all stuck with it, none left behind.Working together can be hard, difficult, with people you don't know,

You all weathered the norming, Iike seasoned pros.Now you're ready to be unleashed on the world,

Digital visual warriors; you‘ve become true digital pearls.To the trainers, facilitators, our gurus, experts and guides,

Tony, Carol, Dennis, Wowo,Big up, big thanks, you were great; just expressing;

but I'm sure you know.

by Anthony Downer a participant of the Digital Media Training

(the poem was shared with the other trainees on the evening

the programme certificates were awarded)

Some challenges� Working in groups to produce a short video with people they did notknow before and who had different views and personalities proved to be a

challenge for some participants.

15

� Due to lack of time and resources, the practice of some skills and useof equipment was limited.

� The relationship/links with Manchester Metropolitan University whichappeared in the publicity leaflet were not clear. The first session at MMU

campus created expectations that, according to some participants, were

not fulfilled.

� In order to respond to the needs and pace of the group, a considerableamount of work between sessions was required to plan and modify the

training over its duration.

Recommenda�onsThe ‘Digital Media Training Project’ is a high quality, well structured, media

training that should continue to be provided benefiting new groups and

communities.

A ‘level 2´ course is recommended as a next step for participants who have

completed the initial courses. Level 2 would help participants to look at

some things in more depth, go further in their learning process and to

practice and consolidate the skills gained.

Future courses should consider:

a) Implementing team building activities at the beginning of the course to

help reduce potential problems later when working in groups to produce

videos.

b) Depending on costs and funding, have more equipment and plan a

longer course so each participant has more time/opportunities to work with

cameras and other equipment (more hands-on activities).

c) Making efforts to improve the recruitment of female students to obtain a

greater gender balanced group.

It is important to make sure that, from the beginning of the project, there is

a clear and collective understanding about the roles and services offered by

the different partners to avoid misunderstandings and to make the most of

the partnership work.

Due to the overall quality of the training, it would be recommended to

explore the possibility of the training to become accredited by a Higher

Education Institution or a recognised Education body.

Maintaining and reinforcing the successful partnership work with the

organisations involved will help to negotiate further project developments in

the future by sharing knowledge, expertise and resources.