7
and their Eects on Student Eort and Proficiency Adrian Leis Miyagi University of Education Flipped Classrooms [email protected] @adrianleis AdrianLeis adrianleis.weebly.com JALTCALL 2015 June 7, 2015 Today’s Menu . Introduction Literature Review This Study Results and Discussion Conclusions Discussion Introduction In class At home Listen to teacher explain the text Do practice exercises Write compositions Do practice exercises Write compositions Listen to teacher explain the text Helpful for teaching deaf and hard-of-hearing students (subtitles in videos) Subtitles help regular students as well All students gave positive feedback when flipping my English composition classes At home In class Regular Class Flipped Class Literature review - Flipped method Salman Khan (2012) Khan Academy All people learn and concentrate in different ways and at different times Teachers must provide opportunities for students to study anytime and anywhere Strayer (2007) Ph.D Dissertation - Flipped method in Math Tasks in flipped learning need to be simple, or students may get lost However, there was an increase in innovation and cooperation in the classroom Davies et al. (2013) ICT class at university Regular method makes it difficult to provide individualized instruction Flipped learning allows personalized instruction and feedback Moraris et al. (2015) 67 graduate students Students were satisfied with the flipped method Perceived effects did not reflect grades

and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

and their Effects on Student Effort and ProficiencyAdrian LeisMiyagi University of Education

Flipped Classrooms

[email protected]

@adrianleis

AdrianLeis

adrianleis.weebly.com

JALTCALL 2015June 7, 2015

Today’s Menu .

• Introduction

• Literature Review

• This Study

• Results and Discussion

• Conclusions

• Discussion

Introduction

In class At home

Listen to teacher explain the text

Do practice exercises Write compositions

Do practice exercises Write compositions

Listen to teacher explain the text

Helpful for teaching deaf and hard-of-hearing students (subtitles in videos) Subtitles help regular students as well All students gave positive feedback when flipping my English composition classes

At home In class Regular Class Flipped Class

Literature review - Flipped method

Salman Khan (2012)

• Khan Academy • All people learn and concentrate in

different ways and at different times • Teachers must provide opportunities for

students to study anytime and anywhere

Strayer (2007)

• Ph.D Dissertation - Flipped method in Math • Tasks in flipped learning need to be simple,

or students may get lost • However, there was an increase in

innovation and cooperation in the classroom

Davies et al. (2013)

• ICT class at university • Regular method makes it difficult to

provide individualized instruction • Flipped learning allows personalized

instruction and feedback

Moraris et al. (2015)

• 67 graduate students • Students were satisfied with the flipped

method • Perceived effects did not reflect grades

Page 2: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

Literature review - Individual Instruction

Morton (1960)

• Using language laboratories enables students to receive individual instruction

• Language laboratories help late-comers to join in the class smoothly

Davies et al. (2013)

• ICT class at university • Regular method makes it difficult to

provide individualized instruction • Flipped learning allows personalized

instruction and feedback

Baker (2000)

• More instructors are attempting to create an environment which is more student-centered, allowing more active learning

Keefe (2007)

• The principal goal of education is to get students to learn

• Teachers must create an environment in which they can provide personalized coaching

Literature review - Flipped method in EFL

Cowie and Sakui (2014)

• Discuss blended learning in Australasian and Asian context • Flipped learning allows students to access classroom content

in a way that cannot be replicated in traditional classrooms

Ishikawa et al. (2014)

• Effects of flipped learning on coaching for proficiency tests • Students indicated high satisfaction with the flipped method • Students displayed high confidence of achieving high

scores in proficiency tests

Mehring (2015)

• Doctorate focusing on flipped learning in EFL classes in northern Japan

• Flipped learning increased the responsibility students felt to be more active in classes

• This is vital in the traditionally passive classrooms seen in Japan (see Aspinall, 2006; Nakata, 2006).

This study - Research Questions

RQ 1. Do students in a flipped classroom environment show more effort in their studies in comparison to students in a regular classroom?

RQ 2. Do students in a flipped classroom environment show a greater increase in proficiency in comparison to students in a regular classroom?

RQ 3. What can we learn from the dynamics of student effort in the flipped group?

This study - Participants

Group Age (SD)

Gender University Major

Female Male English Other

Flipped 19.36(.92) 8 3 8 3

Regular 19.73(.47) 11 0 11 0

Page 3: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

This study - Procedure

Week 1 Pretest

English composition

classes using either the flipped method or regular method

Week 10 Posttest & Questionnaire

Flipped Group 20 Greetings & Dictogloss

10 Q&A of video content

55 Composition writing

5 Confirming preparation for

next class

Regular Group 20 Greetings & Dictogloss

45 Textbook explanation

20 Composition writing

5 Confirming deadline

preparation for next class

Watching videoed explanation Preparing compositions

Completing compositions Feedback from teacher

Feedback from teacher

Results - RQ 1 (Study time)

Before class Flipped Group(M = 122.74, SD = 51.01) > Regular Group

(M = 49.09, SD = 9.29) t(20) = 4.10, p < .001, d = 2.01

After class Flipped Group(M = 46.36, SD = 24.61) ≈ Regular Group

(M = 43.63, SD = 36.41) t(20) = .21, p = .839

Total time Flipped Group(M = 169.09, SD = 70.06) > Regular Group

(M = 92.73, SD = 63.58) t(20) = 2.67, p = .014, d = 1.14

Note. Results are based on independent samples t tests

See Appendix A for a more detailed

statistical report

Results - RQ 1 (Number of words)

Note. Results are based on paired-samples t tests

Pretest Flipped Group(M = 134.73, SD = 39.42) ≈ Regular Group

(M = 133.45, SD = 38.50) t(10) = .06, p = .954

Posttest Flipped Group(M = 260.45, SD = 70.06) > Regular Group

(M = 162.50, SD = 76.75) t(10) = 3.37, p = .007, d = 1.44

See Appendix B for a more detailed

statistical report

Results - RQ 1 (Effort)

Yes!

• The Flipped Group had been given a clearer indication of how to prepare for class. • The Flipped Group were able to access the lesson video anywhere and anytime,

increasing their opportunities to study. • The Flipped Group showed signs of autonomy, by reviewing their compositions and

considering ways to improve.

“I prefer to define autonomy as the capacity to take control of one’s learning, largely because the contrast of control appears to be more open to investigation than the constructs of charge or responsibility (Benson, 2001, p. 47)”

Page 4: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

Results - RQ 2 Results - RQ 2

See Appendix C for a more detailed

statistical report

Results - RQ 2

Despite there being a statistical difference in proficiency in the pretest, a comparison can still be conducted using a one-way analysis of covariance (ANCOVA) (see Larson-Hall, 2010, 2008; Lyster, 2004). Results showed the Flipped Method to be significantly more effective in increasing proficiency than a regular approach to teaching, F (1, 63) = 13.50, p < .001, η2 = .18.

Strength η2

Strong > .14

Medium 0.06

Weak 0.01(Green & Salkind, 2011, p. 213)

Effect size strength for ANCOVA

See Appendix D for a more detailed

report

Results - RQ 2

Yes!

• The subtitles provided in the flipped classroom videos improved students’ understanding of the content.

• Because students were able to access the videos anytime, they could watch the class as many times as they needed to understand the content.

• As the explanation of the lesson had already been conducted online, the instructor was able to provide individual and personalised instruction to students in the Flipped Group.

Page 5: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

Results - RQ 3

Complex Dynamic Systems in L2 Motivation research

Several theories suggest motivation is not static, but ever-changing, measurable under a multitude of rubrics (Dörnyei, et al. 2015):

Chaos Theory (Larsen-Freeman, 1997) Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman & Cameron, 2008)

There is a need for more empirical studies to support the

dynamic systems approach to L2 motivation research (Dörnyei, et al. 2015)

We must not forget the value of pre-posttest designed research as well.

(Noels, 2014)

Results - RQ 3

See Appendix E for a more detailed

report

Note. χ2 (9, N = 9) = 40.74, p < .001, W = .503.

Results - RQ 3

Related to the Hawthorn Effect? (Ur, 2013)

• We may expect immediate results, but these could slowly decrease over the course

• Providing concrete number of entries/items seems to encourage more writing

Conclusions

Using the flipped classroom method increases the initial

workload for teachers

Using the flipped classroom method increases effort made by students

Using the flipped classroom method increases students’

proficiency

Flipped classroom videos with subtitles improve understanding of

content

Flipped classroom videos on video-sharing websites allow viewing anytime anywhere

Page 6: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

Conclusions - Future directions

Effects of the flipped method on motivation of students in discussion-based/conversation classes. Increasing peer-coaching in flipped classes

Flipped Group 20 Greetings & Dictogloss

10 Q&A of video content

55 Peer-coaching

5 Confirming preparation for

next class

Watching videoed explanation Writing compositions

Feedback from teacher

ReferencesAspinall, R. W. (2006, July). Using the paradigm of ‘small cultures’ to explain policy failure in the case of foreign language education in Japan. In Japan Forum (Vol. 18, No. 2, pp. 255-274). Taylor & Francis Group. Baker, J. W. (2000). The" classroom flip": Using web course management tools to become the guide by the side. In Selected Papers from the 11th International Conference on College Teaching and

   Learning, 9-17. Benson, P. (2001). Teaching and researching autonomy in language learning. Harlow: Pearson Education. Cowie, N., & Sakui, K. (2014). Take your pick: Out-of-class, blended language and Web 2.0 projects, and online. JALTCALL Journal 10(3), 273-286. Davies, R. S., Dean, D. L., & Ball, N. (2013). Flipping the classroom and instructional technology integration in a college-level information systems spreadsheet course. Educational Technology Research

   and Development, 61(4), 563-580. de Bot, K., Lowie, W., & Verspoor, M. H. (2007). A Dynamic Systems Theory approach to second language acquisition. Bilingualism: Language and Cognition 10(1), 7-21. Dörnyei, Z., MacIntyre, P. & Henry, A. (2015). Motivational dynamics in language learning. Bristol: Multilingual Matters. Ellis, N. C. & Larsen-Freeman, D. (2006). Language emergence: Implications for applied linguistics – Introduction to the special issue. Applied Linguistics 27(4), 558-589. Green, S., & Salkind, N. (2011). Using SPSS for Windows and Macintosh: Analyzing and understanding data. Boston: Prentice Hall Press. Ishikawa, Y., Akahane-Yamada, R., Smith, C., Tsubota, Y., & Dantsuji, M. (2014). Flipped learning in a university EFL course: Helping students improve their TOEIC scores. INTED2014 Proceedings,    5860-5867. Keefe, J. (2007). What is personalization? Phi Delta Kappan, 83(6), 440-448. Khan, S. (2012). The one world schoolhouse: Education reimagined. New York: Twelve. Larsen-Freeman, D. (1997). Chaos/complexity science and second language acquisition. Applied Linguistics 18, 141-165. Larsen-Freeman, D., & Cameron, L. (2008). Complex systems and applied linguistics. Oxford: Oxford University Press. Larson-Hall, J. (2010). A guide to doing statistics in second language research using SPSS. New York: Routledge. Larson-Hall, J. (2008). Weighing the benefits of studying a foreign language at a younger starting age in a minimal input situation. Second Language Research, 24(1), 35-63. Lyster, R. (2004). Differential effects of prompts and recasts in form-focused instruction. Studies in Second Language Acquisition, 26(4), 399-432. Mehring, J. G. (2015). An exploratory study of the lived experiences of Japanese undergraduate EFL students in the flipped classroom. (Doctoral dissertation, Pepperdine University). Moraros, J., Islam, A., Yu, S., Banow, R., & Schindelka, B. (2015). Flipping for success: evaluating the effectiveness of a novel teaching approach in a graduate level setting. BMC Medical Education, 15(1), 27. Morton, F. (1960). The language laboratory as a teaching machine. International Journal of American Linguistics 26, 113-166. Nakata, Y. (2006). Motivation and experience in foreign language learning. Bern: Peter Lang. Noels, K. (2014, August). Round table discussion conducted at International Conference on Motivational Dynamics and Second Language Acquisition, Nottingham. Strayer, J. F. (2007). The effects of the classroom flip on the learning environment: A comparison of learning activity in a traditional classroom and a flip classroom that used an intelligent tutoring system    (Doctoral dissertation, The Ohio State University). Ur, P. (2013, October). A voyage of discovery. Plenary presented at JALT2013: Learning is a Lifelong Voyage, Kobe.

Appendix A

Group Before (SD) 95%CI After

(SD) 95%CI Total (SD) 95%CI

Flipped 122.74**(51.01)

[88.46, 156.99] 46.36(24.61)

[29.83, 62.89] 169.09*(70.06)

[122.02, 216.16]

Regular 49.09(9.29)

[28.39, 69.79] 43.36(36.41)

[19.18, 68.09] 92.73(63.58)

[50.02, 135.44]

Note. Before: the number of minutes studied before class; After: the number of minutes studied after class; Total: the total minutes of hours studied; * p <.05; ** p < .001.

Results - RQ 1 (Study time)

Appendix B

Group Before (SD) 95%CI After

(SD) 95%CI

Flipped 134.73(39.42) [108.25, 161.21] 260.45*

(49.30) [227.33, 293.57]

Regular 133.45(38.50) [107.60, 159.32] 162.50

(76.75) [115.81, 218.92]

Note. Before: the number of minutes studied before class; After: the number of minutes studied after class; Total: the total minutes of hours studied; * p <.01.

Results - RQ 1 (Number of words)

Page 7: and their E ects on Student E ort and Proficiency ... · Emergentism (Ellis & Larsen-Freeman, 2006) Dynamic Systems Theory (de Bot, et al., 2007) Complexity Theory (Larsen-Freeman

Appendix C

Group Pretest (SD) 95%CI Posttest

(SD) 95%CI

Flipped 11.09(3.19) [9.96, 12.22] 15.55*

(4.44) [13.97, 17.12]

Regular 7.67(2.73) [6.70, 8.63] 9.70*

(3.88) [8.32, 11.07]Note. Results are based on paired-samples t tests; * p < .001; Max: 25, Min: 0.

Results - RQ 2 (Proficiency changes within groups)

Appendix D

Group Pretest Posttest 95%CI

Flipped 9.38 14.67* [13.20, 16.14]

Regular 9.38 10.57 [9.10, 12.04]Note. Results are based on ANCOVA; * p < .001; Max: 25, Min: 0.

Results - RQ 2 (Proficiency changes within groups)

Appendix E

Note. Results are based on a Friedman Test; χ2 (9, N = 9) = 40.74, p < .001, W = .503.

Results - RQ 3 (Dynamics of effort within the Flipped Group)No. Topic Words1 The effects of technology on the environment. 134.732 Write three diary entries about the daily life of a Japanese university student. 291.273 Report on an interview with your partner about one aspect of his/her university life. 313.894 Describe three smartphone applications that are popular for university students. 331.645 Describe three unusual Japanese foods. 317.366 Write a recipe for a food you can cook well. 295.647 Describe five items of a field you are interested in (e.g., musicians, animals). 356.278 Choose one of the items you described in Topic 7 and give a more detailed description. 287.649 Write diary entries for three days past week. 266.8010 The effects of technology on the environment 260.45

Adrian LeisMiyagi University of Education

[email protected]

@adrianleis

AdrianLeis

adrianleis.weebly.com

JALTCALL 2015June 7, 2015

Thank you for your time