23
105 English Teaching, Vol. 69, No. 3, Autumn 2014 The Effectiveness of Reading Strategy Instruction: A Meta-Analysis Unkyoung Maeng (Ajou University) Maeng, Unkyoung. (2014). The effectiveness of reading strategy instruction: A meta-analysis. English Teaching, 69(3), 105-127. Many experimental studies have reported the effects of strategy instruction (SI) on reading comprehension in Korea, but the reported results are not conclusive. This meta- analysis study, therefore, aims to provide reliable common effects of SI on Korean learners’ reading comprehension. The study also aims to investigate how context (institution, L2 proficiency, gender) and treatment variables (strategy type, numbers of different strategies used, test types) affect the effectiveness of SI on the reading comprehension ability of Korean L2 learners. Through a comprehensive search, 37 primary studies were selected and 45 samples were coded into CMA software to calculate effect sizes by computing Heges’ g. The results of this meta-analysis showed a moderate effect of SI on reading comprehension (ES=.58). All moderating variables except L2 proficiency and gender had a statistically significant moderating effect with medium to large effect sizes for 7 variables and small effect sizes for 4 variables. Findings and pedagogical and research implications are discussed. Key words: strategy instruction, reading strategies, reading comprehension, meta- analysis 1. INTRODUCTION Reading is the most essential skill in learning a foreign language (Nunan, 2003). Reading can enhance not only language proficiency but also other content related learning (Nunan, 2003). A vast amount of research has been devoted to developing L2 reading comprehension, and identifying effective reading strategies has been the primary goal of research since the 1970s (Anderson, 2005; Grabe, 2004, 2009; Jeon & Yamashita, 2014; Koda, 2005; Maneg, 2005; Y. H. Park, 2010; Plonsky, 2011). Many L2 learning theories and research results reveal that good readers use various reading strategies effectively and the use of these strategies enhances L2 learners’ reading ability. Many strategy-related 교보문고 KYOBO Book Centre

The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

  • Upload
    others

  • View
    13

  • Download
    0

Embed Size (px)

Citation preview

Page 1: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

105

English Teaching, Vol. 69, No. 3, Autumn 2014

The Effectiveness of Reading Strategy Instruction:

A Meta-Analysis

Unkyoung Maeng

(Ajou University)

Maeng, Unkyoung. (2014). The effectiveness of reading strategy instruction: A

meta-analysis. English Teaching, 69(3), 105-127.

Many experimental studies have reported the effects of strategy instruction (SI) on

reading comprehension in Korea, but the reported results are not conclusive. This meta-

analysis study, therefore, aims to provide reliable common effects of SI on Korean

learners’ reading comprehension. The study also aims to investigate how context

(institution, L2 proficiency, gender) and treatment variables (strategy type, numbers of

different strategies used, test types) affect the effectiveness of SI on the reading

comprehension ability of Korean L2 learners. Through a comprehensive search, 37

primary studies were selected and 45 samples were coded into CMA software to

calculate effect sizes by computing Heges’ g. The results of this meta-analysis showed

a moderate effect of SI on reading comprehension (ES=.58). All moderating variables

except L2 proficiency and gender had a statistically significant moderating effect with

medium to large effect sizes for 7 variables and small effect sizes for 4 variables.

Findings and pedagogical and research implications are discussed.

Key words: strategy instruction, reading strategies, reading comprehension, meta-

analysis

1. INTRODUCTION

Reading is the most essential skill in learning a foreign language (Nunan, 2003).

Reading can enhance not only language proficiency but also other content related learning

(Nunan, 2003). A vast amount of research has been devoted to developing L2 reading

comprehension, and identifying effective reading strategies has been the primary goal of

research since the 1970s (Anderson, 2005; Grabe, 2004, 2009; Jeon & Yamashita, 2014;

Koda, 2005; Maneg, 2005; Y. H. Park, 2010; Plonsky, 2011). Many L2 learning theories

and research results reveal that good readers use various reading strategies effectively and

the use of these strategies enhances L2 learners’ reading ability. Many strategy-related

교보문고 KYOBO Book Centre

Page 2: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

106 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

studies have also examined the association with other variables such as L1 or L2

proficiency, gender, age, motivation, and autonomy (Bae & Maeng 2012; Cummins,

2009; Green & Oxford, 1995; Hardin, 2001; Jung & Kim, 2012; Kim & Suh, 2007; Y. M.

Kim, 2013; Maeng, 2005; Mogagwe & Oliver, 2007; Y. H . Park, 2010; Plonksy, 2011).

Along with descriptive and correlation studies, the effect of strategy instruction (SI) on

L2 reading has been reported and emphasized and reading SI has gained popularity among

L2 teachers (Chamot, 2005; Ellis, 2005; Plonsky, 2011; Pressley, 2000; Sailor & Price,

2010). Several studies reported positive effects of explicit SI on L2 reading

comprehension; some have reported the impact of implementing metacognitive strategies

(Jeon & Lew, 2001; Sheorey & Mokhtari, 2001) and others have reported the effect of

cognitive strategies (Kim & Kim, 2010; Kweon, 2009; Sailor & Price, 2010) or a mixture

of metacognitive and cognitive strategies (Byun & Park, 2012; Maeng, 2010). The effects

of individual or groups of reading strategies have also been shown, such as activating

background knowledge, using graphic or semantic organizers, summarizing, finding main

ideas, inferring, and monitoring (Dryer & Nel, 2003; Maeng, 2010; Oxford, 2004;

Raymond, 1993). However, these positive results were investigated across various

learning contexts (e.g. foreign and second language), settings (e.g. elementary, middle and

high school and college level), age or gender groups, treatments (e.g. number and type of

different reading strategies, length of intervention), and populations (e.g. number of

participants). Moreover, there have been negative and mixed results regarding the effects

of SI on L2 reading across the same context, age or gender groups, and treatments

(Barnett, 1988; Bimmel, Van den Bergh & Oostdam, 2001; E. J. Cho, 2003; W. H. Cho,

2003; Im, 2008; Y. M. Kim, 2013; D. E. Lee, 2013; Maxim, 2002; Park & Lee, 2011;

Plonsky, 2011). With these inconclusive results, it is difficult to ascertain the overall effect

of SI on reading comprehension or to provide an effective instructional model for L2

learners or teachers to use.

Furthermore, comprehensive meta-analyses of the research in this area have been

sparsely conducted despite the vast amount of primary data related to the effects of

reading SI (articles, reports, theses and books). Especially in Korean English education,

though improving learners’ L2 reading comprehension has become a major concern and

more than 200 studies related to this issue have been carried out, there is not much

synthesis research in this area. Plonsky (2011) and Jeon and Yamashita (2014)

comprehensively synthesized some primary research, but Plonsky focused on finding the

effect of SI on various outcomes not specified for reading, and Jean and Yamashita

synthesized the findings of correlated research rather than experimental research.

Furthermore, both of these studies did not include enough research conducted in Korean

school contexts. Thus, their results cannot yield implications directly applicable to the

Korean English education context. Y. H. Park (2010) carried out a meta-analysis on the

교보문고 KYOBO Book Centre

Page 3: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 107

relationship between reading comprehension and reading strategy and found a positive

correlation. However, this also did not contain enough research conducted in the context

of Korean schools and did not consider variables such as age and treatments that influence

the effects of SI.

The purpose of this study is, therefore, to provide an overall picture of the effects of SI

on L2 reading comprehension in the Korean school context by synthesizing the findings of

previous experimental and quasi-experimental research conducted in Korea inclusively

and systematically. The study also examines how moderate variables associate with the

effect of SI on L2 reading comprehension ability. For these aims the following research

questions guided the present meta-analysis:

1. Are interventions using SI effective for improving L2 learners’ reading performance?

2. Do the effects of SI on L2 reading performance differ across gender, L2 proficiency,

institution, and types of treatment and tests?

2. LITERATURE REVIEW

Increasing numbers of researchers, educators, and teachers consider explicit instruction

in reading comprehension strategies an effective way to enhance L2 reading proficiency.

Many empirical studies have also been conducted in Korea to investigate the effectiveness

of reading strategy intervention on Korean learners’ reading comprehension ability.

Several studies were conducted on elementary students and showed a positive or no effect

on their reading comprehension. Cha and Lee (2013) reported that using a graphic

organizer and a KWL chart helped elementary students to enhance their reading

comprehension, and N. I. Choi (2013) reported the effect of using graphic organizer, mind

mapping, and questioning strategies. M. S. Shim (2006) found a positive effect of

affective strategy instruction while other researchers observed a positive effect of

cognitive strategy instruction (D. W. Jung, 2012; Kim & Kim, 2010). D. W. Jung (2012)

reported a positive effect of multiple strategy based instruction (brainstorming,

restructuring, scanning, skimming, summarizing, rereading, highlighting, inferencing, and

guessing) on elementary students’ reading comprehension. However, W. H. Cho (2003)

found no effect of teaching multiple strategies (finding main ideas/topics, scanning,

previewing, and guessing) on students’ reading comprehension ability. Seok (2007)

claimed that SI (inferencing, finding the main idea, replacing, and visualizing) was only

effective in enhancing reading scores of low English proficiency level learners.

A number of studies were conducted on middle and high school students, which also

showed mixed results. Maeng (2010) reported a positive effect of implementing cognitive

교보문고 KYOBO Book Centre

Page 4: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

108 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

(grouping, inferencing, and reasoning) and metacognitive (organizing, selective attention,

planning) strategy instruction on middle school students. Kim and Cha (2010) found that

teaching students to use a graphic organizer increased their reading comprehension, and

this result stands in contrast to the results of other studies conducted in elementary schools

(Cha & Lee, 2013; N. I. Choi, 2013). H. K. Kim (2001) taught several cognitive strategies

such as inferring, chunking, and using semantic mapping along with other reading-

thinking approaches, and found students’ reading comprehension increased after this

instruction. Jang (2004) also taught several cognitive strategies (activating prior

knowledge, semantic mapping, and guessing), metacognitive strategies (centering one’s

learning, evaluating, and confirming), and one social strategy (cooperating) to students,

and found that her instruction helped students increase their reading scores. Other studies

implemented different groups of various cognitive strategies using different classification

criteria: previewing, scanning, skimming, predicting, highlighting, arranging and planning,

and paying attention, (J. M. Park, 2011); brainstorming, skimming, scanning, and

guessing (E. Y. Lee, 2008); categorizing, summarizing, and skimming (J. H. Lee, 2007);

and scanning, skimming, guessing, and activating background knowledge (E. J. Park,

2012). However, some studies reported that teaching skimming and scanning (J. H. Shim,

2002) or guessing and predicting (E. Y. Lee, 2008) strategies did not show any effect.

Moreover, multiple strategy based instruction (inferencing, predicting, grouping,

summarizing, scanning, brainstorming, guessing, and evaluating) did not enhance students

reading scores either (Yun, 2002). J. H. Lim (2008) reported no effect of SI on a group of

high proficient English learners and a negative effect of SI (paraphrasing, questioning,

skimming, scanning, guessing, and activating background knowledge); the control group

showed higher reading score improvement than the experimental group.

Among studies conducted on high school students, some studies report a positive effect

of instruction on various combinations of cognitive and metacognitive strategies: fast

reading, finding main ideas, scanning, summarizing, organizing the structure,

paraphrasing, and guessing (Lee & Son, 2007); and analyzing, inferencing, mind mapping,

guessing, monitoring, and evaluating (S. J. Lee, 2007). Others show a positive effect of

different groups of various cognitive strategies: inferencing, summarizing, finding main

ideas, analyzing, and skimming (Seo, 2009); finding main ideas, analyzing, and

summarizing (H. A. Kim, 2008); and predicting, questioning, grouping, and summarizing

(S. E. Lim, 2010). A positive effect of metacognitive SI (planning and evaluating) is also

reported (Jeon & Lew, 2001). Contrary to these results, Y. M. Kim (2013) reported no

effect of instruction in cognitive, metacognitive and social strategies (activating prior

knowledge, using graphic organizers, inferencing, summarizing, questioning, associating,

guessing, and cooperating), and E. J. Cho (2003) found that teaching strategies such as

finding main ideas and scanning increased scores on reading tests of both control and

교보문고 KYOBO Book Centre

Page 5: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 109

experimental groups. In addition, other research reported that teaching metacognitive

strategies such as activating prior knowledge, guessing, evaluating, and paying selective

attention did not enhance students’ overall reading comprehension scores (Lim & Im,

2011), while the teaching of activating prior knowledge, skimming, finding main ideas,

and summarizing strategies enhanced the reading scores of only the higher English

proficiency level groups (Park & Lee, 2011).

Several studies conducted on university students also show a similar pattern of results.

Kweon (2009) mentioned that self-reported English reading ability scores of students

increased after being taught SI, such as identifying main ideas/arguments, assumptions,

types of support and evaluating. Y. S. Jung (2002) taught guessing, finding topics/main

ideas, scanning, inferencing, analyzing, summarizing, synthesizing, and grouping

strategies, and gave students assignments to practice these strategies. As a result, the

instruction enhanced students’ reading comprehension ability, and gender did not

influence the effects of SI. Byun and Park (2012) also taught various strategies

(summarizing, inferencing, chunking, finding supporting sentences, paraphrasing, reading

critically, guessing, highlighting, monitoring, and evaluating) and found a positive effect

of SI on students’ reading comprehension ability. However, another study reported no

difference in reading scores between groups of less frequent strategy users and more

frequent strategy users after teaching reading strategies such as finding main ideas,

visualizing, predicting, summarizing, inferencing, finding patterns, using a graphic

organizer, and grouping (K. R. Lee, 2010). In addition, a study revealed mixed results:

teaching metacognitive strategies (guessing, activating prior knowledge, monitoring, and

evaluating) did not enhance overall reading scores of the experimental group, but students

in a middle level English proficiency group showed significant improvement in reading

comprehension (Yoon, Won, & Kang, 2001).

As the explicit development of cognitive and metacognitive strategies is important in

learning a language (Anderson, 2002, 2005; Reutzel, Smith, & Fawson, 2005; Sailor &

Price, 2010), the aforementioned research implemented cognitive and metacognitive

strategies mostly to investigate the effect of SI on learners’ reading comprehension. More

specifically, summarizing, guessing, inferencing, scanning, and using graphic organizers

were used most in the empirical studies, in that order, regardless of institutional level.

Predicting, grouping, evaluating, and activating prior knowledge were used across all

school levels except in elementary school level; questioning, skimming, mind/semantic

mapping, and brainstorming were used in primary and secondary school levels; and

paying selective attention, planning, cooperating, and confirming were used mainly in

secondary school level. In addition, the following strategies were used in different levels

of institutions: finding main ideas/arguments/topics/assumptions, chunking, types of

supports, paraphrasing, reading critically, replacing, visualizing, fast reading, analyzing,

교보문고 KYOBO Book Centre

Page 6: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

110 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

synthesizing, restructuring, rereading, highlighting, previewing, associating, using a KWL

chart, reasoning, monitoring, centering one’s learning, monitoring, arranging, and

organizing.

However, the overall results of the aforementioned research are not conclusive; positive,

negative, as well as mixed effects were all reported. Furthermore, studies reporting the

same effect of SI were conducted across different research settings, gender groups, and

type and length of treatments. In other words, as Plonsky (2011) indicates, “doubts about

the effectiveness of SI have been raised due to small sample size and the complexity of

variable that affect L2 strategy use, a lack of valid and reliable instruments” (p. 994).

More specifically, different results were reported across the same and different

institutional levels, even though the same types of strategies and instruction time were

implemented. The population of the aforementioned research varies with gender and age.

These variables also influence strategy use, and findings on the influence are also mixed

(Cohen & Macaro, 2007). In addition, although research investigating the effect of SI has

been actively and abundantly conducted since around the early 2000s in Korea (Byun &

Park, 2012), no comprehensive meta-analysis has been carried out to find a reliable,

qualitative measure of the effectiveness of SI. Thus, it is necessary to verify the common

effects of SI on Korean learners’ reading proficiency and the association of variables such

as age (institutional level), gender, and types of instructions and tests.

3. METHOD

3.1. Selection of Studies

Multiple data bases were used to find the relevant studies for the present meta-analysis:

DBpia, Kiss, KYOBO Scholar, RISS, and NADL (National Assembly Digital Library).

Since the relevant studies were actively administered in the early 2000s (Byun & Park,

2012), studies between 2000 and 2014 were searched for with the following key words:

strategy, reading strategy, strategy instruction, reading comprehension, reading

proficiency, and reading ability. The steps of the study screening are presented in Figure 1.

교보문고 KYOBO Book Centre

Page 7: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 111

FIGURE 1

Flow Diagram for Inclusion of Studies

Abstracts of 448 studies were screened and 364 non-experimental studies were

excluded. As a result, the full text of 74 studies that seemed eligible was further examined

for the information necessary for the present meta-analysis. Among the 74 studies, 37

studies were excluded because some of them did not report sufficient statistical

information to calculate effect sizes, or full-text versions were not accessible. Finally 37

studies were included in the present meta-analysis. Cooper (2010) indicated that “the

quality-controlled journal articles should not be used as the sole source of information for

a research synthesis” because of the existence of bias against null findings and

confirmatory bias (p. 63). Thus, published journal articles, dissertations, and MA theses

are included in the present meta-analysis out of consideration of possible bias. Since “the

effect size has the same meaning regardless of the study design” (p. 25) from a statistical

perspective, and this assumption also applies to education fields especially when looking

at the impact of an educational intervention (Borenstein, Hedges, Higgins & Rothestein,

2009), studies with independent groups and studies with matched groups were included in

the same analysis.

3.2. Coding and Analyzing Data

The collected studies were organized according to the following variables: institution

level, gender, L2 proficiency, SI type and numbers of different strategies, and outcomes

Search features:

� Electronic databases (DBpia, Kiss, KYOBO Scholar, Riss, NADL from 2000 to 2014)

� Scanning reference lists and hand-searched journals

Studies after duplicates removed (n = 448)

Inclusion Criteria:

� Experimental research: one group pre/post-test design or two group pre/post-test design

� Published and unpublished studies (journal articles, dissertations, master’s theses)

� Studies with relevant statistics (i. e., means, standard deviations, sample sizes, t or p values )

Full-text articles assessed (n = 74)

Abstracts screened and excluded (n = 364)

Excluded studies (n = 37)

Studies not reporting sufficient statistic information or reading outcomes

Full-text articles not accessible

Studies included in meta-analysis (n = 37)

교보문고 KYOBO Book Centre

Page 8: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

112 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

for reading comprehension. The studies were coded into a database using the coding

categories shown in Table 1.

TABLE 1

Data Coding Scheme

Variables Values

Identification Author (year) Type of Publication: 1) Article 2) Dissertation 3) MA Thesis

Context Institution : 1) Elementary 2) Secondary (middle & high School) 3) University Gender: 1) Male 2) Female 3) Both Proficiency: 1) High level 2) Middle level 3) Low level

Treatment 1) Specific Strategies 2) Number of Strategies (G1 ≤ 5 & G2 > 5) 3) Strategy Type (general strategies: Cognitive, Metacognitive, Cognitive & Metacognitive)

Outcome Reading Test Score: 1) Standard Test (TOEFL ,TOEIC, PELT) 2) National Test (KCSAT, Achievement Test) 3) Other (i.e., tests made by teachers or book companies)

As discussed in the literature review section specific strategies were further analyzed

and classified into three different categories according to the classification from Oxford

(1990): cognitive, metacognitive, and mixed strategy (cognitive and metacognitive)

groups. In order to classify a study into a strategy group, at least three specific strategies

needed to belong to the same category; if a study used three specific cognitive strategies

and three metacognitive strategies, it was classified in the cognitive and metacognitive

group and if a study used one metacognitive strategy and three cognitive strategies, it was

assigned to the cognitive strategy group. The number of specific strategies used in SI were

also counted and classified into two different groups: one group for ≤ 5 strategies and

another group for >5 strategies.

Study names, statistical information, and main and moderator variables were coded into

the Comprehensive Meta-Analysis software, and effect sizes were calculated by

computing Heges’ g1 (Borenstein et al., 2009). A funnel plot was used to check for

publication bias and Duval and Tweedie’s Trim and Fill was used to manage the file

drawer problem; this “reduces the variance of the effects and yields the adjusted effect

size” (an unbiased estimate of the effect size) (Borenstein et al., 2009, p. 286). A Q test

was used to identify the homogeneity of a given predictor, and based on this result an

effect model (fixed or random effects model) was selected to calculate the effect size of SI.

1 “The standardized mean difference is often called Cohen’s d in research synthesis and d has a slight bias, tending to overestimate the absolute value of δ, the size of effects, in small samples. This bias can be removed by a simple correction that yields an unbiased estimate of δ, with the unbiased estimate called Hedges’ g” (Borenstein et al., 2009, p. 27).

교보문고 KYOBO Book Centre

Page 9: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 113

A subgroup analysis was also used to verify the effect of variables. When conducting a

subgroup analysis to compare the effect size of different types of strategy treatment, a

study (J. H. Choi, 2013) that did not report specific information about the treatment type

was excluded.

4. RESULTS

4.1. Results of Overall Analysis

Results of the funnel plot (see Appendix A) and Duval and Tweedie’s Trim and Fill

presented in Table 2 showed no publication bias in the studies on SI effects. “Trim and

Fill uses an iterative procedure to remove the most extreme small studies from the positive

side of the funnel plot until the funnel plot is symmetric and yields an unbiased estimate of

the effect size” (Borenstein et al., 2009, p. 286). In other words, if the difference between

observed and adjusted values is small, the reported effect is considered to be valid. The

results in Table 2 reveal no shift; thus, the effect size calculated from the sample studies

can be considered valid.

TABLE 2

Duval and Tweedie’s Trim and Fill

Fixed Effects Random Effects Q value

Studies Trimmed

PointEstimate

Lower limit

Upper limit

PointEstimate

Lower limit

Upper limit

Observed values .4596 .4046 .5147 .5799 .4368 .7231 265.333

Adjusted values 0 .4596 .4046 .5147 .5799 .4368 .7231 265.333

In order to verify the effect of SI on learners’ reading comprehension ability, the overall

average effect size of SI was measured by calculating Heges’ g for 45 independent

samples from 37 studies (see Appendix B). The summary of these effect sizes is shown in

Table 3. Homogeneity testing was also conducted and the results are presented in Table 3.

TABLE 3

Overall Average Effect Size of SI

Model 95% CI Heterogeneity

k ES Lower limit Upper limit p Q df p I2

Fixed effects

45 .460 .405 .515 .000 265.333 44 .000 83.417

Random effects

45 .580 .437 .723 .000

교보문고 KYOBO Book Centre

Page 10: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

114 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

The value of Q is 265.333, which is statistically significant. This means homogeneity

does not exist among the primary studies used to calculate the overall effect size of SI.

More specifically, they do not share a common effect size. Thus, a random effects model

is more reliable for computing the effect size of SI. Therefore, all the effect sizes reported

in the present study were calculated under the random effects model. The significant

overall effect size (ES) of SI is .58. This overall ES represents a medium effect on

Cohen’s scale (1988).

4.2. Results of Subgroup Analysis

Moderator analyses were also conducted to compare the effects of SI for subgroups of

studies, and the results are presented in Table 4. The values of QBetween indicate that

institution, types of instruction strategies, numbers of different strategies used in SI, and

types of tests measuring reading comprehension had a significantly different moderating

effect, whereas learner’s proficiency level and gender did not.

TABLE 4

Random Model: Moderator Analysis Results

Moderator variable 95% CI Heterogeneity

k ES Lower limit Upper limit p QBetween p

Institution

E 9 .647 .263 1.030 .001

7.036 .030 S 29 .669 .456 .883 .000

U 7 .349 .210 .488 .000

Proficiency Level

H 11 .618 .037 1.20 .002

.946 .623 M 5 .363 .054 .672 .000

L 10 .569 .171 .967 .001

Gender

Male 7 .526 .250 .802 .000

.878 .645 Female 8 .500 .293 .707 .000

Both 30 .631 .433 .828 .000

Strategy Type

Cog 25 .691 .454 .928 .000

6.112 .047 MT 3 .337 .154 .520 .000

Cog &MT 15 .590 .357 .822 .000

No. of Strategies

G1≤5 23 .785 .497 1.073 .0005.045 .025

G2>5 21 .431 .317 .544 .000

Test Type

1 14 .820 .471 1.170 .000

6.944 .031 2 17 .374 .207 .547 .000

3 14 .646 .420 .872 .000

More specifically, the effect sizes (ES) of SI for elementary and secondary levels

are .647 and .669,

respectively, and they represent a medium effect on Cohen’s scale. The

ES for university level is .349 , which represents a small effect. Specific strategies used in

the studies were categorized into three different groups based on the criteria shown in the

coding scheme: cognitive, metacognitive, and cognitive and metacognitive (two studies

교보문고 KYOBO Book Centre

Page 11: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 115

were excluded because one implemented affective strategy instruction and the other did

not provide any specific strategy information). Cognitive strategy instruction and a

combination of cognitive and metacognitive strategy instruction have a medium effect; the

ES of each group is .691 and .590, respectively. However, the effect of metacognitive

strategy instruction is small, with an ES of .337.

Since previous studies used various numbers of specific strategies when implementing

SI, the sample studies were divided into two groups and the ES of these two groups were

compared. The ES for a group of studies implementing less than 5 different specific

strategies is .785, and the other group with more than 5 different specific strategies is .431;

the former value represents a medium effect and the latter a small effect.

The sample studies used various testing measures to verify the improvement of

students’ reading comprehension ability and this resulted in a statistically significant

moderating effect. The ES for Test Type 1 (TOEFL, TOEIC, PELT), Test Type 2

(KCSAT, Achievement Test) and Test Type 3 (created by teachers or book companies)

is .820, .374, and .646, respectively, representing a large, small, and medium effect,

respectively.

5. DISCUSSION

The first goal of this study was to quantify the effect of SI on reading comprehension.

To this end, 45 effect sizes were derived from 37 primary studies. Overall there was a

medium effect of SI on reading comprehension (ES = .57). This finding provides a

conclusive result that SI enhances Korean students’ reading comprehension. Thus,

coupled with the result of Y. H. Park’s meta-analysis study (2010) reporting a positive

correlation between reading strategy use and reading comprehension, it can be concluded

that interventions using SI are an effective method to enhance Korean students’ reading

performance.

The second goal of this study was to verify the influence of variables that have been

reported inconsistently. Six variables were submitted to moderator analysis (subgroup

analysis), and the findings show that only four variables had a significant moderator effect.

First, there was a significant difference among studies that were conducted in elementary

schools, secondary schools, and universities. There was a medium effect of SI on reading

comprehension of elementary school students (ES = .647) and secondary school students

(ES = .669), and a small effect of SI on reading comprehension of university students (ES

= .349). This finding indicates that SI is more effective for enhancing reading

comprehension of primary and secondary learners than that of post-secondary learners. Y.

H. Park (2010) mentioned in his meta-analysis, “the correlation between reading strategy

교보문고 KYOBO Book Centre

Page 12: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

116 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

use and reading comprehension ability of post-secondary learners are stronger than that of

secondary learners” (p. 18). He explained this result by noting that younger learners are

less cognitively developed than older learners. This explanation can apply to the current

finding as well. Since younger learners need more instruction because they are less

cognitively, affectively, and socially developed, or there are not many other sources that

they can depend on for reading comprehension, younger learners might tend to rely more

on what their teachers taught (SI). As a result, the effect of SI for younger learners on

reading comprehension is stronger than for older learners. Furthermore, most specific

strategies utilized in the primary school studies are similar across institutions, and these

results could be affected by the inappropriate selection of strategies for university level

students. SI is effective when the appropriate levels of strategies are chosen for the

students (Chamot & Rubin, 1994; Haris, 2003).

Unlike previous research, which reported that higher level learners use more strategies

than lower level learners when they comprehend reading (Anderson, 2005; Grabe, 2009;

Y. H. Park, 2010), or indicated that more advanced learners incorporate new strategies

into their inventory of strategies used (Plonsky, 2011; Wharton, 2000), this study shows

that different levels of L2 proficiency did not influence the effects of SI differently.

Several reasons might explain this result: comparatively fewer samples related to this

variable were coded to compute the effect size and most of the samples were derived from

secondary institutions; each study used different criteria for dividing levels; or specific

strategies used in SI might not be appropriate strategies for each level of learners. Thus,

more precise meta-analysis of this issue is needed across primary, secondary, and post-

secondary institutions. In addition to this variable, gender was similarly problematic;

hence, gender needs to be further investigated, though this study showed no statistical

difference for SI effects between male and female learners.

As reported in other research and theories, different strategy instructions have different

effects on reading comprehension (Byun & Park, 2012; Dryer & Nel, 2003; Kim & Kim,

2010; Kweon, 2009; Maeng, 2010; Oxford, 2004; Raymond, 1993; Sheorey & Mokhtari,

2001). This study shows how strongly they influence reading comprehension. Similar to

the results of Plonsky’s research (2011), cognitive strategy instruction has a stronger effect

than metacognitive strategy instruction on reading comprehension. In addition, a mixture

of cognitive and metacognitve strategy instruction has a stronger effect than metacognitive

strategy instruction. Furthermore, this study found that most SI studies conducted in Korea

incorporated cognitive strategies and metacognitive strategies, and this suggests the

necessity of conducting socio-affective strategy instruction to distinguish the effects of

different combinations of SI. Different numbers of strategies incorporated in the

interventions also reveals different effects. Interestingly, SI incorporating less than 5

specific strategies has a stronger effect than SI integrating more than 5 specific strategies.

교보문고 KYOBO Book Centre

Page 13: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 117

Since most of the studies were conducted for a period of less than a semester, the more

strategies were introduced, the less time was available for students to learn and use them.

This incomplete learning might have affected their reading comprehension. This finding

confirms the general findings of previous research that SI is most effective when fewer

strategies are used more (Chamot & O’Malley, 1994), and suggests very important

pedagogical implications, in that the amount of strategies and practice time should be

considered when implementing SI.

Different instruments for measuring reading comprehension lead to significantly

different results for its effects. As in the results of Y. H. Park (2010), standardized tests

showed the strongest effect. Unexpectedly, tests developed by a teacher or textbook

companies showed a moderate effect, and KCSAT and national/local achievement tests

showed the weakest effect. This finding might be explained by test item consistency.

Since the validity and reliability of items on standardized tests are rigorously checked,

while those of non-standardized tests are not, evaluation criteria are consistently applied

when using standardized tests, but are inconsistently applied when using non-standardized

tests. Though this moderating effect is not adequately explained, this implies the selection

of measurements for reading comprehension requires careful consideration when

conducting research.

6. CONCLUSION

By exploring experimental research comprehensively and reviewing it systematically,

this meta-analysis study has found some important factors related to the effects of SI. First,

overall SI has a moderate effect on enhancing the reading comprehension of Korean L2

learners. Second, from the subgroup analyses, the study contributes an overall picture of

how different contexts (institutions, L2 proficiency, gender) and treatments (strategy type

and test type) relate to the effectiveness of SI in Korea. The advantage found for SI in

secondary (including primary) over post-secondary contexts is somewhat surprising, but it

indicates that factors other than SI should be considered for implementation at the

university level. Results from group effects across different treatment-related variables

such as types of strategies, numbers of different strategies used, and types of tests

emphasize the importance of selecting strategies in SI. In addition, this study provides

empirical evidence supporting a less-is-more approach for effective SI (Chamot &

O’Malley, 1994).

Overall, the results of this study yield several important pedagogical implications. First

when conducting SI, teachers or researchers need to carefully select strategies that are

appropriate for their students’ L2 level and cognitive level (institution level). Second,

교보문고 KYOBO Book Centre

Page 14: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

118 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

since implementing too many strategies in a short period time is not effective in enhancing

L2 learners’ reading comprehension, the number of strategies implemented should be

carefully considered. Third, since different tests showed different effects of SI on reading

comprehension, more caution is needed when selecting a test to measure learners’ reading

comprehension.

Despite the contributions of the aforementioned findings there are some limitations in

this study. Though this study attempted to provide a complete picture of the effects of SI

for Korean learners, the answers to some questions were not found or were not adequately

addressed, e.g., regarding the moderating effects of L2 proficiency and the types of tests

due to the lack of relevant primary studies. Time of treatment is also an important variable,

which affects the success of SI; however, this variable was not analyzed in this study

because most of the primary studies were conducted over less than a semester. In addition,

the study did not include other experimental research providing other types of data such as

MANOVA, ANCOVA and regression. Thus, more research is needed to investigate the

effects of SI across longer periods of treatment and different L2 proficiency groups, and

more detailed research analyses are needed to verify the causes of moderating effects for

different types of tests.

REFERENCES

Anderson, N. J. (2002). The role of metacognition in second language teaching and

learning. ERIC Digest, April 2002, 3-4.

Anderson, N. J. (2005). L2 learning strategies. In E. Hinkel (Ed.), Handbook of research

in second language teaching and learning (pp. 757-771). Mahwah, NJ: Lawrence

Erlbaum Associates.

Bae, E. S., & Maeng, U. K. (2012). L2 learning strategy use of Korean elementary and

middle school students and its correlation with their L1 reading. Modern English

Education, 13(4), 293-313.

Barnett, M. A. (1988). Reading through context: How real and perceived strategy use

affects L2 comprehension. The Modern Language Journal, 72, 150-162.

Bimmel, P. E., Van den Bergh, H., & Oostdam, R. J. (2001). Effects of strategy training

on reading comprehension in first and foreign language. European Journal of

Psychology of Education, 16, 509-529.

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothestein, H. (2009). Introduction to

meta-analysis. New York: Wiley.

*Byun, J. H., & Park, S. H. (2012). The effects of strategic instruction and learners'

reading strategy use in general English class. Korean Journal of General

교보문고 KYOBO Book Centre

Page 15: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 119

Education, 6(2), 207-241. *Cha, K. A., & Lee, E. Y. (2013). A study of elementary school students’ reading

comprehension development through KWL reading strategy instruction. Primary

English Education, 19(1), 241-269.

Chamot, A. U. (2005). Language learning strategy instruction: Current issues and research.

Annual Review of Applied Linguistics, 25, 112-130.

Chamot, A. U., & O’Malley, J. M. (1994). The CALLA handbook: Implementing the

cognitive academic language learning approach. New York: Addition-Wesley.

Chamot, A. U., & Rubin, J. (1994). Comments on Janie Rees-Miller’s “A critical

appraisal of learner training: Theoretical bases and teaching implication”: Two

readers react. TESOL Quarterly, 28, 771-776. *Cho, E. J. (2003). Effects of the internet-based reading activities on Korean high school

students' English reading comprehension. Unpublished master’s thesis. Ewha

Woman’s University, Seoul. *Cho, W. H. (2003). A study of English learning strategies for elementary school students.

Unpublished doctoral dissertation. Hoseo University, Cheonan. *Choi, H. Y. (2010). Attitude and preference of English learners to reading strategy

instruction. Unpublished master’s thesis. Hankuk University of Foreign Studies,

Seoul. *Choi, J. H. (2013). Effects of teaching English reading strategies. Unpublished master’s

thesis. Chungnam National Univesity, Daejeon. *Choi, N. I. (2013). The effect of reading strategy instruction on private elementary school

students’ English reading abilities in extensive reading of various genres.

Unpublished master’s thesis. Hankuk Univesity of Foreign Studies, Seoul.

Cohen, A. D., & Macaro, E. (2007). Language learner strategies: Thirty years of research

and practice. Oxford: Oxford University Press.

Cohen, J. (1988). Statistical power analysis for the behavior science (2nd ed.). New York:

Academic Press.

Cooper, H. (2010). Research synthesis and meta-analysis: A step-by-step approach (4th

ed.). London: Sage.

Cummins, J. (2009). Bilingual and immersion programs. In M. Long & C. J. Doughty

(Eds.), The handbook of language teaching (pp. 161-181). Oxford: Blackwell.

Dryer, C., & Nel, C. (2003). Teaching reading strategies and reading comprehension

within a technology-enhanced learning environment. System, 31, 349-365.

Ellis, R. (2005). Principles of instructed language learning. Asian EFL Journal, 7, 9-24.

Grabe, W. (2004). Research on teaching reading. Annual Review of Applied Linguistics,

24, 44-69.

Grabe, W. (2009). Reading in a second language: Moving from theory to practice. New

교보문고 KYOBO Book Centre

Page 16: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

120 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

York: Cambridge University Press.

Green, J. M., & Oxford, R. (1995). A closer look at learning strategies, L2 proficiency,

and gender. TESOL Quarterly, 29, 261-297.

Hardin, V. B. (2001). Transfer and variation in cognitive reading strategies of Latino

fourth-grade students in a late-exit bilingual program. Bilingual Research Journal,

25(4), 417-439.

Haris, V. (2003). Adapting classroom-based strategy instruction to a distance learning

context. TESL-EJ, 7, 1-13. *Im, J. H. (2008). The effects reading strategy training on low-level high school students’

English reading comprehension. Unpublished master’s thesis. Hankuk University

of Foreign Studies, Seoul. *Jang, J. H. (2004). A study on the strategy training in listening and reading classes for

middle school students. Korea National University of Education, Cheongju.

Jeon, E. H. , & Yamashita, J. (2014). L2 reading comprehension and its correlates: A

meta-analysis. Language Learning, 64(1), 160-212. *Jeon, B. Q., & Lew, C. S. (2001). A study of the effects of metacognitive reading

strategies training on English reading comprehension. The Journal of Linguistic

Science, 19, 217-240.

*Jung, D. W. (2012). The effect of English instructed cognitive strategies on elementary

students’ reading abilities. Unpublished master’s thesis. Chung-Ang University,

Seoul.

Jung, M. A., & Kim, N. H. (2012). Reading strategies in L1 and L2: Comparison of

Korean EFL learners` reading strategy use. Studies in Modern Grammar, 68, 211-

240. *Jung, Y. S. (2002). Effects of EFL reading strategy instruction integrating technology for

Korean university students. Multimedia-Assisted Language Learning, 5(1), 32-58. *Kim, H. A. (2008). The effects of reading strategy training on high school students’

English reading comprehension. Unpublished master’s thesis. Chungbuk National

University of Education, Cheongju. *Kim, H. K. (2001). A Study on the effects of strategy training on middle school students'

reading comprehension. The Journal of English Language, 13(2), 21-43. *Kim, H. R., & Kim, Y. M. (2010). Teaching of reading strategies in primary English

through the use of children’s literature. Primary English Education, 16(3), 85-121. *Kim, H. S., & Cha, K. A. (2010). The Effects of instruction using graphic organizers on

reading comprehension. Studies in Foreign Language Education, 24(1), 209-241.

Kim, M. R., & Suh, C. S. (2007). The relationship of language learning strategies and

English achievements. English Language Teaching, 19(1), 135-159. *Kim, Y. M. (2013). The effects of the explicit learning strategy instruction on high school

교보문고 KYOBO Book Centre

Page 17: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 121

students' listening and reading abilities: The applicability of the CALLA model.

Unpublished master’s thesis. Ewha Woman’s University, Seoul.

Koda, K. (2005). Insights into second language reading: A cross-linguistic approach.

New York: Cambridge University Press. *Kweon, S. O. (2009). Explicit instruction does affect the metacognitive awareness of

reading strategies for EFL readers. Foreign Languages Education, 16(1), 1-27. *Lee, D. E. (2013). A study on the effects of prediction strategy training on reading

abilities and attitudes of Korean middle school students. Unpublished master’s

thesis. Ewha Woman’s University, Seoul. *Lee. E. Y. (2008). Effects of reading strategy instruction on students’ achievement.

Unpublished master’s thesis. Kyung Hee University, Suwon. *Lee, H. J., & Son, H. J. (2007). A study on the instruction of English newspaper reading

through strategy training for learner autonomy. Studies in English Education,

12(1), 1-24. *Lee, J. H. (2007). A study of teaching reading comprehension by using reading strategy-

finding main idea task. Unpublished master’s thesis. Korea National University of

Education, Cheongju. *Lee, K. R. (2010). Improving self-efficacy and reading performance through

individualized reading strategy instruction. Modern English Education, 11(3), 40-

54. =*Lee, S. J. (2007). The effects of reading strategy training classified by its types on

Korean high school students' reading comprehension abilities and the attitude

toward reading. Unpublished master’s thesis. Ewha Woman’s University, Seoul.

Lim, J. H. (2008). The effects of reading and vocabulary strategy use on advanced middle

school students’ reading comprehension. Unpublished master’s thesis. Hankuk

University of Foreign Studies, Seoul. *Lim, S. E. (2010). The effects of reciprocal teaching in a Korea high school reading

classroom. Unpublished master’s thesis. Sookmyung Women’s University of

Education, Seoul. *Lim, E. H., & Im, B. B. (2011). The effectiveness of students’ reading proficiency and

metacognitive level by comprehension-monitoring reading strategies training

through think-aloud technique. Modern Studies in English Language & Literature,

55(2), 203-227.

Maeng, U. K. (2005). A comparative study of reading strategies in L1 and L2: Case study

of five Korean graduate students. Language Research, 41(2), 457-486. *Maeng, U. K. (2010). Reading strategy instruction and reading comprehension of middle

school students. Journal of the English Language and Literature, 52(2), 95-121.

Magogwe, J. M., & Oliver, R. (2007). The relationship between language learning

교보문고 KYOBO Book Centre

Page 18: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

122 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

strategies, proficiency, age and self-efficacy beliefs: A study of language learners

in Botswana. System, 35, 338-352.

Maxim, H. (2002). A study into the feasibility and effects of reading extended authentic

discourse in the beginning German language classroom. The Modern Language

Journal, 86, 20-35.

Nunan, D. (2003). Practical English language teaching (Int’l ed.). New York: MaGraw-

Hill/Contemporary.

Oxford, R. L. (1990). Language learning strategies: What every teacher should know.

New York: Newbury House.

Oxford, R. (2004). Effect of the presence and difficulty of task on strategy use: An

exploratory study. International Review of Applied Linguistics, 42, 1-47. *Park, E. J. (2012). A study on the improvement of English reading comprehension for

middle school students. Unpublished master’s thesis. Wonkwang University, Iksan. *Park, H. J., & Lee, E. J. (2011). The effects of reading strategy instruction and reading

portfolios on English reading proficiency and the attitude of Korean high school

students. English Language Teaching, 23(3), 127-149.

Park, Y. H. (2010). A relationship between reading comprehension and reading strategy

use: Meta-analysis. English Teaching, 65(3), 3-22. *Park, J. M. (2011). The effect of using metacognitive reading strategies on English

reading motivation and comprehension. Unpublished doctoral dissertation. Kongju

University, Kongju.

Plonsky, L. (2011). The effectiveness of second language strategy instruction: A meta-

analysis. Language Learning, 61(4), 993-1038.

Pressley, M. (2000). What should comprehension instruction be the instruction of? In M.

L. Kamil, P. D. Pearson, E. B. Moje, & P. P. Afflerbach (Eds.), Handbook of

reading research (pp. 545-561). Mahwah, NJ: Lawrence Erlbaum.

Raymond, P. M. (1993). The effects of structure strategy training on the recall of

expository prose for university students reading French as a second language. The

Modern Language Journal, 77, 445-458.

Reutzel, D. R., Smith, J. A., & Fawson, P. C. (2005). An evaluation of two approaches for

teaching reading comprehension strategies in the primary years using science

information texts. Early Childhood Research Quarterly, 20, 276-305.

Sailor, M., & Price, L.R. (2010). Professional development that supports the teaching of

=cognitive reading strategy instruction. The Elementary School Journal, 110(3),

301-322. *Seo, I. S. (2009). The effects of reading strategy instruction on the high school students’

English reading comprehension. Unpublished master’s thesis. Chunbuk National

University, Cheongju.

교보문고 KYOBO Book Centre

Page 19: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 123

*Seok, J. Y. (2007). Study on the persistent effectiveness of reading strategies instruction

through reciprocal teaching. Studies in Foreign Language Education, 21(1), 35-53.

Sheorey, R., & Mokhtari, K. (2001). Differences in the metacognitive awareness of

reading strategies among native and non-native readers. System, 29, 431-449. *Shim, J. H. (2002). A study of English reading strategy training for middle school

students at a lower proficiency level. Unpublished master’s thesis. Pukyong

National University, Busan. *Shim, M. S. (2006). The effect of affective strategies on elementary school students’

listening and reading proficiency. Unpublished master’s thesis. Busan National

University, Busan. *Yu, M. K. (2011). The effects of reading strategies on elementary students’ English

reading ability and affective domain. Unpublished master’s thesis. Busan National

University, Busan. *Yun, H. M. (2002). Effects of reading strategy training with textual enhanced text on

Korean middle school students’ reading comprehension abilities and reading

strategy uses. Unpublished master’s thesis. Ewha Woman’s University, Seoul. =*Yoon, W. J., Won, M. O., & Kang, H. D. (2001). The effects of metacognitive strategy

instruction for reading in EFL. The Journal of English Language Teaching, 13(2),

203-221.

Wharton, G. (2000). Language learning strategy use of bilingual foreign language learners

in Singapore. Language Learning, 50, 203-243.

References marked with an asterisk are the studies included in the meta-analysis.

교보문고 KYOBO Book Centre

Page 20: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

124 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

APPENDIX A

Funnel Plot of Sample Studies

-20 -10 0 10 20

0.0

0.5

1.0

1.5

2.0

Sta

ndard E

rror

Hedges's g

Funnel Plot of Standard Error by Hedges's g

APPENDIX B

Effect Size and Statistics for Each Study

Study name Subgroup within study Comparison Outcome Statistics for each study

Hedges's Standard Lower Upper g error limit limit p-Value

1. 변변변,박박박(2002) Blank Blank 자자자자변 0.409 0.105 0.203 0.615 0.000 cogmeta

2. 이이자, 손이자(2007) Exp.vs.Con Blank 수수수수 0.130 0.242 -0.344 0.605 0.590 cog

3. 김김김, 김김김 (2010) Blank Blank 자자자자변 1.457 0.436 0.603 2.311 0.001 cog

4. 박박박, 이이이(2011) Exp.vs.Con Blank 수수수수 0.755 0.207 0.349 1.161 0.000 cog

5. 석박이(2007) Exp.vs.Con Blank PELT 1.868 0.302 1.276 2.459 0.000 cog

6. Jung, Y. S(2002) Blank Blank TOEIC 0.357 0.092 0.178 0.537 0.000 cog

6. Jung, Y. S F Blank TOEIC 0.619 0.113 0.397 0.840 0.000 cog

6. Jung, Y. S M Blank TOEIC 0.314 0.174 -0.028 0.655 0.072 cog

7. Kim, H. K. (2001) Exp.vs.Con HG 성성성 0.139 0.218 -0.288 0.566 0.523 cog

8. Kim, H.S & Cha, K. A (2010) Exp.vs.Con Blank TOEIC 10.316 1.225 7.915 12.718 0.000 cog

9. Kweon, S. O.1 (2009) Blank Blank 자자자자변 0.442 0.134 0.180 0.704 0.001 cog

10. Lee, K. R. (2010) Blank HSG TOEIC 0.005 0.181 -0.349 0.359 0.978 cog

11. Maeng, U.K (2010) Exp.vs.Con Blank TOEIC 0.572 0.177 0.225 0.918 0.001 cogmeta

11. Maeng, U.K (2010) F Blank TOEIC 0.503 0.178 0.153 0.852 0.005 cogmeta

11. Maeng, U.K (2010) M Blank TOEIC 0.374 0.184 0.013 0.735 0.042 cogmeta

12. 윤윤박, 원원원, 강강강(2001)Blank Blank 출출출출출 0.103 0.147 -0.185 0.391 0.485 meta

13. 임이이, 임임임(2011) Exp.vs.Con Blank 수수수수 1.845 0.518 0.830 2.861 0.000 cogmeta

14. 전임전, 류류류(2001) Blank Blank 자자자자변 0.394 0.101 0.196 0.592 0.000 meta

15. 차차차, 이이김(2013) Blank Blank PELT 0.225 0.274 -0.312 0.762 0.411 cog

16. 박변박 (2011) Exp.vs.Con Blank 성성성 1.164 0.232 0.710 1.618 0.000 cogmeta

17. 김윤김(2013) Exp.vs.Con Blank 수수수수 0.066 0.210 -0.346 0.478 0.753 cogmeta

18. 최변김 (2013) Exp.vs.Con Blank 수수수수 0.168 0.264 -0.350 0.685 0.525 Blank

19. 이강이 (2013) Exp.vs.Con Blank 성성성 0.084 0.307 -0.516 0.685 0.783 cog

20. 조이조 (2003) Exp.vs.Con Blank 자자자자 0.352 0.194 -0.028 0.732 0.069 cog

21. 유김차 (2011) Exp.vs.Con Blank PELT 0.233 0.264 -0.285 0.751 0.379 cogmeta

22. 이이김 (2008) Exp.vs.Con Blank 자자자자 0.260 0.228 -0.187 0.707 0.255 cog

23. 윤박박 (2002) Exp.vs.Con Blank 성성성 0.025 0.194 -0.355 0.404 0.899 cog

24. 이수박 (2007) 상상변성 Blank 성성성 0.236 0.180 -0.117 0.590 0.190 cogmeta

24. 이수박 (2007) 초초변상상변성 Blank 성성성 0.336 0.183 -0.023 0.695 0.066 cogmeta

24. 이수박 (2007) 초초변초초변성 Blank 성성성 0.426 0.192 0.049 0.803 0.027 cogmeta

24. 이수박 (2007) 초초변성 Blank 성성성 0.314 0.192 -0.062 0.690 0.101 cogmeta

25. 최변김 (2010) Exp.vs.Con Blank 자자자자 0.087 0.264 -0.430 0.604 0.742 cog

26. 심김성 (2006) Exp.vs.Con Blank PELT 0.214 0.260 -0.296 0.723 0.411 affect

27. 이박이 (2007) Blank HG 자자자자 0.716 0.200 0.323 1.109 0.000 cog

28. 박이조 (2012) Exp.vs.Con Blank 자자자자 2.647 0.330 2.000 3.294 0.000 cogmeta

29. 장변변 (2004) Blank Blank 자자자자 0.439 0.119 0.206 0.673 0.000 meta

30. 조원박 (2003) Exp.vs.Con Blank 출출출출출 0.454 0.246 -0.029 0.937 0.065 cogmeta

31. 임변변 (2008) Exp.vs.Con Blank 성성성 0.350 0.286 -0.211 0.911 0.222 cogmeta

32. 심심강 (2002) Blank Blank 자자자자 1.210 0.193 0.832 1.588 0.000 cog

32. 심심강 (2002) Exp.vs.Con HG 자자자자 0.569 0.254 0.071 1.067 0.025 cog

33. 서초서 (2009) Exp.vs.Con Blank 자자자자 0.237 0.229 -0.213 0.687 0.301 cog

34. 김변김 (2008) Exp.vs.Con Blank 수수수수 0.946 0.320 0.318 1.573 0.003 cog

35. 임성이(2010) Exp.vs.Con Blank TOEIC 3.090 0.380 2.345 3.835 0.000 cog

36. 최최최(2013) Exp.vs.Con Blank 자자자자 0.859 0.372 0.129 1.588 0.021 cog

37. 조정원 (2012) Exp.vs.Con Blank PELT 0.761 0.289 0.195 1.326 0.008 cog

0.460 0.028 0.405 0.515 0.000

-1.00 -0.50 0.00 0.50 1.00

Favours A Favours B

Meta Analysis

Meta Analysis

교보문고 KYOBO Book Centre

Page 21: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 125

APPENDIX C

Data Coded from Primary Studies

Study Pub Inst Gen Time L Specific Strategy No. St S -Type R -Test

1. Byun, J. H. &

Park, S.H.

(2012)

A U

Both 10 hrs -

guessing, highlighting,

summarizing, inferencing,

chunking, finding

supporting sentences,

paraphrasing, monitoring,

reading critically, evaluating

10

Cog &

Metacog Self-Made

2. Lee, H. J. &

Son, H. J.

(2007)

AS

(H)

F 14 hrs

-

fast reading, summarizing

scanning, guessing,

paraphrasing, finding main

idea

6

Cog KCSAT

3. Kim, H. R. &

Kim, Y. M.

(2010)

A E

Both 16 hrs.

-

mind mapping, guessing,

evaluating, questioning,

summarizing

5

Cog Self-Made

4. Park, H. J. &

Lee, E. J.

(2011)

AS

(H)

F 12 wks -

activating prior knowledge,

skimming, finding main

ideas, summarizing

4

Cog KCSAT

5. Seok, J. Y.

(2007)

A E

Both 8 wks

(16 hrs)

H,

M, L

inferencing, finding main

idea, replacing

visualizing

4

Cog PELT

6. Jung, Y. S.

(2002)

A U

Both 12 wks -

guessing, finding

topics/main ideas, scanning,

inferencing, analyzing,

summarizing, synthesizing,

grouping

8

Cog TOEIC

7. Kim, H, K.

(2001)

AS

(M)

Both 14 hrs

H,

M, L

guessing, chunking, mind

mapping 3 Cog Achievement

8. Kim, H. S. &

Cha, K. A.

(2010)

AS

(M)

Both 10wks

- using graphic organizer 1 Cog TOEIC

9. Kweon, S. O.

(2009)

A U

Both 12wks

-

identifying main

ideas/arguments,

assumptions, types of

support and evaluating

5

Cog Self-Made

10. Lee, K. R.

(2010)

A U

Both 11wks

-

finding main ideas,

visualizing, predicting,

summarizing, making

inferences, finding patterns,

using graphic organizer,

grouping

7 Cog 3 TOEIC

11. Maeng, U.

K. (2010)

AS

(M)

Both 12hrs

-

grouping, inferencing,

reasoning, organizing,

selective attention, planning

6 Cog &

Metacog 3 TOEIC

12. Yoon, W. J.,

Won, M. O.

& Kang, H.

D. (2001)

A U

Both 36hrs

-

guessing, activating prior

knowledge, monitoring,

evaluating

4 Metacog Company Test

교보문고 KYOBO Book Centre

Page 22: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

126 The Effectiveness of Reading Strategy Instruction: A Meta-analysis

13. Lim, E. H.

& Im, B. B.

(2011)

AS

(H)

F 20hrs

-

questioning, activating prior

knowledge, guessing,

confirming, inferencing,

association, selective

attention

6 Cog &

Metacog KCSAT

14. Jeon, B. Q.

& Lew, C. S.

(2001)

AS

(H)

Both 16hrs

- planning, evaluating

controlling pace 3 Metacog Self-Made

15. Cha, K. A.

& Lee, E. Y.

(2013)

A E

Both 16hrs

- KWL chart, graphic

organizer 2 Cog PELT

16. Park, J. M

(2011) D

S

(M)

Both

30hrs

H, L

previewing, scanning,

skimming, predicting,

arranging & planning

paying attention

highlighting

7 Cog &

Metacog Achievement

17. Kim, Y. M.

(2013) M

S

(H)

Both

3weks

(8hrs)

-

activating prior knowledge,

guessing, using graphic

organizer, inferencing,

summarizing, cooperating,

questioning, associating

8 Cog &

Metacog KCSAT

18. Choi, J. H.

(2013) M

S

(H)

M

March-July

- - - - KCSAT

19. Lee, D. E.

(2013) M

S

(M)

Both

6wks

(10hrs)

- guessing, predicting 2 Cog Achievement

20. Cho, E. J.

(2003) M

S

(H)

F

10wks

(20hrs)

- finding main ideas,

scanning, skimming 3 Cog KCSAT

21. Yu, M. K.

(2011) M E

Both

12wks

(24hrs)

-

memory, cognitive,

compensatory,

metacognitive, social,

affective

6 Cog &

Metacog PELT 3급

22. Lee, E. Y.

(2008) M

S

(M)

M

8wks

(16hrs)

- brainstorming, skimming,

scanning, guessing 4 Cog Self-Made

23. Yun, H. M

(2002) M

S

(M)

Both

10hrs

H, L

guessing, inferencing,

brainstorming, predicting,

grouping, summarizing,

scanning

7 Cog Achievement

24. Lee, S. J.

(2007) M

S

(H)

Both

10hrs

H, L

guessing intelligently,

predicting, analyzing,

inferencing, mind mapping,

summarizing, monitoring,

evaluating

8 Cog &

Metacog Achievement

25. Choi, H. Y.

(2010) M E

Both

16hrs

-

finding main topic/idea,

scanning, previewing

guessing

5 Cog Self-Made

26. Shim, M. S.

(2006) M E

Both

8wks

(16hrs)

H, L affective strategy 1 Affective PELT

27. Lee, J. H.

(2007) M

S

(M)

M

10wks

(10hrs)

H,

M, L

categorizing(grouping),

summarizing, skimming 3 Cog Self-Made

28. Park, E. J.

(2012) M

S

(M)

Both

8wks

(16hrs)

-

scanning, skimming,

guessing, activating

background knowledge

4 Cog &

Metacog Self-Made

교보문고 KYOBO Book Centre

Page 23: The Effectiveness of Reading Strategy Instruction: A Meta ...journal.kate.or.kr/wp-content/uploads/2015/01/kate_69_3_5.pdf · The Effectiveness of Reading Strategy Instruction: A

Unkyoung Maeng 127

29. Jang, J. H.

(2004) M

S

(M)

Both

12hrs

H,

M, L

activating prior knowldege,

semanting mapping,

guessing, centering one’s

learning, evaluating,

confirming, cooperating

6 Metacog Self-Made

30. Cho, W. H.

(2003) D E

Both

17wks

(34hrs)

-

cognitive, memory,

compensate, meta-cog,

social, affective

6 Cog &

Metacog Company Test

31. Im, J. H

(2008) M

S

(M)

F

10wks

(8hrs)

-

paraphrasing, guessing,

activating prior knowledge,

questioning

4 Cog &

Metacog Achievement

32. Shim, J. H.

(2002) M

S

(M)

M

12hrs

H, L skimming, scanning 2 Cog Self-Made

33. Seo, I. S.

(20009) M

S

(H)

F

15hrs

H,

M, L

inferencing, summarizing,

finding main idea, analyzing 4 Cog Self-Made

34. Kim, H. A.

(2008) M

S

(H)

Both

24hrs

- finding main idea,

analyzing, summarizing 3 Cog KCSAT

35. Lim, S. E.

(2010)

MS

(H)

Both

30hrs

H, L

predicting, questioning,

summarizing, classifying

(grouping)

4 Cog TOEIC

36. Choi, N. I.

(2013)

M E

Both

6wks

(80min X 2)-

graphic organizer

mind mapping, questioning3 Cog Self-Made

37. Jung, D, W.

(2012)

M E

Both

18hrs

-

brainstorming, restructuring,

guessing, , scanning,

skimming,

summarizing, rereading,

highlighting, inferencing

9 Cog PELT

Note. Pub: publication, A: article, M: master’s thesis, D: dissertation, Inst: institution, E: elementary school, S (M): secondary

(middle school), S (H): secondary (high school), Gen: gender, L: proficiency level, No. St: number of strategies, S-Type: strategy

type, R-Test: reading test

Applicable levels: Elementary, secondary, tertiary

Unkyoung Maeng

Graduate School of Education

Ajou University

San 5 Wonchung-dong, Youngtong-gu

Suwon, Gyeonggi-do 443-749, Korea

Phone: (031) 219-1883

Cell: 010-4730-5329

Email: [email protected]

Received in June 2014

Reviewed in July 2014

Revised version received in August 2014

교보문고 KYOBO Book Centre