25
University of Groningen The effectiveness of hints during computer supported word problem solving de Kock, Willem Daniel IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite from it. Please check the document version below. Document Version Publisher's PDF, also known as Version of record Publication date: 2016 Link to publication in University of Groningen/UMCG research database Citation for published version (APA): de Kock, W. D. (2016). The effectiveness of hints during computer supported word problem solving. [Groningen]: Rijksuniversiteit Groningen. Copyright Other than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons). Take-down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim. Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons the number of authors shown on this cover page is limited to 10 maximum. Download date: 14-08-2020

University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

University of Groningen

The effectiveness of hints during computer supported word problem solvingde Kock, Willem Daniel

IMPORTANT NOTE: You are advised to consult the publisher's version (publisher's PDF) if you wish to cite fromit. Please check the document version below.

Document VersionPublisher's PDF, also known as Version of record

Publication date:2016

Link to publication in University of Groningen/UMCG research database

Citation for published version (APA):de Kock, W. D. (2016). The effectiveness of hints during computer supported word problem solving.[Groningen]: Rijksuniversiteit Groningen.

CopyrightOther than for strictly personal use, it is not permitted to download or to forward/distribute the text or part of it without the consent of theauthor(s) and/or copyright holder(s), unless the work is under an open content license (like Creative Commons).

Take-down policyIf you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediatelyand investigate your claim.

Downloaded from the University of Groningen/UMCG research database (Pure): http://www.rug.nl/research/portal. For technical reasons thenumber of authors shown on this cover page is limited to 10 maximum.

Download date: 14-08-2020

Page 2: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

210 211

ACME. (2011). Mathematical Needs Mathematics in the workplace and in Higher

Education. London.

Adams, D. M., McLaren, B. M., Durkin, K., Mayer, R. E., RittleJohnson, B., &

Isotani, S. (2014). Using erroneous examples to improve mathematics

learning with a webbased tutoring system. Computers in Human Behavior,

36, 401–411. doi:10.1016/j.chb.2014.03.053

Aleven, V., & Koedinger, K. R. (2000). Limitations of student control: Do students

know when they need help? In G. Gauthier, C. Frasson, & K. VanLehn (Eds.),

Proceedings of the 5th International Conference on Intelligent Tutoring

Systems, ITS 2000 (pp. 292–303). Berlin: Springer Verlag. doi:10.1007/3

540451080_33

Aleven, V., Roll, I., McLaren, B. M., & Koedinger, K. R. (2016). Help helps, but only

so much: Research on help seeking with intelligent tutoring systems.

International Journal of Artificial Intelligence in Education. 119. doi:

10.1007/s4059301500891

Arends, R. I. (2004). Learning to teach. Dubuque, Iowa: McGrawHill.

Atkinson, R. K. (2002). Optimizing learning from examples using animated

pedagogical agents. Journal of Educational Psychology, 94, 416–427.

doi:10.1037/00220663.94.2.416.

Avouris, N., Dimitracopoulou, A., & Komis, V. (2002). On analysis of collaborative

problemsolving: an objectoriented approach. Computers in Human

Behavior, 19, 147–167.

Azevedo, R. (2007). Understanding the complex nature of selfregulatory processes

in learning with computerbased learning environments: An introduction.

Metacognition and Learning, 2, 57–65. doi:10.1007/s1140900790185

Baines, E., Blatchford, P., & Kutnick, P. (2003). Changes in grouping practices over

primary and secondary school. International Journal of Educational

Research, 39, 9–34. doi:10.1016/s08830355(03)000715.

Page 3: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

212 213

Baker, R. S., Corbett, A. T., & Koedinger, K. R. (2004). Detecting student misuse of

intelligent tutoring systems. In J. C. Lester, R. M. Vicario, & F. Paraguaçu

(Eds.), Proceedings of seventh international conference on intelligent

tutoring systems, ITS 2004 (pp. 531–540). Berlin: Springer Verlag.

Baker, R. S., Walonoski, J., Heffernan, N., Roll, I., Corbett, A., & Koedinger, K. R.

(2008). Why students engage in "gaming the system" behavior in interactive

learning environments. Journal of Interactive Learning Research, 19 (2),

185–224. doi:10.1.1.297.2912

Bannert, M., Hildebrand, M., & Mengelkamp, C. (2009). Effects of a metacognitive

support device in learning environments. Computers in Human Behavior,

25 (4), 829–835. doi:10.1016/ j.chb.2008.07.002.

Bannert, M., Sonnenberg, C., Mengelkamp, C., & Pieger, E. (2015). Short and long

term effects of students’ selfdirected metacognitive prompts on navigation

behavior and learning performance. Computers in Human Behavior, 52,

293306. doi: 10.1016/j.chb.2015.05.038

Barron, B. (2000). Achieving Coordination in Collaborative ProblemSolving

Groups. Journal of Learning Sciences, 9 (4), 403–436.

Berthold, K., Nückles, M., & Renkl, A. (2007). Do learning protocols support

learning strategies and outcomes? The role of cognitive and metacognitive

prompts. Learning and Instruction, 17, 564–577.

Bollen, L., Gijlers, H., & Van Joolingen, W. (2012). Computersupported

collaborative drawing in primary school education – Technical realization

and empirical findings. In V. Herskovic, H. U. Hoppe, M. Jansen & J. Ziegler

(Eds.), Collaboration and technology (pp. 1–16). Berlin Heidelberg:

Springer.

Boonen, A.J.H., Van Wesel, F., Jolles, J. & Van der Schoot, M. (2014). The role of

visual representation type, spatial ability and reading comprehension in

word problem solving: An itemlevel analysis in primary school children.

International Journal of Educational Research, 68, 15–26.

Briggs, R. O., De Vreede, G. J. , Nunamaker, J. F. Jr. , & Tobey, D. (2001).

ThinkLets: Achieving Predictable, Repeatable Patterns of Group

Interaction with Group Support Systems (GSS). Proceedings of the

Hawaii International Conference on System Sciences, Los Alamitos, IEEE

Computer Society Press.

Bruun, F. (2013). Elementary Teachers’ Perspectives of Mathematics Problem

Solving Strategies. The Mathematics Educator. 23 (1), 45–59.

Bulu, S. T. & Pedersen, S. (2010). Scaffolding middle school students' content

knowledge and illstructured problem solving in a problembased

hypermedia learning environment. Educational Technology Research and

Development, 58(5), 507–529.

Capraro, R. M., Capraro, M. M., & Rupley, W. H. (2012). Reading enhanced word

problem solving: A theoretical model. European Journal of Psychology

of Education, 27 (1) , 91 114. doi:10.1007/s10212 011 0068 3

Capuano, N., D’Aniello, G., Gaeta, A., & Miranda, S. (2015). A personality based

adaptive approach for information systems. Computers in Human Behavior,

44, 156–165. doi:10.1016/j.chb.2014.10.058

Chang, K., Sung, Y., & Lin, S. (2006). Computerassisted learning for mathematical

problem solving. Computers & Education, 46, 140–151.

doi:10.1016/j.compedu.2004.08.002

Cheng, X., Li, Y., Sun, J., & Huang, J. (2015). Application of a novel collaboration

engineering method for learning design: A case study. British Journal of

Educational Technology, 47 (4), 803818.

Chung, K. K. H., & Tam, Y. H. (2005). Effects of cognitivebased instruction on

mathematical problem solving by learners with mild intellectual disabilities.

Journal of Intellectual and Developmental Disability, 30, 207–216.

doi:10.1080/13668250500349409

CITO. (2002). RekenenWiskunde 2002. Opgavenboekje M7[Mathematics work

book M7]. Arnhem, The Netherlands: Citogroep.

Clarebout, G., & Elen, J. (2006). Tool use in computerbased learning

environments. Computers in Human Behavior, 22, 389–411.

doi:10.1016/j.chb.2004.09.007.

Page 4: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

212 213

Baker, R. S., Corbett, A. T., & Koedinger, K. R. (2004). Detecting student misuse of

intelligent tutoring systems. In J. C. Lester, R. M. Vicario, & F. Paraguaçu

(Eds.), Proceedings of seventh international conference on intelligent

tutoring systems, ITS 2004 (pp. 531–540). Berlin: Springer Verlag.

Baker, R. S., Walonoski, J., Heffernan, N., Roll, I., Corbett, A., & Koedinger, K. R.

(2008). Why students engage in "gaming the system" behavior in interactive

learning environments. Journal of Interactive Learning Research, 19 (2),

185–224. doi:10.1.1.297.2912

Bannert, M., Hildebrand, M., & Mengelkamp, C. (2009). Effects of a metacognitive

support device in learning environments. Computers in Human Behavior,

25 (4), 829–835. doi:10.1016/ j.chb.2008.07.002.

Bannert, M., Sonnenberg, C., Mengelkamp, C., & Pieger, E. (2015). Short and long

term effects of students’ selfdirected metacognitive prompts on navigation

behavior and learning performance. Computers in Human Behavior, 52,

293306. doi: 10.1016/j.chb.2015.05.038

Barron, B. (2000). Achieving Coordination in Collaborative ProblemSolving

Groups. Journal of Learning Sciences, 9 (4), 403–436.

Berthold, K., Nückles, M., & Renkl, A. (2007). Do learning protocols support

learning strategies and outcomes? The role of cognitive and metacognitive

prompts. Learning and Instruction, 17, 564–577.

Bollen, L., Gijlers, H., & Van Joolingen, W. (2012). Computersupported

collaborative drawing in primary school education – Technical realization

and empirical findings. In V. Herskovic, H. U. Hoppe, M. Jansen & J. Ziegler

(Eds.), Collaboration and technology (pp. 1–16). Berlin Heidelberg:

Springer.

Boonen, A.J.H., Van Wesel, F., Jolles, J. & Van der Schoot, M. (2014). The role of

visual representation type, spatial ability and reading comprehension in

word problem solving: An itemlevel analysis in primary school children.

International Journal of Educational Research, 68, 15–26.

Briggs, R. O., De Vreede, G. J. , Nunamaker, J. F. Jr. , & Tobey, D. (2001).

ThinkLets: Achieving Predictable, Repeatable Patterns of Group

Interaction with Group Support Systems (GSS). Proceedings of the

Hawaii International Conference on System Sciences, Los Alamitos, IEEE

Computer Society Press.

Bruun, F. (2013). Elementary Teachers’ Perspectives of Mathematics Problem

Solving Strategies. The Mathematics Educator. 23 (1), 45–59.

Bulu, S. T. & Pedersen, S. (2010). Scaffolding middle school students' content

knowledge and illstructured problem solving in a problembased

hypermedia learning environment. Educational Technology Research and

Development, 58(5), 507–529.

Capraro, R. M., Capraro, M. M., & Rupley, W. H. (2012). Reading enhanced word

problem solving: A theoretical model. European Journal of Psychology

of Education, 27 (1) , 91 114. doi:10.1007/s10212 011 0068 3

Capuano, N., D’Aniello, G., Gaeta, A., & Miranda, S. (2015). A personality based

adaptive approach for information systems. Computers in Human Behavior,

44, 156–165. doi:10.1016/j.chb.2014.10.058

Chang, K., Sung, Y., & Lin, S. (2006). Computerassisted learning for mathematical

problem solving. Computers & Education, 46, 140–151.

doi:10.1016/j.compedu.2004.08.002

Cheng, X., Li, Y., Sun, J., & Huang, J. (2015). Application of a novel collaboration

engineering method for learning design: A case study. British Journal of

Educational Technology, 47 (4), 803818.

Chung, K. K. H., & Tam, Y. H. (2005). Effects of cognitivebased instruction on

mathematical problem solving by learners with mild intellectual disabilities.

Journal of Intellectual and Developmental Disability, 30, 207–216.

doi:10.1080/13668250500349409

CITO. (2002). RekenenWiskunde 2002. Opgavenboekje M7[Mathematics work

book M7]. Arnhem, The Netherlands: Citogroep.

Clarebout, G., & Elen, J. (2006). Tool use in computerbased learning

environments. Computers in Human Behavior, 22, 389–411.

doi:10.1016/j.chb.2004.09.007.

Page 5: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

214 215

Clarebout, G., Elen, J., Johnson, W. L., & Shaw, E. (2002). Animated pedagogical

agents: An opportunity to be grasped? Journal of Educational Multimedia

and Hypermedia, 11, 267–286.

Clark, H., & Brennan, S. (1991). Grounding in communication. In L. B. Resnick, J.

Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp.

127–149). Washington, DC: APA.

Clark, R. C., & Mayer, R. E. (2011). Elearning and the science of instruction. (3rd

ed.). San Francisco: John Wiley & Sons, Inc.

Cohen, D., & Hill, H. (2000). Instructional policy and classroom performance: The

mathematics reform in California. Teachers College Record, 102, 294–343.

Cohen, J (1988). Statistical Power Analysis for the Behavioral Sciences (second

ed.). Lawrence Erlbaum Associates.

Cooper, B., & Harries, T. (2005). Making sense of realistic word problems:

Portraying working class “failure” on a division with remainder problem.

International Journal of Research & Method in Education, 28, 147–169

Corbalan, G., Kester, L., & Van Merriënboer, J. J. G. (2008). Selecting learning

tasks: Effects of adaptation and shared control on efficiency and task

involvement. Contemporary Educational Psychology, 33, 733–756.

Corter, J. E. & Zahner, D. (2007). Use of external visual representations in

probability problem solving. Statistics Education Research Journal, 6 (1),

2250.

Crippen, K. J., & Earl, B. L. (2007). The impact of Webbased worked examples and

selfexplanation on performance, problem solving, and selfefficacy.

Computers & Education, 49 (3), 809–821.

doi:10.1016/j.compedu.2005.11.018

DarlingHammond, L., Wei, R. C., & Johnson, C. M. (2009). Teacher preparation

and teacher learning: A changing policy landscape. In G. Sykes, B. L.

Schneider, & D. N. Plank (Eds.), Handbook of education policy research (pp.

613–636). New York, NY: Routledge.

De Boer, H., Donker, A. S., & Van der Werf, M. P. C. (2014). Effects of the attributes

of educational interventions on students’ academic performance: a meta

analysis. Review of Educational Research, 84 (4), 509 545.

De Jong, T. (2005). The Guided Discovery Principle in Multimedia learning. In R.

Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 507–

523). New York, NY: Cambridge University Press.

De Kock, W. D., & Harskamp, E. G. (2014). Can Teachers in Primary Education

Implement a Metacognitive Computer Programme for Word Problem

Solving in their Mathematics Classes? Educational Research and

Evaluation, 20 (3), 231–250. doi:10.1080/13803611.2014.901921

Demetriadis, S.N., Papadopoulos, P.M., Stamelos, J.G., & Fischer, F. (2008). The

effect of scaffolding students’ contextgenerating cognitive activity in

technologyenhanced casebased learning. Computers and Education, 51 (2),

939–954.

Desoete, A., Roeyers, H., & De Clercq, A. (2003). Can offline metacognition

enhance mathematical problem solving? Journal of Educational

Psychology, 95, 188–200.doi:10.1037/00220663.95.1.188

Devolder, A., Van Braak, J., & Tondeur, J. (2012). Supporting selfregulated

learning in computerbased learning environments: Systematic review of

effects of scaffolding in the domain of science education. Journal of

Computer Assisted Learning, 28, 557–573.

De Vreede, G. J., Kolfschoten, G. L., & Briggs, R. O. (2006). ThinkLets: a

collaboration engineering pattern language. International Journal of

Computer Applications in Technology, 25 (2), 140154.

Dignath, C., & Büttner, G. (2008). Components of fostering selfregulated learning

among students. A metaanalysis on intervention studies at primary and

secondary school level. Metacognition and Learning, 3, 231–

264.doi:10.1007/s114090089029x

Dillenbourg, P., & Tchounikine, P. (2007). Flexibility in macro CSCL scripts.

Journal of Computer Assisted Learning, 23 (1), 113.

Ding, N. (2009). Computersupported collaborative learning and gender

(Doctoral dissertation). Groningen: University of Groningen.

Ding, N., Bosker, R. J., & Harskamp, E. G. (2011). Exploring gender and gender

pairing in the knowledge elaboration processes of students using computer

supported collaborative learning. Computers & Education, 56 (2), 325–336.

Page 6: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

214 215

Clarebout, G., Elen, J., Johnson, W. L., & Shaw, E. (2002). Animated pedagogical

agents: An opportunity to be grasped? Journal of Educational Multimedia

and Hypermedia, 11, 267–286.

Clark, H., & Brennan, S. (1991). Grounding in communication. In L. B. Resnick, J.

Levine, & S. D. Teasley (Eds.), Perspectives on socially shared cognition (pp.

127–149). Washington, DC: APA.

Clark, R. C., & Mayer, R. E. (2011). Elearning and the science of instruction. (3rd

ed.). San Francisco: John Wiley & Sons, Inc.

Cohen, D., & Hill, H. (2000). Instructional policy and classroom performance: The

mathematics reform in California. Teachers College Record, 102, 294–343.

Cohen, J (1988). Statistical Power Analysis for the Behavioral Sciences (second

ed.). Lawrence Erlbaum Associates.

Cooper, B., & Harries, T. (2005). Making sense of realistic word problems:

Portraying working class “failure” on a division with remainder problem.

International Journal of Research & Method in Education, 28, 147–169

Corbalan, G., Kester, L., & Van Merriënboer, J. J. G. (2008). Selecting learning

tasks: Effects of adaptation and shared control on efficiency and task

involvement. Contemporary Educational Psychology, 33, 733–756.

Corter, J. E. & Zahner, D. (2007). Use of external visual representations in

probability problem solving. Statistics Education Research Journal, 6 (1),

2250.

Crippen, K. J., & Earl, B. L. (2007). The impact of Webbased worked examples and

selfexplanation on performance, problem solving, and selfefficacy.

Computers & Education, 49 (3), 809–821.

doi:10.1016/j.compedu.2005.11.018

DarlingHammond, L., Wei, R. C., & Johnson, C. M. (2009). Teacher preparation

and teacher learning: A changing policy landscape. In G. Sykes, B. L.

Schneider, & D. N. Plank (Eds.), Handbook of education policy research (pp.

613–636). New York, NY: Routledge.

De Boer, H., Donker, A. S., & Van der Werf, M. P. C. (2014). Effects of the attributes

of educational interventions on students’ academic performance: a meta

analysis. Review of Educational Research, 84 (4), 509 545.

De Jong, T. (2005). The Guided Discovery Principle in Multimedia learning. In R.

Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 507–

523). New York, NY: Cambridge University Press.

De Kock, W. D., & Harskamp, E. G. (2014). Can Teachers in Primary Education

Implement a Metacognitive Computer Programme for Word Problem

Solving in their Mathematics Classes? Educational Research and

Evaluation, 20 (3), 231–250. doi:10.1080/13803611.2014.901921

Demetriadis, S.N., Papadopoulos, P.M., Stamelos, J.G., & Fischer, F. (2008). The

effect of scaffolding students’ contextgenerating cognitive activity in

technologyenhanced casebased learning. Computers and Education, 51 (2),

939–954.

Desoete, A., Roeyers, H., & De Clercq, A. (2003). Can offline metacognition

enhance mathematical problem solving? Journal of Educational

Psychology, 95, 188–200.doi:10.1037/00220663.95.1.188

Devolder, A., Van Braak, J., & Tondeur, J. (2012). Supporting selfregulated

learning in computerbased learning environments: Systematic review of

effects of scaffolding in the domain of science education. Journal of

Computer Assisted Learning, 28, 557–573.

De Vreede, G. J., Kolfschoten, G. L., & Briggs, R. O. (2006). ThinkLets: a

collaboration engineering pattern language. International Journal of

Computer Applications in Technology, 25 (2), 140154.

Dignath, C., & Büttner, G. (2008). Components of fostering selfregulated learning

among students. A metaanalysis on intervention studies at primary and

secondary school level. Metacognition and Learning, 3, 231–

264.doi:10.1007/s114090089029x

Dillenbourg, P., & Tchounikine, P. (2007). Flexibility in macro CSCL scripts.

Journal of Computer Assisted Learning, 23 (1), 113.

Ding, N. (2009). Computersupported collaborative learning and gender

(Doctoral dissertation). Groningen: University of Groningen.

Ding, N., Bosker, R. J., & Harskamp, E. G. (2011). Exploring gender and gender

pairing in the knowledge elaboration processes of students using computer

supported collaborative learning. Computers & Education, 56 (2), 325–336.

Page 7: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

216 217

Donker, A. S., De Boer, H., Kostons, D., DignathVan Ewijk, C. C., & Van der Werf,

M. P. (2014). Effectiveness of learning strategy instruction on academic

performance: a metaanalysis. Educational Research Review, 11, 1–26.

Dreyfus, T. & Eisenberg, T. (1996). On different factes of mathematical thinking. in

R. Sternberg & BenZeev (Eds). The Nature of Mathematical Thinking.

Hillsdale, NY: Lawrence Erlbaum Associates.

Dufresne, R. J. & Gerace, W. J. & Leonard, W. J. (1997). Solving physics problems

with multiple representations. The Physics Teacher, 35 (5), 270275.

Edens, K. & Potter, E. (2008). How Students "Unpack" the Structure of a Word

Problem: Graphic Representations and Problem Solving. Science and School

Mathematics Journal, 108 (5), 184–193.

Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences

tell us about the learning process? Educational Research Review, 1, 314.

Erkens, G., Kanselaar, G., Prangsma, M., & Jaspers, J. (2003). Computer support

for collaborative and argumentative writing. In E. de Corte (Ed.), Powerful

learning environments (pp. 159–177). Amsterdam: Pergamon.

Fischer, F., & Mandl, H. (2002). Facilitating knowledge convergence in

videoconferencing environments: The role of external representation tools.

Paper presented at the Computer Support for Collaborative Learning:

Foundations for a CSCL Community Conference, Boulder, CO., University of

Munrich, Germany

Foshay, R., & Kirkley, J. (2003). Principles for teaching problem solving

(Technical Paper No. 4). Retrieved from PLATO Learning

website:http://www.learningace.com/doc/2440565/e094c08dc4a564128df

491521b5d4ef8/2003_foshay_platolearninginc_techpaper4_principles

forteachingproblemsolving

Fuchs, L. S., Fuchs, D., Stuebing, K., Fletcher, J. M., Hamlett, C. L., & Lambert, W.

(2008). Problem solving and computational skill: Are they shared or distinct

aspects of mathematical cognition? Journal of Educational Psychology, 100,

30–47. doi:10.1037/00220663.100.1.30

Fuchs, L. S., Powell, S. R., Seethaler, P. M., Cirino, P. T., Fletcher, J. M., Fuchs, D.,

& Hamlett, C. L. (2010a). The effects of strategic counting instruction, with

and without deliberate practice, on number combination skill among

students with mathematics difficulties. Learning and Individual Differences,

20, 89–100. doi:10.1016/j.lindif.2009.09.003

Fuchs, L. S., Powell, S. R., Seethaler, P. M., Cirino, P. T., Fletcher, J. M., Fuchs,

D.,…Zumeta, R. O. (2009). Remediating number combination and word

problem deficits among students with mathematics difficulties: A

randomized control trial. Journal of Educational Psychology, 101, 561–576.

doi:10.1037/a0014701

Fuchs, L. S., Zumeta, R. O., Schumacher, R. F., Powell, S. R., Seethaler, P. M.,

Hamlett, C. L., & Fuchs, D. (2010b). The effects of schemabroadening

instruction on second graders’ wordproblem performance and their ability to

represent word problems with algebraic equations: A randomized control

study. The Elementary School Journal, 110, 440–463. doi:10.1086/651191

Ginns, P. (2005). Metaanalysis of the modality effect. Learning and Instruction,

15, 313–331. doi:10.1016/j.learninstruc.2005.07.001.

Ginns, P., Martin, A., & Marsh, H. (2013). Designing instructional text in a

conversational style: a metaanalysis. Educational Psychology Review, 25

(4), 1–28. doi:10.1007/s1064801392280.

Ginsburg, H. P. (1983). The Development of Mathematical Thinking. Orlando

(FL): Academic Press, Inc.

Goos, M. (2002). Understanding metacognitive failure. Journal of Mathematical

Behavior, 21, 283–302.

Gräsel, C., Fischer, F., & Mandl, H. (2000). The use of additional information in

problemoriented learning environments. Learning Environment Research,

3, 287–325. doi:10.1023/A:1011421732004.

Groff, J. & Mouza, C. (2008). A framework for addressing challenges to classroom

technology use. AACE Journal, 16, 2146.

Guskey, T. R., & Yoon, K. S. (2009). What Works in Professional Development? Phi

Delta Kappan, 90 (7), 495500.

Page 8: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

216 217

Donker, A. S., De Boer, H., Kostons, D., DignathVan Ewijk, C. C., & Van der Werf,

M. P. (2014). Effectiveness of learning strategy instruction on academic

performance: a metaanalysis. Educational Research Review, 11, 1–26.

Dreyfus, T. & Eisenberg, T. (1996). On different factes of mathematical thinking. in

R. Sternberg & BenZeev (Eds). The Nature of Mathematical Thinking.

Hillsdale, NY: Lawrence Erlbaum Associates.

Dufresne, R. J. & Gerace, W. J. & Leonard, W. J. (1997). Solving physics problems

with multiple representations. The Physics Teacher, 35 (5), 270275.

Edens, K. & Potter, E. (2008). How Students "Unpack" the Structure of a Word

Problem: Graphic Representations and Problem Solving. Science and School

Mathematics Journal, 108 (5), 184–193.

Efklides, A. (2006). Metacognition and affect: What can metacognitive experiences

tell us about the learning process? Educational Research Review, 1, 314.

Erkens, G., Kanselaar, G., Prangsma, M., & Jaspers, J. (2003). Computer support

for collaborative and argumentative writing. In E. de Corte (Ed.), Powerful

learning environments (pp. 159–177). Amsterdam: Pergamon.

Fischer, F., & Mandl, H. (2002). Facilitating knowledge convergence in

videoconferencing environments: The role of external representation tools.

Paper presented at the Computer Support for Collaborative Learning:

Foundations for a CSCL Community Conference, Boulder, CO., University of

Munrich, Germany

Foshay, R., & Kirkley, J. (2003). Principles for teaching problem solving

(Technical Paper No. 4). Retrieved from PLATO Learning

website:http://www.learningace.com/doc/2440565/e094c08dc4a564128df

491521b5d4ef8/2003_foshay_platolearninginc_techpaper4_principles

forteachingproblemsolving

Fuchs, L. S., Fuchs, D., Stuebing, K., Fletcher, J. M., Hamlett, C. L., & Lambert, W.

(2008). Problem solving and computational skill: Are they shared or distinct

aspects of mathematical cognition? Journal of Educational Psychology, 100,

30–47. doi:10.1037/00220663.100.1.30

Fuchs, L. S., Powell, S. R., Seethaler, P. M., Cirino, P. T., Fletcher, J. M., Fuchs, D.,

& Hamlett, C. L. (2010a). The effects of strategic counting instruction, with

and without deliberate practice, on number combination skill among

students with mathematics difficulties. Learning and Individual Differences,

20, 89–100. doi:10.1016/j.lindif.2009.09.003

Fuchs, L. S., Powell, S. R., Seethaler, P. M., Cirino, P. T., Fletcher, J. M., Fuchs,

D.,…Zumeta, R. O. (2009). Remediating number combination and word

problem deficits among students with mathematics difficulties: A

randomized control trial. Journal of Educational Psychology, 101, 561–576.

doi:10.1037/a0014701

Fuchs, L. S., Zumeta, R. O., Schumacher, R. F., Powell, S. R., Seethaler, P. M.,

Hamlett, C. L., & Fuchs, D. (2010b). The effects of schemabroadening

instruction on second graders’ wordproblem performance and their ability to

represent word problems with algebraic equations: A randomized control

study. The Elementary School Journal, 110, 440–463. doi:10.1086/651191

Ginns, P. (2005). Metaanalysis of the modality effect. Learning and Instruction,

15, 313–331. doi:10.1016/j.learninstruc.2005.07.001.

Ginns, P., Martin, A., & Marsh, H. (2013). Designing instructional text in a

conversational style: a metaanalysis. Educational Psychology Review, 25

(4), 1–28. doi:10.1007/s1064801392280.

Ginsburg, H. P. (1983). The Development of Mathematical Thinking. Orlando

(FL): Academic Press, Inc.

Goos, M. (2002). Understanding metacognitive failure. Journal of Mathematical

Behavior, 21, 283–302.

Gräsel, C., Fischer, F., & Mandl, H. (2000). The use of additional information in

problemoriented learning environments. Learning Environment Research,

3, 287–325. doi:10.1023/A:1011421732004.

Groff, J. & Mouza, C. (2008). A framework for addressing challenges to classroom

technology use. AACE Journal, 16, 2146.

Guskey, T. R., & Yoon, K. S. (2009). What Works in Professional Development? Phi

Delta Kappan, 90 (7), 495500.

Page 9: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

218 219

Gutwin, C., & Greenberg, S. (2004) The Importance of Awareness for Team

Cognition in Distributed Collaboration. In E. Salas and S. M. Fiore (Editors)

Team Cognition: Understanding the Factors that Drive Process and

Performance (pp. 177201), Washington: APA Press.

Harskamp, E. G., & Ding, N. (2006). Structured Collaboration versus Individual

Learning in Solving Physics Problems. International Journal of Science

Education, 28 (14), 1669–1688.

Harskamp, E. G., Mayer, R. E., & Suhre, C. (2007). Does the modality principle for

multimedia learning apply to science classrooms? Learning and Instruction,

17 (5), 465–477. doi:10.1016/j.learninstruc.2007.09.010.

Heidig, S., & Clarebout, G. (2011). Do pedagogical agents make a difference to

student motivation and learning? Educational Research Review, 6, 27–54.

doi:10.1016/j.edurev.2010.07.004.

Hegarty, M & Kozhevnikov, M. (1999). Types of visual–spatial representations and

mathematical problem solving. Journal of Educational Psychology, 91 (4),

684–689. doi:10.1037/00220663.91.4.684

Hegarty, M., Mayer, R. E., & Monk, C. A. (1995). Comprehension of

arithmetic word problems: A comparison of successful and

unsuccessful problem solvers. Journal of Educational Psychology,

87, 1832.

Hill, J. R. & Hannafin, M. J. (2001). Teaching and learning in digital environments:

the resurgence of resourcebased learning. Educational Technology

Research and Development, 49 (3), 37–52.

HmeloSilver, C. E., Chinn, C.A., Chan, C. K. & O’Donnell, A. (2013). The

International Handbook of Collaborative Learning. Routledge, New York.

Hodgen, J., & Marks, R. (2013). The Employment Equation: Why our young

people need more maths for today’s jobs. London.

Hohn, R. L., & Frey, B. (2002). Heuristic training and performance in elementary

mathematical problem solving. The Journal of Educational Research, 95,

374–380. doi:10.1080/00220670209596612

Hurme, T. R., & Järvelä, S. (2005). Student’s activity in computersupported

collaborative problem solving in mathematics. International Journal of

Computers for Mathematical Learning, 10, 49–73. doi: 10.1007/s10758005

45793

Inspectie van het Onderwijs. (2008). Basisvaardigheden rekenenwiskunde in het

basisonderwijs [Basic math skills in elementary education]. Utrecht, The

Netherlands: Author.

Jacobs, V. R., Franke, M. L., Carpenter, T. P., Levi, L., & Battey, D. (2007).

Professional development focused on children’s algebraic reasoning in

elementary schools. Journal for Research in Mathematics Education ,

38 (3), 258288.

Jacobse, A. E. (2012). Can we improve children’s thinking? (Doctoral dissertation).

Groningen, The Netherlands: University of Groningen.

Jacobse, A. E., & Harskamp, E. G. (2009). Studentcontrolled metacognitive

training for solving word problems in primary school mathematics.

Educational Research and Evaluation, 15, 447–463.

doi:10.1080/13803610903444519

Janssen, J. (2014). Opening the black box of collaborative learning: A meta

analysis investigating the antecedents and consequences of collaborative

interaction. Report no. 41111632 commissioned by NWOPROO and NRO.

University of Utrecht, Utrecht (2014)

Janssen, J., Erkens, G., & Kirschner, P. A. (2011). Group awareness tools: It’s what

you do with it that matters. Computers in Human Behavior, 27, 1046–1058.

doi:10.1016/j.chb.2010.06.002

Jitendra, A. K., Dupuis, D. N., Rodriguez, M. C., Zaslofsky, A. F., Slater, S., Cozine

Corroy, K., & Church, C. (2013). A randomized controlled trial of the impact

of schemabased instruction on mathematical outcomes for third grade

students with mathematics difficulties. The Elementary School Journal, 114

(2), 252–276.

Page 10: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

218 219

Gutwin, C., & Greenberg, S. (2004) The Importance of Awareness for Team

Cognition in Distributed Collaboration. In E. Salas and S. M. Fiore (Editors)

Team Cognition: Understanding the Factors that Drive Process and

Performance (pp. 177201), Washington: APA Press.

Harskamp, E. G., & Ding, N. (2006). Structured Collaboration versus Individual

Learning in Solving Physics Problems. International Journal of Science

Education, 28 (14), 1669–1688.

Harskamp, E. G., Mayer, R. E., & Suhre, C. (2007). Does the modality principle for

multimedia learning apply to science classrooms? Learning and Instruction,

17 (5), 465–477. doi:10.1016/j.learninstruc.2007.09.010.

Heidig, S., & Clarebout, G. (2011). Do pedagogical agents make a difference to

student motivation and learning? Educational Research Review, 6, 27–54.

doi:10.1016/j.edurev.2010.07.004.

Hegarty, M & Kozhevnikov, M. (1999). Types of visual–spatial representations and

mathematical problem solving. Journal of Educational Psychology, 91 (4),

684–689. doi:10.1037/00220663.91.4.684

Hegarty, M., Mayer, R. E., & Monk, C. A. (1995). Comprehension of

arithmetic word problems: A comparison of successful and

unsuccessful problem solvers. Journal of Educational Psychology,

87, 1832.

Hill, J. R. & Hannafin, M. J. (2001). Teaching and learning in digital environments:

the resurgence of resourcebased learning. Educational Technology

Research and Development, 49 (3), 37–52.

HmeloSilver, C. E., Chinn, C.A., Chan, C. K. & O’Donnell, A. (2013). The

International Handbook of Collaborative Learning. Routledge, New York.

Hodgen, J., & Marks, R. (2013). The Employment Equation: Why our young

people need more maths for today’s jobs. London.

Hohn, R. L., & Frey, B. (2002). Heuristic training and performance in elementary

mathematical problem solving. The Journal of Educational Research, 95,

374–380. doi:10.1080/00220670209596612

Hurme, T. R., & Järvelä, S. (2005). Student’s activity in computersupported

collaborative problem solving in mathematics. International Journal of

Computers for Mathematical Learning, 10, 49–73. doi: 10.1007/s10758005

45793

Inspectie van het Onderwijs. (2008). Basisvaardigheden rekenenwiskunde in het

basisonderwijs [Basic math skills in elementary education]. Utrecht, The

Netherlands: Author.

Jacobs, V. R., Franke, M. L., Carpenter, T. P., Levi, L., & Battey, D. (2007).

Professional development focused on children’s algebraic reasoning in

elementary schools. Journal for Research in Mathematics Education ,

38 (3), 258288.

Jacobse, A. E. (2012). Can we improve children’s thinking? (Doctoral dissertation).

Groningen, The Netherlands: University of Groningen.

Jacobse, A. E., & Harskamp, E. G. (2009). Studentcontrolled metacognitive

training for solving word problems in primary school mathematics.

Educational Research and Evaluation, 15, 447–463.

doi:10.1080/13803610903444519

Janssen, J. (2014). Opening the black box of collaborative learning: A meta

analysis investigating the antecedents and consequences of collaborative

interaction. Report no. 41111632 commissioned by NWOPROO and NRO.

University of Utrecht, Utrecht (2014)

Janssen, J., Erkens, G., & Kirschner, P. A. (2011). Group awareness tools: It’s what

you do with it that matters. Computers in Human Behavior, 27, 1046–1058.

doi:10.1016/j.chb.2010.06.002

Jitendra, A. K., Dupuis, D. N., Rodriguez, M. C., Zaslofsky, A. F., Slater, S., Cozine

Corroy, K., & Church, C. (2013). A randomized controlled trial of the impact

of schemabased instruction on mathematical outcomes for third grade

students with mathematics difficulties. The Elementary School Journal, 114

(2), 252–276.

Page 11: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

220 221

Jitendra, A. K., PetersonBrown, S., Lein, A., Zaslofsky, A., Kunkel, A., Jung, PG.,

& Egan, A. (2015). Teaching mathematical word problem solving: The

quality of evidence for strategy instruction priming the problem structure.

Journal of Learning Disabilities, 48 (1), 51–72.

Jitendra, A. K., Rodriguez, M., Kanive, R. G., Huang, JP., Church, C., Corroy, K. C.,

& Zaslofsky, A. F. (2013). The impact of smallgroup tutoring interventions

on the mathematical problem solving and achievement of third grade

students with mathematics difficulties. Learning Disability Quarterly, 36,

21–35.

Jitendra, A. K., Star, J., Starosta, K., Leh, J., Sood, S., Caskie, G., & Mack, T.

(2009). Improving students’ learning of ratio and proportion problem

solving: The role of schemabased instruction. Contemporary Educational

Psychology, 34 (3), 250–264.

Johnson, D. W., & Johnson, R. T. (1999). Making cooperative learning work.

Theory into Practice, 38 (2), 67–73.

Johnson, D. W. & Johnson R. T. (2009). An Educational Psychology Success Story:

Social Interdependence Theory and Cooperative Learning. Educational

Researcher, 38, 365 – 379.

Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational

Technology Research and Development, 48 (4), 6385.

Jonassen, D. H. (2003). Using cognitive tools to represent problems. Journal of

Research on Technology in Education, 35 (3), 362381.

Jonassen, D. H. (2010). Learning to solve problems: A handbook. New York:

Routledge.

Kirschner, F., Paas, F., & Kirschner, P. A. (2009). A cognitive load approach to

collaborative learning: United brains for complex tasks. Educational

Psychological Review, 21, 31–42. doi:10.1007/s1064800890952

Koedinger, K. R., & Aleven, V. (2007). Exploring the assistance dilemma in

experiments with cognitive tutors. Educational Psychology Review, 19, 239–

264. doi:10.1007/s1064800790490.

Koedinger, K. R., & Nathan, M. J. (2004). The real story behind story problems:

Effects of representations on quantitative reasoning. Journal of the Learning

Sciences, 13, 129–164.

Kolfschoten, G. L., Vreede, G. J. de, Briggs, R. O., & Sol, H. G. (2010).

Collaboration ‘Engineerability’. Group Decision & Negotiation, 19 (3), 301

312.

Kollar I., Fischer F., & Hesse F. W. (2006). Collaboration scripts—A conceptual

analysis. Educational Psychology Review, 18, 159–185. doi:10.1007/s10648

00690072.

Kollar, I., Ufer, S., Reichersdorfer, E., Vogel, F., Fischer, F., & Reiss, K. (2014).

Effects of Collaboration Scripts and Heuristic Worked Examples on the

Acquisition of Mathematical Argumentation Skills of Teacher Students with

Different Levels of Prior Achievement. Learning and Instruction, 32, 2236.

Kramarski, B., & Friedman, S. (2014). Solicited versus Unsolicited Metacognitive

Prompts for Fostering Mathematical ProblemSolving Using Multimedia.

Journal of Educational Computing Research, 50 (3), 285–314.

Kramarski, B., & Gutman, M. (2006). How can selfregulated learning be

supported in mathematical Elearning environments? Journal of Computer

Assisted Learning, 22, 24–33. doi:10.1111/j.13652729.2006.00157.x

Kroesbergen, E. H., & Van Luit, J. E. H. (2002). Teaching multiplication to low

math performers: Guided versus structured instruction. Instructional

Science, 30, 361–378. doi:10.1023/A:1019880913714

Ku, H., Harter, C., Liu, P., Thompson, L., & Cheng, Y. (2007). The effects of

individually personalized computerbased instructional program on solving

mathematics problems. Computers in Human Behavior, 23 (3), 1195–1210.

Kyndt, E., Raes, E., Lismont, B., Timmers, F., Cascallar, E., & Dochy, F. (2013). A

metaanalysis of the effects of facetoface cooperative learning. Do recent

studies falsify or verify earlier findings? Educational Research Review,

10(0), 133149. doi:10.1016/j.edurev.2013.02.002

Larkin, J., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten

thousand words. Cognitive Science, 11, 6599.

Page 12: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

220 221

Jitendra, A. K., PetersonBrown, S., Lein, A., Zaslofsky, A., Kunkel, A., Jung, PG.,

& Egan, A. (2015). Teaching mathematical word problem solving: The

quality of evidence for strategy instruction priming the problem structure.

Journal of Learning Disabilities, 48 (1), 51–72.

Jitendra, A. K., Rodriguez, M., Kanive, R. G., Huang, JP., Church, C., Corroy, K. C.,

& Zaslofsky, A. F. (2013). The impact of smallgroup tutoring interventions

on the mathematical problem solving and achievement of third grade

students with mathematics difficulties. Learning Disability Quarterly, 36,

21–35.

Jitendra, A. K., Star, J., Starosta, K., Leh, J., Sood, S., Caskie, G., & Mack, T.

(2009). Improving students’ learning of ratio and proportion problem

solving: The role of schemabased instruction. Contemporary Educational

Psychology, 34 (3), 250–264.

Johnson, D. W., & Johnson, R. T. (1999). Making cooperative learning work.

Theory into Practice, 38 (2), 67–73.

Johnson, D. W. & Johnson R. T. (2009). An Educational Psychology Success Story:

Social Interdependence Theory and Cooperative Learning. Educational

Researcher, 38, 365 – 379.

Jonassen, D. H. (2000). Toward a design theory of problem solving. Educational

Technology Research and Development, 48 (4), 6385.

Jonassen, D. H. (2003). Using cognitive tools to represent problems. Journal of

Research on Technology in Education, 35 (3), 362381.

Jonassen, D. H. (2010). Learning to solve problems: A handbook. New York:

Routledge.

Kirschner, F., Paas, F., & Kirschner, P. A. (2009). A cognitive load approach to

collaborative learning: United brains for complex tasks. Educational

Psychological Review, 21, 31–42. doi:10.1007/s1064800890952

Koedinger, K. R., & Aleven, V. (2007). Exploring the assistance dilemma in

experiments with cognitive tutors. Educational Psychology Review, 19, 239–

264. doi:10.1007/s1064800790490.

Koedinger, K. R., & Nathan, M. J. (2004). The real story behind story problems:

Effects of representations on quantitative reasoning. Journal of the Learning

Sciences, 13, 129–164.

Kolfschoten, G. L., Vreede, G. J. de, Briggs, R. O., & Sol, H. G. (2010).

Collaboration ‘Engineerability’. Group Decision & Negotiation, 19 (3), 301

312.

Kollar I., Fischer F., & Hesse F. W. (2006). Collaboration scripts—A conceptual

analysis. Educational Psychology Review, 18, 159–185. doi:10.1007/s10648

00690072.

Kollar, I., Ufer, S., Reichersdorfer, E., Vogel, F., Fischer, F., & Reiss, K. (2014).

Effects of Collaboration Scripts and Heuristic Worked Examples on the

Acquisition of Mathematical Argumentation Skills of Teacher Students with

Different Levels of Prior Achievement. Learning and Instruction, 32, 2236.

Kramarski, B., & Friedman, S. (2014). Solicited versus Unsolicited Metacognitive

Prompts for Fostering Mathematical ProblemSolving Using Multimedia.

Journal of Educational Computing Research, 50 (3), 285–314.

Kramarski, B., & Gutman, M. (2006). How can selfregulated learning be

supported in mathematical Elearning environments? Journal of Computer

Assisted Learning, 22, 24–33. doi:10.1111/j.13652729.2006.00157.x

Kroesbergen, E. H., & Van Luit, J. E. H. (2002). Teaching multiplication to low

math performers: Guided versus structured instruction. Instructional

Science, 30, 361–378. doi:10.1023/A:1019880913714

Ku, H., Harter, C., Liu, P., Thompson, L., & Cheng, Y. (2007). The effects of

individually personalized computerbased instructional program on solving

mathematics problems. Computers in Human Behavior, 23 (3), 1195–1210.

Kyndt, E., Raes, E., Lismont, B., Timmers, F., Cascallar, E., & Dochy, F. (2013). A

metaanalysis of the effects of facetoface cooperative learning. Do recent

studies falsify or verify earlier findings? Educational Research Review,

10(0), 133149. doi:10.1016/j.edurev.2013.02.002

Larkin, J., & Simon, H. A. (1987). Why a diagram is (sometimes) worth ten

thousand words. Cognitive Science, 11, 6599.

Page 13: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

222 223

Lee, H., Lim, K., & Grabowski, B. L. (2010). Improving selfregulation, learning

strategy use, and achievement with metacognitive feedback. Educational

Technology Research and Development, 58 (6), 629–648.

Lesh, R., & Doerr, H. (2000). Symbolizing, communicating and mathematizing:

Key components of models and modeling. In P. Cobb, E. Yackel, & K.

McClain (Eds.), Symbolizing and communicating in mathematics

classrooms (pp. 361–383). Mahwah, NJ: Lawrence Erlbaum.

Li, Q., & Ma, X. (2010). A metaanalysis of the effects of computer technology on

school students’ mathematics learning. Educational Psychology Review, 22,

215–243. doi:10.1007/s1064801091258

Lipponen, L., Rahikainen, M., Lallimo, J., & Hakkarainen, K. (2001). Analyzing

patterns of participation and discourse in elementary students’ online

science discussion. In P. Dillenbourg, A. Eurelings., & K. Hakkarainen (Eds.),

European Perspectives on ComputerSupported Collaborative Learning.

Proceedings of the First European Conference on CSCL (pp. 421428).

Maastricht, the Netherlands: Maastricht McLuhan Institute.

Liu, M., Bera, S., Corliss, S. B., Svinicki, M. D., & Beth, A. D. (2004).

Understanding the Connection Between Cognitive Tool Use and Cognitive

Processes as used by Sixth Graders in a ProblemBased Hypermedia

Learning Environment. Journal of Educational Computing Research, 31 (3),

309–334.

Low, R., & Over, R. (1989). Detection of missing irrelevant information within

algebraic story problems. Britisch Journal of Educational Psychology, 59

(3), 296–305.

Low, R., & Over, R. (1990). Text editing of algebraic word problems. Australian

Journal of Psychology, 42 (1), 63–73.

Lu, J., Lajoie, S. P., & Wiseman, J. (2010). Scaffolding problembased learning with

tools. International Journal of ComputerSupported Collaborative

Learning, 5 (3), 283–298. doi:10.1007/s1141201090926

Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty:

Replication in the education sciences. Educational Researcher, 43, 304–316.

doi:10.3102/0013189x14545513

Martin, M.O. & Mullis, I.V.S. (Eds.). (2013). TIMSS and PIRLS 2011: Relationships

Among Reading, Mathematics, and Science Achievement at the Fourth

Grade—Implications for Early Learning. Chestnut Hill, MA: TIMSS &

PIRLS International Study Center, Boston College.

Mayer, R. E. (1992) Thinking, problem solving, cognition (2nd Ed.). New York: W.

H. Freeman.

Mayer, R. E., Dow, G., & Mayer, S. (2003). Multimedia learning in an interactive

selfexplaining environment: what works in the design of agentbased

microworlds? Journal of Educational Psychology, 95, 806–813.

Mayer, R. E., & Hegarty, M. (1996). The process of understanding mathematical

problem solving. In: Sternberg, R. J. and BenZeev T., (Eds.), The nature of

mathematical thinking (pp. 29–54).Mahwah, NJ: Erlbaum.

Mayer, R. E., Mathias, A., & Wetzell, K. (2002). Fostering understanding of

multimedia messages through pretraining: Evidence for a twostage theory

of mental model construction. Journal of Experimental Psychology:

Applied, 8,147–154. doi:10.1037/1076898X.8.3.147

McLaren, B.M., van Gog, T., Ganoe, C., Karabinos, M., & Yaron, D. (2016). The

efficiency of worked examples compared to erroneous examples, tutored

problem solving, and problem solving in classroom experiments. Computers

in Human Behavior, 55, 8799. doi:10.1016/j.chb.2015.08.038

Meijer, J., & Riemersma, F. (2002). Teaching and testing mathematical problem

solving by offering optional assistance. Instructional Science, 30, 187–220.

Mevarech, Z. R., & Kramarski, B. (1997). IMPROVE: A multidimensional method

for teaching mathematics in heterogeneous classrooms. American

Educational Research Journal 34 (2), 365–394.

Mevarech, Z. R., & Kramarski, B. (2003). The effects of metacognitive training

versus workedout examples on students' mathematical reasoning. British

Journal of Educational Psychology, 73 (4), 449–471.

Montague, M., Enders C., & Dietz, S. (2011). Effects of cognitive strategy

instruction on math problem solving of middle school students with learning

disabilities. Learning Disability Quaterly, 34 (4), 262–272.

Page 14: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

222 223

Lee, H., Lim, K., & Grabowski, B. L. (2010). Improving selfregulation, learning

strategy use, and achievement with metacognitive feedback. Educational

Technology Research and Development, 58 (6), 629–648.

Lesh, R., & Doerr, H. (2000). Symbolizing, communicating and mathematizing:

Key components of models and modeling. In P. Cobb, E. Yackel, & K.

McClain (Eds.), Symbolizing and communicating in mathematics

classrooms (pp. 361–383). Mahwah, NJ: Lawrence Erlbaum.

Li, Q., & Ma, X. (2010). A metaanalysis of the effects of computer technology on

school students’ mathematics learning. Educational Psychology Review, 22,

215–243. doi:10.1007/s1064801091258

Lipponen, L., Rahikainen, M., Lallimo, J., & Hakkarainen, K. (2001). Analyzing

patterns of participation and discourse in elementary students’ online

science discussion. In P. Dillenbourg, A. Eurelings., & K. Hakkarainen (Eds.),

European Perspectives on ComputerSupported Collaborative Learning.

Proceedings of the First European Conference on CSCL (pp. 421428).

Maastricht, the Netherlands: Maastricht McLuhan Institute.

Liu, M., Bera, S., Corliss, S. B., Svinicki, M. D., & Beth, A. D. (2004).

Understanding the Connection Between Cognitive Tool Use and Cognitive

Processes as used by Sixth Graders in a ProblemBased Hypermedia

Learning Environment. Journal of Educational Computing Research, 31 (3),

309–334.

Low, R., & Over, R. (1989). Detection of missing irrelevant information within

algebraic story problems. Britisch Journal of Educational Psychology, 59

(3), 296–305.

Low, R., & Over, R. (1990). Text editing of algebraic word problems. Australian

Journal of Psychology, 42 (1), 63–73.

Lu, J., Lajoie, S. P., & Wiseman, J. (2010). Scaffolding problembased learning with

tools. International Journal of ComputerSupported Collaborative

Learning, 5 (3), 283–298. doi:10.1007/s1141201090926

Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty:

Replication in the education sciences. Educational Researcher, 43, 304–316.

doi:10.3102/0013189x14545513

Martin, M.O. & Mullis, I.V.S. (Eds.). (2013). TIMSS and PIRLS 2011: Relationships

Among Reading, Mathematics, and Science Achievement at the Fourth

Grade—Implications for Early Learning. Chestnut Hill, MA: TIMSS &

PIRLS International Study Center, Boston College.

Mayer, R. E. (1992) Thinking, problem solving, cognition (2nd Ed.). New York: W.

H. Freeman.

Mayer, R. E., Dow, G., & Mayer, S. (2003). Multimedia learning in an interactive

selfexplaining environment: what works in the design of agentbased

microworlds? Journal of Educational Psychology, 95, 806–813.

Mayer, R. E., & Hegarty, M. (1996). The process of understanding mathematical

problem solving. In: Sternberg, R. J. and BenZeev T., (Eds.), The nature of

mathematical thinking (pp. 29–54).Mahwah, NJ: Erlbaum.

Mayer, R. E., Mathias, A., & Wetzell, K. (2002). Fostering understanding of

multimedia messages through pretraining: Evidence for a twostage theory

of mental model construction. Journal of Experimental Psychology:

Applied, 8,147–154. doi:10.1037/1076898X.8.3.147

McLaren, B.M., van Gog, T., Ganoe, C., Karabinos, M., & Yaron, D. (2016). The

efficiency of worked examples compared to erroneous examples, tutored

problem solving, and problem solving in classroom experiments. Computers

in Human Behavior, 55, 8799. doi:10.1016/j.chb.2015.08.038

Meijer, J., & Riemersma, F. (2002). Teaching and testing mathematical problem

solving by offering optional assistance. Instructional Science, 30, 187–220.

Mevarech, Z. R., & Kramarski, B. (1997). IMPROVE: A multidimensional method

for teaching mathematics in heterogeneous classrooms. American

Educational Research Journal 34 (2), 365–394.

Mevarech, Z. R., & Kramarski, B. (2003). The effects of metacognitive training

versus workedout examples on students' mathematical reasoning. British

Journal of Educational Psychology, 73 (4), 449–471.

Montague, M., Enders C., & Dietz, S. (2011). Effects of cognitive strategy

instruction on math problem solving of middle school students with learning

disabilities. Learning Disability Quaterly, 34 (4), 262–272.

Page 15: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

224 225

Moran, A. S., Swanson, H. L., Gerber, M. M., & Fung, W. (2014). The effects of

paraphrasing interventions on problemsolving accuracy for math

disabilities. Learning Disabilities Research & Practice, 29 (3), 97–105.

Moreno, R. (2005). Multimedia learning with animated pedagogical agents. In R.

Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 507–

523). New York, NY: Cambridge University Press.

Moreno, R. (2006). When worked examples don’t work: Is cognitive load theory at

an impasse? Learning and Instruction, 16, 170181.

doi:10.1016/j.learninstruc.2006.02.006

Moreno, R., & Mayer, R. (2002). Learning science in virtual reality multimedia

environments: role of methods and media. Journal of Educational

Psychology, 94 (3), 598–610. doi:10.1037//00220663.94.3.598.

Moreno, R., Mayer, R., & Lester, J. (2000). Lifelike pedagogical agents in

constructivist multimedia environments: cognitive consequences of their

interaction. In J. Bourdeau, & R. Heller (Eds.), Proceedings of World

Conference on Educational Multimedia, Hypermedia and

Telecommunications 2000 (pp. 776–781). Chesapeake, VA: AACE. Retrieved

October 17, 2013 from http://www.editlib.org/p/16160.

Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001). The case for social

agency in computerbased teaching. Do students learn more deeply when

they interact with animated pedagogical agents? Cognition and Instruction,

19 (2), 177–213. doi:10.1207/S1532690XCI1902_02.

Murphy, P. K., & Alexander, P. A. (2002). What counts? The predictive power of

subjectmatter knowledge, strategic processing, and interest in domain

specific performance. Journal of Experimental Education, 70, 197–214.

Mullis, I. V. S., Martin, M. O., Foy, P., & Arora, A. (2012). TIMSS 2011

International Results in Mathematics. Chestnut Hill, MA: Boston College,

TIMSS and PIRLS International Study Center.

http://timssandpirls.bc.edu/timss2011/reports/internationalresults

mathematics.html

Nelson, M. C., Cordray, D. S., Hulleman, C. S., Darrow, C. L., & Sommer, E. C.

(2012). A procedure for assessing intervention fidelity in experiments testing

educational and behavioral interventions. Journal of Behavioral Health

Services & Research, 39 (4), 374–396. doi: 10.1007/s114140129295x

OECD (2014). PISA 2012 Results: Creative Problem Solving: Students’ Skills in

Tackling RealLife Problems (Volume V). PISA, OECD publishing.

http://dx.doi.org/10.1787/9789264208070en

Olsen, J. K., Aleven, V., & Rummel N. (2015). Toward combining individual and

collaborative learning with an intelligent tutoring system. In: Conati, S.,

Hefferman, N., Mitrovic, A., Felisa Verdejo., M. (eds) Artificial Intelligence in

Education, 848851. doi:10.1007/9783319197739_130.

Olsen, J. K., Belenky, D. M., Aleven, V., & Rummel N. (2014). Using an intelligent

tutoring system to support collaborative as well as individual learning. In:

TrausanMatu, S., Boyer, K. E., Crosby, M., & Panourgia, K. (eds.) ITS 2014,

8474, 134143. Springer, Heidelberg. doi: 10.1007/9783319072210_16.

Palinscar, A. S., & Herrenkohl, L. R. (2002). Designing collaborative learning

contexts. Theory into Practice, 41, 2732.

Parmar, R. S., Cawley, J. F., & Frazita, R. R. (1996). Word problemsolving by

students with and without mild disabilities. Exceptional Children, 62, 415–

429.

Passolunghi, M. C., Marzocchi, G. M. & Fiorillo, F. (2005). Selective effect of

inhibition of literal or numerical irrelevant information in children with

attention deficit hyperactivity disorder (ADHD) or arithmetic learning

disorder (ALD). Developmental Neuropsychology, 28 (3), 731–753.

Pellegrino, J. W., & Hilton, M. L. (2012). Education for Life and Work: Developing

Transferrable Knowledge and Skill in the 21st Century. Washington, D.C.:

The National Academies Press.

PenaShaff, J. B., & Nicholls, C. (2004). Analyzing student interactions and

meaning construction in computer bulletin board discussions. Computers &

Education, 42, 243–265.

Page 16: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

224 225

Moran, A. S., Swanson, H. L., Gerber, M. M., & Fung, W. (2014). The effects of

paraphrasing interventions on problemsolving accuracy for math

disabilities. Learning Disabilities Research & Practice, 29 (3), 97–105.

Moreno, R. (2005). Multimedia learning with animated pedagogical agents. In R.

Mayer (Ed.), The Cambridge Handbook of Multimedia Learning (pp. 507–

523). New York, NY: Cambridge University Press.

Moreno, R. (2006). When worked examples don’t work: Is cognitive load theory at

an impasse? Learning and Instruction, 16, 170181.

doi:10.1016/j.learninstruc.2006.02.006

Moreno, R., & Mayer, R. (2002). Learning science in virtual reality multimedia

environments: role of methods and media. Journal of Educational

Psychology, 94 (3), 598–610. doi:10.1037//00220663.94.3.598.

Moreno, R., Mayer, R., & Lester, J. (2000). Lifelike pedagogical agents in

constructivist multimedia environments: cognitive consequences of their

interaction. In J. Bourdeau, & R. Heller (Eds.), Proceedings of World

Conference on Educational Multimedia, Hypermedia and

Telecommunications 2000 (pp. 776–781). Chesapeake, VA: AACE. Retrieved

October 17, 2013 from http://www.editlib.org/p/16160.

Moreno, R., Mayer, R. E., Spires, H. A., & Lester, J. C. (2001). The case for social

agency in computerbased teaching. Do students learn more deeply when

they interact with animated pedagogical agents? Cognition and Instruction,

19 (2), 177–213. doi:10.1207/S1532690XCI1902_02.

Murphy, P. K., & Alexander, P. A. (2002). What counts? The predictive power of

subjectmatter knowledge, strategic processing, and interest in domain

specific performance. Journal of Experimental Education, 70, 197–214.

Mullis, I. V. S., Martin, M. O., Foy, P., & Arora, A. (2012). TIMSS 2011

International Results in Mathematics. Chestnut Hill, MA: Boston College,

TIMSS and PIRLS International Study Center.

http://timssandpirls.bc.edu/timss2011/reports/internationalresults

mathematics.html

Nelson, M. C., Cordray, D. S., Hulleman, C. S., Darrow, C. L., & Sommer, E. C.

(2012). A procedure for assessing intervention fidelity in experiments testing

educational and behavioral interventions. Journal of Behavioral Health

Services & Research, 39 (4), 374–396. doi: 10.1007/s114140129295x

OECD (2014). PISA 2012 Results: Creative Problem Solving: Students’ Skills in

Tackling RealLife Problems (Volume V). PISA, OECD publishing.

http://dx.doi.org/10.1787/9789264208070en

Olsen, J. K., Aleven, V., & Rummel N. (2015). Toward combining individual and

collaborative learning with an intelligent tutoring system. In: Conati, S.,

Hefferman, N., Mitrovic, A., Felisa Verdejo., M. (eds) Artificial Intelligence in

Education, 848851. doi:10.1007/9783319197739_130.

Olsen, J. K., Belenky, D. M., Aleven, V., & Rummel N. (2014). Using an intelligent

tutoring system to support collaborative as well as individual learning. In:

TrausanMatu, S., Boyer, K. E., Crosby, M., & Panourgia, K. (eds.) ITS 2014,

8474, 134143. Springer, Heidelberg. doi: 10.1007/9783319072210_16.

Palinscar, A. S., & Herrenkohl, L. R. (2002). Designing collaborative learning

contexts. Theory into Practice, 41, 2732.

Parmar, R. S., Cawley, J. F., & Frazita, R. R. (1996). Word problemsolving by

students with and without mild disabilities. Exceptional Children, 62, 415–

429.

Passolunghi, M. C., Marzocchi, G. M. & Fiorillo, F. (2005). Selective effect of

inhibition of literal or numerical irrelevant information in children with

attention deficit hyperactivity disorder (ADHD) or arithmetic learning

disorder (ALD). Developmental Neuropsychology, 28 (3), 731–753.

Pellegrino, J. W., & Hilton, M. L. (2012). Education for Life and Work: Developing

Transferrable Knowledge and Skill in the 21st Century. Washington, D.C.:

The National Academies Press.

PenaShaff, J. B., & Nicholls, C. (2004). Analyzing student interactions and

meaning construction in computer bulletin board discussions. Computers &

Education, 42, 243–265.

Page 17: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

226 227

Pfannenstiel, K. H., Bryant, D. P., Bryant, B.R., & Porterfield, J. A. (2015).

Cognitive strategy instruction for teaching word problems to primarylevel

struggling students. Intervention in School and Clinic, 50 (5), 291–296. doi:

10.1177/1053451214560890

Pfister, H. R. (2005). How to support synchronous netbased learning discourses:

Principles and perspectives. In R. Bromme, F. Hesse & H. Spada (Eds.).

Barriers and biases in computermediated knowledge communication (pp.

39–57). New York: Springer.

Powell, S. R. (2011). Solving word problems using schemas: A review of the

literature. Learning Disabilities Research & Practice, 26 (2), 94–108.

Prinsen, F. R., Volman, M. L. L., & Terwel, J. (2006). The influence of learner

characteristics on degree and type of participation in a CSCL environment.

British Journal of Educational Technology, 38 (6), 10371055.

doi:10.1111/j.14678535.2006.00692.x

Rasbash, J., Steele, F., Browne, W. J., & Goldstein, H. (2012). A user’s guide to

MLwiN, v2.26. Bristol: Centre for Multilevel Modelling, University of

Bristol.

Rau, W. & Heyl, B. S. (1990). Humanizing the college classroom: Collaborative

learning and social organization among students. Teaching Sociology, 18,

141–155.

Reinwein, J. (2012). Does the modality effect exist? And if so, which modality

effect? Journal of Psycholinguistic Research, 41, 1–32. doi:10.1007/s10936

01191804.

Renkl, A. (2011). Instruction based on examples. In R. E. Mayer & P. A. Alexander

(Eds.), Handbook of research on learning and instruction (pp. 272295).

New York: Routledge.

Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007). Cognitive tutor:

applied research in mathematics education. Psychonomic Bulletin & Review,

14 (2), 249–255.

RittleJohnson, B., & Koedinger, K. R. (2005). Designing knowledge scaffolds to

support mathematical problem solving. Cognition and Instruction, 23 (3),

313–349. doi:10.1207/s1532690xci2303_1

Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2007). Designing for

metacognition—applying cognitive tutor principles to the tutoring of help

seeking. Metacognition and Learning, 2 (23), 125–140.

Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2011). Improving students’

helpseeking skills using metacognitive feedback in an intelligent tutoring

system. Learning and Instruction, 21, 267–280.

Rummel, N., Mullins, D., & Spada, H. (2012). Scripted collaborative learning with

the cognitive tutor algebra. International Journal of Computer Supported

Collaborative Learning, 7 (2), 307339. doi:10.1007/s114120129146z.

Salomon, G., & Globerson, T. (1989). When teams don’t function the way they

ought to. International Journal of Educational Research, 13, 89–100.

Schoenfeld, A. H. (1992). Learning to think mathematically: Problem solving,

metacognition, and sense making in mathematics. In D. A. Grouws (Ed.),

Handbook of research on mathematics teaching (pp. 334–370). New York,

NY: Macmillan.

Schoenfeld, A. H. (2002). Research methods in (Mathematics) Education. In L.

English (Ed.), Handbook of International Research in Mathematics

Education (pp. 435–488). Mahwah, NJ: Erlbaum.

Schoenfeld, A. H. (2013). Reflections on problem solving theory and practice. The

Mathematics Enthusiast, 10 (12), 9–34.

Schraw, G. (2009). Measuring metacognitive judgments. In D. Hacker, J.

Dunlosky, & A. Greasser (Eds.), Handbook of metacognition in education

(pp. 415–429). New York, NY: Routledge.

Sfard, A., & Kieran, C. (2001). Cognition as communication: Rethinking learning

by talking through multifaceted analysis of students’ mathematical

interactions. Mind, Culture, and Activity, 8 (1), 42–76.

Sfard, A., Nesher, P., Streefland, L., Cobb, P., & Mason, J. (1998). Learning

mathematics through conversation: Is it as good as they say? A debate. For

the Learning of Mathematics, 18 (1), 41–51.

Simons, K. D., & Klein, J. D. (2007). The impact of scaffolding and student

achievement levels in a problembased learning environment. Instructional

Science, 35 (1), 41–72.

Page 18: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

226 227

Pfannenstiel, K. H., Bryant, D. P., Bryant, B.R., & Porterfield, J. A. (2015).

Cognitive strategy instruction for teaching word problems to primarylevel

struggling students. Intervention in School and Clinic, 50 (5), 291–296. doi:

10.1177/1053451214560890

Pfister, H. R. (2005). How to support synchronous netbased learning discourses:

Principles and perspectives. In R. Bromme, F. Hesse & H. Spada (Eds.).

Barriers and biases in computermediated knowledge communication (pp.

39–57). New York: Springer.

Powell, S. R. (2011). Solving word problems using schemas: A review of the

literature. Learning Disabilities Research & Practice, 26 (2), 94–108.

Prinsen, F. R., Volman, M. L. L., & Terwel, J. (2006). The influence of learner

characteristics on degree and type of participation in a CSCL environment.

British Journal of Educational Technology, 38 (6), 10371055.

doi:10.1111/j.14678535.2006.00692.x

Rasbash, J., Steele, F., Browne, W. J., & Goldstein, H. (2012). A user’s guide to

MLwiN, v2.26. Bristol: Centre for Multilevel Modelling, University of

Bristol.

Rau, W. & Heyl, B. S. (1990). Humanizing the college classroom: Collaborative

learning and social organization among students. Teaching Sociology, 18,

141–155.

Reinwein, J. (2012). Does the modality effect exist? And if so, which modality

effect? Journal of Psycholinguistic Research, 41, 1–32. doi:10.1007/s10936

01191804.

Renkl, A. (2011). Instruction based on examples. In R. E. Mayer & P. A. Alexander

(Eds.), Handbook of research on learning and instruction (pp. 272295).

New York: Routledge.

Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007). Cognitive tutor:

applied research in mathematics education. Psychonomic Bulletin & Review,

14 (2), 249–255.

RittleJohnson, B., & Koedinger, K. R. (2005). Designing knowledge scaffolds to

support mathematical problem solving. Cognition and Instruction, 23 (3),

313–349. doi:10.1207/s1532690xci2303_1

Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2007). Designing for

metacognition—applying cognitive tutor principles to the tutoring of help

seeking. Metacognition and Learning, 2 (23), 125–140.

Roll, I., Aleven, V., McLaren, B. M., & Koedinger, K. R. (2011). Improving students’

helpseeking skills using metacognitive feedback in an intelligent tutoring

system. Learning and Instruction, 21, 267–280.

Rummel, N., Mullins, D., & Spada, H. (2012). Scripted collaborative learning with

the cognitive tutor algebra. International Journal of Computer Supported

Collaborative Learning, 7 (2), 307339. doi:10.1007/s114120129146z.

Salomon, G., & Globerson, T. (1989). When teams don’t function the way they

ought to. International Journal of Educational Research, 13, 89–100.

Schoenfeld, A. H. (1992). Learning to think mathematically: Problem solving,

metacognition, and sense making in mathematics. In D. A. Grouws (Ed.),

Handbook of research on mathematics teaching (pp. 334–370). New York,

NY: Macmillan.

Schoenfeld, A. H. (2002). Research methods in (Mathematics) Education. In L.

English (Ed.), Handbook of International Research in Mathematics

Education (pp. 435–488). Mahwah, NJ: Erlbaum.

Schoenfeld, A. H. (2013). Reflections on problem solving theory and practice. The

Mathematics Enthusiast, 10 (12), 9–34.

Schraw, G. (2009). Measuring metacognitive judgments. In D. Hacker, J.

Dunlosky, & A. Greasser (Eds.), Handbook of metacognition in education

(pp. 415–429). New York, NY: Routledge.

Sfard, A., & Kieran, C. (2001). Cognition as communication: Rethinking learning

by talking through multifaceted analysis of students’ mathematical

interactions. Mind, Culture, and Activity, 8 (1), 42–76.

Sfard, A., Nesher, P., Streefland, L., Cobb, P., & Mason, J. (1998). Learning

mathematics through conversation: Is it as good as they say? A debate. For

the Learning of Mathematics, 18 (1), 41–51.

Simons, K. D., & Klein, J. D. (2007). The impact of scaffolding and student

achievement levels in a problembased learning environment. Instructional

Science, 35 (1), 41–72.

Page 19: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

228 229

Slavin, R. E. (1996). Research on cooperative learning and achievement: What we

know, what we need to know. Contemporary Educational Psychology, 21

(1), 43–69.

Slavin, R. E. (2009), Cooperative Learning. In G McCulloch, & D Crook (Eds),

International Encyclopedia of Education. Abington, UK: Routledge.

Slavin, R. E., & Karweit, N. L. (1985). Effects of WholeClass, AbilityGrouped, and

Individualized Instruction on Mathematics Achievement. American

Educational Research Journal. 22, 351–367.

Slavin, R. E. & Lake, C. (2008). Effective programs in elementary mathematics: A

bestevidence synthesis. Review of Educational Research, 78 (3), 427–515.

Stahl, G. (2000). A model of collaborative knowledgebuilding. In B. Fishman & S.

O’ConnosDivelbiss (Eds.), Fourth International Conference of the Learning

Sciences (pp. 7077). Mahwah, NJ: Erlbaum.

Stahl, G. (2004). Groupware goes to school: Adapting BSCW to the classroom.

International Journal of Computer Applications in Technology, 19 (3/4), 1–

13.

Stahl, G. (2009). Studying virtual math teams. New York, NY: Springer.

doi:10.1007/9781441902283

Stellingwerf, B. P., & Van Lieshout, E.C.D.M. (1999). Manipulatives and number

sentences in computer aided arithmetic word problem solving. Instructional

Science, 27, 459–476.

Strijbos, J. W., Martens, R. L., Jochems, W. M. G., & Broers, N. J. (2004). The

effect of functional roles on group efficiency using multilevel modelling and

content analysis to investigate computersupported collaboration in small

groups. Small Group Research, 35, 195229.

Strijbos, J. W., Martens, R. L., Jochems, W. M. G., & Broers, N. J. (2007). The

effect of functional roles on perceived group efficiency during computer

supported collaborative learning: A matter of triangulation. Computers in

Human Behavior, 23, 353380.

Swanson, H. L., Orosco, M. J., & Lussier, C. M. (2014). The effects of mathematics

strategy instruction for children with serious problemsolving difficulties.

Exceptional Children, 80, 149–168.

Szewkis, E., Nussbaum, M., Rosen, T., Abalos, J., Denardin, F., Caballero, D.,

Tagle, A., & Alcoholado, C. (2011). Collaboration between large groups in the

classroom. International Journal of Computer Supported Collaborative

Learning, 6, 561575.

Tarr, J., Chavez, O., Reys, R., & Reys, B. (2006). From the written to the enacted

curricula: The intermediary role of middle school mathematics teachers in

shaping students’ opportunity to learn. School Science and Mathematics,

106, 191201.

Teong, S. K. (2003). The effect of metacognitive training on mathematical word

problem solving. Journal of Computer Assisted Learning, 19, 46–55.

doi:10.1046/j.02664909.2003.00005.x

Thevenot, C., Devidal, M., Barrouillet, P., & Fayol, M. (2007). Why does placing the

question before an arithmetic word problem improve performance? A

situation model account. Quarterly Journal of Experimental Psychology, 60

(1), pp. 43–56.

Timmermans, R. E., Van Lieshout, E. C. D. M., & Verhoeven, L. (2007). Gender

related effects of contemporary math instruction for low performers on

problem solving behaviour. Learning and Instruction, 17, 42–54.

10.1016/j.learninstruc.2006.11.005

Tutty, J. I., & Klein, J. D. (2008). Computermediated instruction: A comparison of

online and face to face collaboration. Educational Technology Research and

Development, 56, 101–124.

Uesaka, Y., Manalo, E., & Ichikawa, S. (2007). What kinds of perceptions and daily

learning behaviors promote students’ use of diagrams in mathematics

problem solving? Learning and Instruction, 17, 322–335.

Uribe, D., Klein, J. D., & Sullivan, H. (2003). The effect of computermediated

collaborative learning on solving illdefined problems. Educational

Technology Research and Development, 51 (1), 5–19.

Van den HeuvelPanhuizen, M. (2005). The role of context in assessment problems

in mathematics. For the Learning of Mathematics, 25(2), 2–9.

Page 20: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

228 229

Slavin, R. E. (1996). Research on cooperative learning and achievement: What we

know, what we need to know. Contemporary Educational Psychology, 21

(1), 43–69.

Slavin, R. E. (2009), Cooperative Learning. In G McCulloch, & D Crook (Eds),

International Encyclopedia of Education. Abington, UK: Routledge.

Slavin, R. E., & Karweit, N. L. (1985). Effects of WholeClass, AbilityGrouped, and

Individualized Instruction on Mathematics Achievement. American

Educational Research Journal. 22, 351–367.

Slavin, R. E. & Lake, C. (2008). Effective programs in elementary mathematics: A

bestevidence synthesis. Review of Educational Research, 78 (3), 427–515.

Stahl, G. (2000). A model of collaborative knowledgebuilding. In B. Fishman & S.

O’ConnosDivelbiss (Eds.), Fourth International Conference of the Learning

Sciences (pp. 7077). Mahwah, NJ: Erlbaum.

Stahl, G. (2004). Groupware goes to school: Adapting BSCW to the classroom.

International Journal of Computer Applications in Technology, 19 (3/4), 1–

13.

Stahl, G. (2009). Studying virtual math teams. New York, NY: Springer.

doi:10.1007/9781441902283

Stellingwerf, B. P., & Van Lieshout, E.C.D.M. (1999). Manipulatives and number

sentences in computer aided arithmetic word problem solving. Instructional

Science, 27, 459–476.

Strijbos, J. W., Martens, R. L., Jochems, W. M. G., & Broers, N. J. (2004). The

effect of functional roles on group efficiency using multilevel modelling and

content analysis to investigate computersupported collaboration in small

groups. Small Group Research, 35, 195229.

Strijbos, J. W., Martens, R. L., Jochems, W. M. G., & Broers, N. J. (2007). The

effect of functional roles on perceived group efficiency during computer

supported collaborative learning: A matter of triangulation. Computers in

Human Behavior, 23, 353380.

Swanson, H. L., Orosco, M. J., & Lussier, C. M. (2014). The effects of mathematics

strategy instruction for children with serious problemsolving difficulties.

Exceptional Children, 80, 149–168.

Szewkis, E., Nussbaum, M., Rosen, T., Abalos, J., Denardin, F., Caballero, D.,

Tagle, A., & Alcoholado, C. (2011). Collaboration between large groups in the

classroom. International Journal of Computer Supported Collaborative

Learning, 6, 561575.

Tarr, J., Chavez, O., Reys, R., & Reys, B. (2006). From the written to the enacted

curricula: The intermediary role of middle school mathematics teachers in

shaping students’ opportunity to learn. School Science and Mathematics,

106, 191201.

Teong, S. K. (2003). The effect of metacognitive training on mathematical word

problem solving. Journal of Computer Assisted Learning, 19, 46–55.

doi:10.1046/j.02664909.2003.00005.x

Thevenot, C., Devidal, M., Barrouillet, P., & Fayol, M. (2007). Why does placing the

question before an arithmetic word problem improve performance? A

situation model account. Quarterly Journal of Experimental Psychology, 60

(1), pp. 43–56.

Timmermans, R. E., Van Lieshout, E. C. D. M., & Verhoeven, L. (2007). Gender

related effects of contemporary math instruction for low performers on

problem solving behaviour. Learning and Instruction, 17, 42–54.

10.1016/j.learninstruc.2006.11.005

Tutty, J. I., & Klein, J. D. (2008). Computermediated instruction: A comparison of

online and face to face collaboration. Educational Technology Research and

Development, 56, 101–124.

Uesaka, Y., Manalo, E., & Ichikawa, S. (2007). What kinds of perceptions and daily

learning behaviors promote students’ use of diagrams in mathematics

problem solving? Learning and Instruction, 17, 322–335.

Uribe, D., Klein, J. D., & Sullivan, H. (2003). The effect of computermediated

collaborative learning on solving illdefined problems. Educational

Technology Research and Development, 51 (1), 5–19.

Van den HeuvelPanhuizen, M. (2005). The role of context in assessment problems

in mathematics. For the Learning of Mathematics, 25(2), 2–9.

Page 21: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

230 231

Van der Meijden, H., & Veenman, S. (2005). Facetoface versus computer

mediated communication in a primary school setting. Computers in Human

Behavior, 21, 831859.

Van der Schoot, F. (2008). Onderwijs op peil? Een samenvattend overzicht van 20

jaar PPON. [Education on track? A summative review of 20 years PPON].

Arnhem: Stichting Cito Instituut voor Toetsontwikkeling.

Van Garderen, D. (2006). Spatial visualisation, visual imagery, and mathematical

problem solving of students with varying abilities. Journal of Learning

Disabilities, 39, 496–506.

Van Garderen, D., & Montague, M. (2003). Visualspatial representations and

mathematical problem solving. Learning Disabilities Research and Practice,

18, 246–254.

Van Garderen, D., Scheuermann, A., & Jackson, C. (2013). Examining how students

of diverse abilities use diagrams to solve mathematics word problem.

Learning Disability Quarterly, 36 (3), 145160.

Van Heuvelen, A. (1991). Learning to think like a physicist: A review of research

based instructional strategies. American Journal of Physics, 59 (10), 891–

897.

Verschaffel, L., De Corte, E., Lasure, S., Van Vaerenbergh, G., Bogaerts, H., &

Ratinckx, E. (1999). Learning to solve mathematical application

problems: A design experiment with fifth graders. Mathematical Thinking

and Learning, 1, 195229.

Verschaffel, L., Greer, B., & De Corte, E. (2000). Making Sense of Word Problems.

Educational Studies in Mathematics, 42 (2), 211–213.

Verschaffel, L., Greer, B., & De Corte, E. (2007). Whole number concepts and

operation. In F. K. Lester, Jr. (Ed.), Second handbook of research on

mathematics teaching and learning (pp. 557–628). Charlotte, NC:

Information Age Publishing.

Vicente, S., Orrantia, J., & Verschaffel, L. (2007). Influence of situational and

conceptual rewording on word problem solving. Britisch Journal of

Educational Psychology, 77, 829848.

VileniusTuohimaa, P. M., Aunola, K., & Nurmi, J. (2008). The association between

mathematical word problems and reading comprehension. Educational

Psychology, 28 (4), 409–426.

Vogel, F., Kollar, I., Wecker, C., & Fischer, F. (2014). The role of content support

and transactivity for effects of computersupported collaboration scripts on

domainspecific learning: a metaanalysis. Intelligent Networking and

Collaborative Systems, 2014 International Conference on, 677682.

doi:10.1109/INCoS.2014.82

Webb, N. (2008). Cooperative Learning, in T.L. Good (ed.), 21st Century

Education: A Reference Handbook. Thousand Oaks, CA: Sage.

Webb, N., Nemer, K. M., & Zuniga, S. (2002). Short Circuits or Superconductors?

Effects of Group Composition on HighAchieving Students' Science

Assessment Performance. American Educational Research Journal, 39 (4),

943989.

Weinberger, A., Fischer, F., & Mandl, H. (2001). Scripts and scaffolds in problem

based computer supported collaborative learning environments: Fostering

participation and transfer. Research Report. Institute for Empirical

Pedagogy, University of München, Germany.

Winters, F. I., Greene, J. A., & Costich, C. M. (2008). Selfregulation of learning

within computerbased learning environments: a critical analysis.

Educational Psychology Review, 20, 429–444.

Wood, H., & Wood, D. (1999). Help seeking, learning and contingent tutoring.

Computers & Education, 33, 153–199. doi:10.1016/S03601315(99)000305

Xin, Y. P., Jitendra, A. K., & DeatlineBuchman, A. (2005). Effects of mathematical

word problem solving instruction on students with learning problems.

Journal of Special Education, 39, 181–192.

Zahner, D., & Corter, J. E. (2010). The process of probability problem solving: Use

of external visual representations. Mathematical Thinking and Learning, 12

(2), 177–204.

Zhang, X., de Pablos, P. O., & Xu, Q. (2014). Culture effects on the knowledge

sharing in multinational virtual classes: a mixed method. Computers in

Human Behavior, 31, 491–498. doi:10.1016/j.chb.2013.04.021.

Page 22: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

230 231

Van der Meijden, H., & Veenman, S. (2005). Facetoface versus computer

mediated communication in a primary school setting. Computers in Human

Behavior, 21, 831859.

Van der Schoot, F. (2008). Onderwijs op peil? Een samenvattend overzicht van 20

jaar PPON. [Education on track? A summative review of 20 years PPON].

Arnhem: Stichting Cito Instituut voor Toetsontwikkeling.

Van Garderen, D. (2006). Spatial visualisation, visual imagery, and mathematical

problem solving of students with varying abilities. Journal of Learning

Disabilities, 39, 496–506.

Van Garderen, D., & Montague, M. (2003). Visualspatial representations and

mathematical problem solving. Learning Disabilities Research and Practice,

18, 246–254.

Van Garderen, D., Scheuermann, A., & Jackson, C. (2013). Examining how students

of diverse abilities use diagrams to solve mathematics word problem.

Learning Disability Quarterly, 36 (3), 145160.

Van Heuvelen, A. (1991). Learning to think like a physicist: A review of research

based instructional strategies. American Journal of Physics, 59 (10), 891–

897.

Verschaffel, L., De Corte, E., Lasure, S., Van Vaerenbergh, G., Bogaerts, H., &

Ratinckx, E. (1999). Learning to solve mathematical application

problems: A design experiment with fifth graders. Mathematical Thinking

and Learning, 1, 195229.

Verschaffel, L., Greer, B., & De Corte, E. (2000). Making Sense of Word Problems.

Educational Studies in Mathematics, 42 (2), 211–213.

Verschaffel, L., Greer, B., & De Corte, E. (2007). Whole number concepts and

operation. In F. K. Lester, Jr. (Ed.), Second handbook of research on

mathematics teaching and learning (pp. 557–628). Charlotte, NC:

Information Age Publishing.

Vicente, S., Orrantia, J., & Verschaffel, L. (2007). Influence of situational and

conceptual rewording on word problem solving. Britisch Journal of

Educational Psychology, 77, 829848.

VileniusTuohimaa, P. M., Aunola, K., & Nurmi, J. (2008). The association between

mathematical word problems and reading comprehension. Educational

Psychology, 28 (4), 409–426.

Vogel, F., Kollar, I., Wecker, C., & Fischer, F. (2014). The role of content support

and transactivity for effects of computersupported collaboration scripts on

domainspecific learning: a metaanalysis. Intelligent Networking and

Collaborative Systems, 2014 International Conference on, 677682.

doi:10.1109/INCoS.2014.82

Webb, N. (2008). Cooperative Learning, in T.L. Good (ed.), 21st Century

Education: A Reference Handbook. Thousand Oaks, CA: Sage.

Webb, N., Nemer, K. M., & Zuniga, S. (2002). Short Circuits or Superconductors?

Effects of Group Composition on HighAchieving Students' Science

Assessment Performance. American Educational Research Journal, 39 (4),

943989.

Weinberger, A., Fischer, F., & Mandl, H. (2001). Scripts and scaffolds in problem

based computer supported collaborative learning environments: Fostering

participation and transfer. Research Report. Institute for Empirical

Pedagogy, University of München, Germany.

Winters, F. I., Greene, J. A., & Costich, C. M. (2008). Selfregulation of learning

within computerbased learning environments: a critical analysis.

Educational Psychology Review, 20, 429–444.

Wood, H., & Wood, D. (1999). Help seeking, learning and contingent tutoring.

Computers & Education, 33, 153–199. doi:10.1016/S03601315(99)000305

Xin, Y. P., Jitendra, A. K., & DeatlineBuchman, A. (2005). Effects of mathematical

word problem solving instruction on students with learning problems.

Journal of Special Education, 39, 181–192.

Zahner, D., & Corter, J. E. (2010). The process of probability problem solving: Use

of external visual representations. Mathematical Thinking and Learning, 12

(2), 177–204.

Zhang, X., de Pablos, P. O., & Xu, Q. (2014). Culture effects on the knowledge

sharing in multinational virtual classes: a mixed method. Computers in

Human Behavior, 31, 491–498. doi:10.1016/j.chb.2013.04.021.

Page 23: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

232 233

Zhang, X., Liu, L., de Pablos, P. O., & She, J. (2014). The auxiliary role of

information technology in teaching: enhancing programming course using

alice. International Journal of Engineering Education, 30 (3), 560–565.

Zheng, X., Flynn, L. J., & Swanson, H. L. (2013). Experimental intervention studies

on word problem solving and math disabilities: selective analysis of the

literature. Learning Disability Quarterly, 36 (2), 97–111.

doi:10.1177/0731948712444277

Zimmerman, B. J. (2008). Investigating selfregulation and motivation: historical

background, methodological developments, and future prospects. American

Educational Research Journal, 45, 166–183.

Zurita, G., & Nussbaum, M. (2004). Computer supported collaborative learning

using wirelessly interconnected handheld computers. Computers &

Education , 42 (3), 289–314.

Zurita, G., Nussbaum, M., & Salinas, R. (2005). Dynamic grouping in collaborative

learning supported by wireless handhelds. Educational Technology &

Society, 8 (3), 149–161.

Page 24: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

232 233

Zhang, X., Liu, L., de Pablos, P. O., & She, J. (2014). The auxiliary role of

information technology in teaching: enhancing programming course using

alice. International Journal of Engineering Education, 30 (3), 560–565.

Zheng, X., Flynn, L. J., & Swanson, H. L. (2013). Experimental intervention studies

on word problem solving and math disabilities: selective analysis of the

literature. Learning Disability Quarterly, 36 (2), 97–111.

doi:10.1177/0731948712444277

Zimmerman, B. J. (2008). Investigating selfregulation and motivation: historical

background, methodological developments, and future prospects. American

Educational Research Journal, 45, 166–183.

Zurita, G., & Nussbaum, M. (2004). Computer supported collaborative learning

using wirelessly interconnected handheld computers. Computers &

Education , 42 (3), 289–314.

Zurita, G., Nussbaum, M., & Salinas, R. (2005). Dynamic grouping in collaborative

learning supported by wireless handhelds. Educational Technology &

Society, 8 (3), 149–161.

Page 25: University of Groningen The effectiveness of hints during ... · hypermedia learning environment. Educational Technology Research and Development, 58(5), ... engineering method for

234 235

Willem de Kock was born in Leeuwarden, the Netherlands, on July 23th 1981. He

attended the Teacher’ Training College for Primary Education at NHL Hogeschool

from 2002 to 2006. After receiving his teacher degree, he continued his academic

career at the university. He did a premaster at the Institute for Pedagogical

Education (SPO), which is affiliated to the University of Groningen. After

completion, he enrolled in the Master programme of Educational Science at the

University of Groningen, specialising in the instructional design of learning

environments in education. He obtained his Master’s degree in Educational Science

at the University of Groningen in 2008. His thesis was about different methods for

teaching history using a digital whiteboard. Hereafter, he enrolled in the Research

Master programme of the University of Groningen, with Research and Evaluation

of Educational Effectiveness as his topic of interest. He obtained his Research

Master in 2009. During his master studies he worked as a research assistant on

different projects at the Groningen Institute for Educational Research (GION) of

the University of Groningen. After graduation, he continued his position at the

GION as a junior researcher. Here, he worked on the topic of improving the

effectiveness of computer support for students in mathematics education. In 2010,

he started his PhD project at the GION. Besides working on the studies presented

in this dissertation, he was involved in teaching a number of courses and

supervising master students. He is currently employed at NHL Hogeschool as a

lecturer (mathematics) with the Teacher’ Training College for Primary Education.