Validation of the Shortened Version of the Metacognitive Awareness Inventory in Spanish University Students

  1. Eduardo González-Cabañes 1
  2. Trinidad García 1
  3. David Álvarez-García 1
  4. Estrella Fernández 1
  5. Celestino Rodríguez 1
  1. 1 Universidad de Oviedo
    info

    Universidad de Oviedo

    Oviedo, España

    ROR https://ror.org/006gksa02

Journal:
Psicothema

ISSN: 0214-9915,  1886-144X

Year of publication: 2022

Volume: 34

Issue: 3

Pages: 454-462

Type: Article

DOI: 10.7334/PSICOTHEMA2022.75 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Psicothema

Abstract

Background: The Metacognitive Awareness Inventory (MAI) is used all over the world to identify metacognitive components that are relevant to learning. However, there is not enough evidence confirming its factorial structure or the suitability of its Shortened Version, proposed by various authors. Also, to date, the MAI has not been validated in the Spanish context. Method: After adapting the MAI to Spanish, it was administered to 1076 university students from different regions of Spain. Different structures of the MAI Shortened Version, with 19 items, were compared with the structures of the original 52-item MAI. Indexes of validity and reliability were analyzed, considering the factorial structure and relationships to other validated questionnaires. Results: Only the MAI Shortened Version that differentiates between knowledge and regulation of cognition achieved a good fit. These two scales showed good convergent and divergent validity, high criterion validity in relation to academic achievement, high test- retest reliability, and high internal reliability. Conclusions: results support the traditional differentiation between knowledge of cognition and regulation of cognition, but only for the Shortened Version of the MAI. This instrument allows quick evaluations and identification of these components in Spanish contexts with adequate metric properties

Bibliographic References

  • Abdelrahman, R. M. (2020). Metacognitive awareness and academic motivation and their impact on academic achievement of Ajman University students. Heliyon, 6(9), Article e04192. https://doi.org/10.1016/j.heliyon.2020.e04192
  • Akin, A., Abaci, R., & Cetin, B. (2007). The validity and reliability of the Turkish version of the Metacognitive Awareness Inventory. Kuram Ve Uygulamada Egitim Bilimleri, 7(2), 671-678. https://toad.halileksi.net/ sites/default/files/pdf/metacognitive-awareness-inventory-toad.pdf
  • Antúnez, Á., Pérez-Herrero, M. d. H., Rosário, P., Vallejo, G., & Núñez, J. C. (2020). Engagement SPIRALS in elementary students: A schoolbased self-regulated learning approach. Sustainability, 12(9), 3894. https://doi.org/10.3390/su12093894
  • Baker, L. (1989). Metacognition, comprehension monitoring, and the adult reader. Educational Psychology Review, 1(1), 3-38. https://doi.org/10.1007/bf01326548
  • Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64(1), 417-444. https://doi.org/10.1146/annurev-psych-113011-143823
  • Brown, A. (1987). Metacognition, executive control, self-regulation, and other more mysterious mechanisms. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation, and understanding (pp. 65-116). Lawrence Erlbaum.
  • Çini, A., Malmberg, J., & Järvelä, S. (2020). How individual metacognitive awareness relates to situation-specific metacognitive interpretations of collaborative learning tasks. Educational Studies, 1-22. https://doi.org/10.1080/03055698.2020.1834359
  • Craig, K., Hale, D., Grainger, C., & Stewart, M. E. (2020). Evaluating metacognitive self-reports: systematic reviews of the value of self-report in metacognitive research. Metacognition and Learning, 15(2), 155-213. https://doi.org/10.1007/s11409-020-09222-y
  • de Boer, H., Donker, A. S., Kostons, D. D. N. M., & van der Werf, G. P. C. (2018). Long-term effects of metacognitive strategy instruction on student academic performance: A meta-analysis. Educational Research Review, 24, 98-115. https://doi.org/10.1016/j.edurev.2018.03.002
  • Dent, A. L., & Koenka, A. C. (2016). The relation between self-regulated learning and academic achievement across childhood and adolescence: A meta-Analysis. Educational Psychology Review, 28(3), 425-474. https://doi.org/10.1007/s10648-015-9320-8
  • Dignath, C., Buettner, G., & Langfeldt, H.-P. (2008). How can primary school students learn self-regulated learning strategies most effectively? A meta-analysis on self-regulation training programmes. Educational Research Review, 3(2), 101-129. https://doi.org/10.1016/j.edurev.2008.02.003
  • Donker, A. S., de Boer, H., Kostons, D., van Ewijk, C. C. D., & van der Werf, M. P. C. (2014). Effectiveness of learning strategy instruction on academic performance: A meta-analysis. Educational Research Review, 11, 1-26. https://doi.org/10.1016/j.edurev.2013.11.002
  • Favieri, A. G. (2013). General Metacognitive Strategies Inventory (GMSI) and the Metacognitive Integrals Strategies Inventory (MISI). Electronic Journal of Research in Educational Psychology, 11(3), 831-850. https://doi.org/10.14204/ejrep.31.13067
  • Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist, 34(10), 906-911. https://doi.org/10.1037/0003-066X.34.10.906
  • Flavell, J. H. (1987). Speculations about the nature and development of metacognition. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation and understanding (pp. 21-29). Lawrence Erlbaum.
  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.2307/3151312
  • Garcia, T., Betts, L., Gonzalez-Castro, P., Gonzalez-Pienda, J. A., & Rodriguez, C. (2016). On-line assessment of the process involved in maths problem-solving in fifth and sixth grade students: Self-regulation and achievement. Relime, 19(2), 165-186. https://doi.org/10.12802/relime.13.1922
  • Garcia, T., Cueli, M., Rodriguez, C., Krawec, J., & Gonzalez-Castro, P. (2015). Metacognitive knowledge and skills in students with deep approach to learning. Evidence from mathematical problem solving. Revista De Psicodidactica, 20(2), 209-226. https://doi.org/10.1387/RevPsicodidact.13060
  • García, T., González-Cabañes, E., Al-Halabí, S., & Rodríguez, C. (2020). Resultados de una intervención sobre la metacognición en estudiantes universitarios: Evidencia previa a través de una experiencia innovadora en el aula [Results of a metacognitive intervention in university students: Preliminary evidence through an innovative experience in the classroom]. In R. Roig-Vila (Ed.), La docencia en la Enseñanza Superior. Nuevas aportaciones desde la investigación e innovación educativas (pp. 604-613). Octaedro. https://octaedro.com/libro/la-docencia-en-la-ensenanza-superior/
  • Garcia, T., Rodriguez, C., Gonzalez-Castro, P., Gonzalez-Pienda, J. A., & Torrance, M. (2016). Elementary students’ metacognitive processes and post-performance calibration on mathematical problem-solving tasks. Metacognition and Learning, 11(2), 139-170. https://doi.org/10.1007/s11409-015-9139-1
  • Gargallo, B., Suárez-Rodríguez, J. M., & Pérez-Pérez, C. (2009). The CEVEAPEU questionnaire: An instrument to assess the learning strategies of university students. RELIEVE, 15(2). https://www.uv.es/RELIEVE/v15n2/RELIEVEv15n2_5.html
  • González-Cabañes, E., García, T., Núñez, J. C., & Rodríguez, C. (2021). Problem-solving before instruction (PS-I): A protocol for assessment and intervention in students with different abilities. JoVE(175), e62138, Article e62138. https://doi.org/10.3791/62138
  • González-Cabañes, E., García, T., Rodríguez, C., Cuesta, M., & Núñez, J. C. (2020). Learning and emotional outcomes after the application of invention activities in a sample of university students. Sustainability, 12(18), 7306. https://doi.org/10.3390/su12187306
  • Hambleton, R. K., & Zenisky, A. L. (2010). Translating and adapting tests for cross-cultural assessments. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 46-70). Cambridge University Press. https://doi.org/10.1017/CBO9780511779381.004
  • Hargrove, R. A., & Nietfeld, J. L. (2015). The impact of metacognitive instruction on creative problem solving. Journal of Experimental Education, 83(3), 291-318. https://doi.org/10.1080/00220973.2013.876604
  • Harrison, G. M., & Vallin, L. M. (2018). Evaluating the metacognitive awareness inventory using empirical factor-structure evidence. Metacognition and Learning, 13(1), 15-38. https://doi.org/10.1007/s11409-017-9176-z
  • Heirweg, S., De Smul, M., Merchie, E., Devos, G., & Van Keer, H. (2020). Mine the process: investigating the cyclical nature of upper primary school students’ self-regulated learning. Instructional Science, 48(4), 337-369. https://doi.org/10.1007/s11251-020-09519-0
  • Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115- 135. https://doi.org/10.1007/s11747-014-0403-8
  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
  • Izquierdo, I., Olea, J., & Abad, F. J. (2014). Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema, 26(3), 395- 400. https://doi.org/10.7334/psicothema2013.349
  • Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2021). semTools: Useful tools for structural equation modeling In R Foundation for Statistical Computing (Version 0.5-5) https://CRAN.R-project.org/package=semTools
  • Korkmaz, S., Goksuluk, D., & Zararsiz, G. (2014). MVN: An R package for assessing multivariate normality. R Journal, 6(2), 151-162. https://doi.org/10.32614/rj-2014-03
  • Lima-Filho, R. N., & Bruni, A. L. (2015). Metacognitive awareness inventory: Translation and validation from a confirmatory analysis. Psicologia: Ciência e Profissão, 35(4), 1275-1293. https://doi.org/10.1590/1982-3703002292013
  • Magno, C. (2010). The role of metacognitive skills in developing critical thinking. Metacognition and Learning, 5(2), 137-156. https://doi.org/10.1007/s11409-010-9054-4
  • Marsh, H. W., Hau, K.-T., & Grayson, D. (2005). Goodness of fit in structural equation models. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics: A festschrift for Roderick P. McDonald (pp. 275-340). Lawrence Erlbaum.
  • McNamara, D. S. (2011). Measuring deep, reflective comprehension and learning strategies: Challenges and successes. Metacognition and Learning, 6(2), 195-203. https://doi.org/10.1007/s11409-011-9082-8
  • Muis, K. R., Winne, P. H., & Jamieson-Noel, D. (2007). Using a multitrait-multimethod analysis to examine conceptual similarities of three self-regulated learning inventories. British Journal of Educational Psychology, 77(1), 177-195. https://doi.org/10.1348/000709905X90876
  • Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: Segunda Edición [Guidelines for test translation and adaptation: Second edition.]. Psicothema, 25(2), 151-157. https://doi.org/10.7334/psicothema2013.24
  • Norman, E., Pfuhl, G., Saele, R. G., Svartdal, F., Lag, T., & Dahl, T. I. (2019). Metacognition in psychology. Review of General Psychology, 23(4), 403-424. https://doi.org/10.1177/1089268019883821
  • Ohtani, K., & Hisasaka, T. (2018). Beyond intelligence: a meta-analytic review of the relationship among metacognition, intelligence, and academic performance. Metacognition and Learning, 13(2), 179-212. https://doi.org/10.1007/s11409-018-9183-8
  • Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the Motivated Strategies for Learning Questionnaire (MSLQ). Educational and Psychological Measurement, 53(3), 801-813. https://doi.org/10.1177/0013164493053003024
  • Pishghadam, R., & Khajavy, G. H. (2013). Intelligence and metacognition as predictors of foreign language achievement: A structural equation modeling approach. Learning and Individual Differences, 24, 176-181. https://doi.org/10.1016/j.lindif.2012.12.004
  • Pour, A. V., & Ghanizadeh, A. (2017). Validating the Persian version of Metacognitive Awareness Inventory and scrutinizing the role of its components in IELTS academic reading achievement. Modern Journal of Language Teaching Methods, 7(3), 46-73. https://doi.org/10.26655/mjltm.2017.3.1
  • Reisoglu, I., Toksoy, S. E., & Erenler, S. (2020). An analysis of the online information searching strategies and metacognitive skills exhibited by university students during argumentation activities. Library & Information Science Research, 42(3), Article 101019. https://doi.org/10.1016/j.lisr.2020.101019
  • Rodríguez, C., Torrance, M., Betts, L., Cerezo, R., & García, T. (2017). Effects of ADHD on writing composition product and process in schoolage students. Journal of Attention Disorders, 24(12), 1735-1745. https://doi.org/10.1177/1087054717707048
  • R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. www.R-project.org
  • Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02
  • Satorra, A., & Bentler, P. (1988). Scaling Corrections for Statistics in Covariance Structure Analysis. Department of Statistics at UCLA. https://escholarship.org/uc/item/8dv7p2hr
  • Schraw, G., & Dennison, R. S. (1994). Assessing Metacognitive Awareness. Contemporary Educational Psychology, 19(4), 460-475. https://doi.org/https://doi.org/10.1006/ceps.1994.1033
  • Teo, T., & Lee, C. (2012). Assessing the factorial validity of the Metacognitive Awareness Inventory (MAI) in an Asian country: A confirmatory factor analysis. International Journal of Educational and Psychological Assessment, 10(2), 92-103. https://researchdirect.westernsydney.edu.au/islandora/object/uws: 13188/
  • Turan, S., Demirel, O., & Sayek, I. (2009). Metacognitive awareness and self-regulated learning skills of medical students in different medical curricula. Medical Teacher, 31(10), Article e477-83. https://doi.org/10.3109/01421590903193521
  • Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3-14. https://doi.org/10.1007/s11409-006-6893-0
  • Weinstein, C. E., Schulte, A., & Palmer, D. R. (1987). The Learning and Study Strategies Inventory. H&H Publishing.
  • Whitehead, A. E., & Jackman, P. C. (2021). Towards a framework of cognitive processes during competitive golf using the Think Aloud method. Psychology of Sport and Exercise, 53, 1-10, Article 101869. https://doi.org/10.1016/j.psychsport.2020.101869
Data source: Dialnet