Validation of the Shortened Version of the Metacognitive Awareness Inventory in Spanish University Students

  1. Eduardo González-Cabañes 1
  2. Trinidad García 1
  3. David Álvarez-García 1
  4. Estrella Fernández 1
  5. Celestino Rodríguez 1
  1. 1 Universidad de Oviedo
    info

    Universidad de Oviedo

    Oviedo, España

    ROR https://ror.org/006gksa02

Revista:
Psicothema

ISSN: 0214-9915 1886-144X

Año de publicación: 2022

Volumen: 34

Número: 3

Páginas: 454-462

Tipo: Artículo

DOI: 10.7334/PSICOTHEMA2022.75 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: Psicothema

Resumen

Antecedentes: El Inventario de Conciencia Metacognitiva (MAI) se utiliza internacionalmente para identificar componentes metacognitivos relevantes para el aprendizaje. Sin embargo, hay escasa evidencia sobre su estructura factorial y la validez de su Versión Reducida, propuesta por diversos autores. Asimismo, hasta el momento, no ha sido validado en el contexto español. Método: Tras adaptar los ítems del MAI al español, se administró a 1076 estudiantes universitarios de diferentes regiones de España. Se compararon varias estructuras de la Versión Reducida del MAI, con 19 ítems, y del MAI original, con 52 ítems. Se analizaron la validez y fiabilidad, considerando las estructuras factoriales y las relaciones con otros cuestionarios ya validados. Resultados: Sólo la Versión Reducida del MAI que diferencia conocimiento y regulación de la cognición alcanzó un ajuste aceptable. Estas dos escalas mostraron buena validez convergente y divergente, alta validez de criterio en relación al rendimiento académico, alta fiabilidad test-retest y alta consistencia interna. Conclusiones: los resultados apoyan la diferenciación tradicional entre conocimiento de la cognición y regulación de la cognición, pero solo con la adaptación al español de la Versión Reducida del MAI. Este instrumento permite evaluaciones cortas y la identificación de estos componentes con propiedades métricas adecuadas en contextos españoles.

Referencias bibliográficas

  • Abdelrahman, R. M. (2020). Metacognitive awareness and academic motivation and their impact on academic achievement of Ajman University students. Heliyon, 6(9), Article e04192. https://doi.org/10.1016/j.heliyon.2020.e04192
  • Akin, A., Abaci, R., & Cetin, B. (2007). The validity and reliability of the Turkish version of the Metacognitive Awareness Inventory. Kuram Ve Uygulamada Egitim Bilimleri, 7(2), 671-678. https://toad.halileksi.net/ sites/default/files/pdf/metacognitive-awareness-inventory-toad.pdf
  • Antúnez, Á., Pérez-Herrero, M. d. H., Rosário, P., Vallejo, G., & Núñez, J. C. (2020). Engagement SPIRALS in elementary students: A schoolbased self-regulated learning approach. Sustainability, 12(9), 3894. https://doi.org/10.3390/su12093894
  • Baker, L. (1989). Metacognition, comprehension monitoring, and the adult reader. Educational Psychology Review, 1(1), 3-38. https://doi.org/10.1007/bf01326548
  • Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64(1), 417-444. https://doi.org/10.1146/annurev-psych-113011-143823
  • Brown, A. (1987). Metacognition, executive control, self-regulation, and other more mysterious mechanisms. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation, and understanding (pp. 65-116). Lawrence Erlbaum.
  • Çini, A., Malmberg, J., & Järvelä, S. (2020). How individual metacognitive awareness relates to situation-specific metacognitive interpretations of collaborative learning tasks. Educational Studies, 1-22. https://doi.org/10.1080/03055698.2020.1834359
  • Craig, K., Hale, D., Grainger, C., & Stewart, M. E. (2020). Evaluating metacognitive self-reports: systematic reviews of the value of self-report in metacognitive research. Metacognition and Learning, 15(2), 155-213. https://doi.org/10.1007/s11409-020-09222-y
  • de Boer, H., Donker, A. S., Kostons, D. D. N. M., & van der Werf, G. P. C. (2018). Long-term effects of metacognitive strategy instruction on student academic performance: A meta-analysis. Educational Research Review, 24, 98-115. https://doi.org/10.1016/j.edurev.2018.03.002
  • Dent, A. L., & Koenka, A. C. (2016). The relation between self-regulated learning and academic achievement across childhood and adolescence: A meta-Analysis. Educational Psychology Review, 28(3), 425-474. https://doi.org/10.1007/s10648-015-9320-8
  • Dignath, C., Buettner, G., & Langfeldt, H.-P. (2008). How can primary school students learn self-regulated learning strategies most effectively? A meta-analysis on self-regulation training programmes. Educational Research Review, 3(2), 101-129. https://doi.org/10.1016/j.edurev.2008.02.003
  • Donker, A. S., de Boer, H., Kostons, D., van Ewijk, C. C. D., & van der Werf, M. P. C. (2014). Effectiveness of learning strategy instruction on academic performance: A meta-analysis. Educational Research Review, 11, 1-26. https://doi.org/10.1016/j.edurev.2013.11.002
  • Favieri, A. G. (2013). General Metacognitive Strategies Inventory (GMSI) and the Metacognitive Integrals Strategies Inventory (MISI). Electronic Journal of Research in Educational Psychology, 11(3), 831-850. https://doi.org/10.14204/ejrep.31.13067
  • Flavell, J. H. (1979). Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry. American Psychologist, 34(10), 906-911. https://doi.org/10.1037/0003-066X.34.10.906
  • Flavell, J. H. (1987). Speculations about the nature and development of metacognition. In F. Weinert & R. Kluwe (Eds.), Metacognition, motivation and understanding (pp. 21-29). Lawrence Erlbaum.
  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.2307/3151312
  • Garcia, T., Betts, L., Gonzalez-Castro, P., Gonzalez-Pienda, J. A., & Rodriguez, C. (2016). On-line assessment of the process involved in maths problem-solving in fifth and sixth grade students: Self-regulation and achievement. Relime, 19(2), 165-186. https://doi.org/10.12802/relime.13.1922
  • Garcia, T., Cueli, M., Rodriguez, C., Krawec, J., & Gonzalez-Castro, P. (2015). Metacognitive knowledge and skills in students with deep approach to learning. Evidence from mathematical problem solving. Revista De Psicodidactica, 20(2), 209-226. https://doi.org/10.1387/RevPsicodidact.13060
  • García, T., González-Cabañes, E., Al-Halabí, S., & Rodríguez, C. (2020). Resultados de una intervención sobre la metacognición en estudiantes universitarios: Evidencia previa a través de una experiencia innovadora en el aula [Results of a metacognitive intervention in university students: Preliminary evidence through an innovative experience in the classroom]. In R. Roig-Vila (Ed.), La docencia en la Enseñanza Superior. Nuevas aportaciones desde la investigación e innovación educativas (pp. 604-613). Octaedro. https://octaedro.com/libro/la-docencia-en-la-ensenanza-superior/
  • Garcia, T., Rodriguez, C., Gonzalez-Castro, P., Gonzalez-Pienda, J. A., & Torrance, M. (2016). Elementary students’ metacognitive processes and post-performance calibration on mathematical problem-solving tasks. Metacognition and Learning, 11(2), 139-170. https://doi.org/10.1007/s11409-015-9139-1
  • Gargallo, B., Suárez-Rodríguez, J. M., & Pérez-Pérez, C. (2009). The CEVEAPEU questionnaire: An instrument to assess the learning strategies of university students. RELIEVE, 15(2). https://www.uv.es/RELIEVE/v15n2/RELIEVEv15n2_5.html
  • González-Cabañes, E., García, T., Núñez, J. C., & Rodríguez, C. (2021). Problem-solving before instruction (PS-I): A protocol for assessment and intervention in students with different abilities. JoVE(175), e62138, Article e62138. https://doi.org/10.3791/62138
  • González-Cabañes, E., García, T., Rodríguez, C., Cuesta, M., & Núñez, J. C. (2020). Learning and emotional outcomes after the application of invention activities in a sample of university students. Sustainability, 12(18), 7306. https://doi.org/10.3390/su12187306
  • Hambleton, R. K., & Zenisky, A. L. (2010). Translating and adapting tests for cross-cultural assessments. In D. Matsumoto & F. J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 46-70). Cambridge University Press. https://doi.org/10.1017/CBO9780511779381.004
  • Hargrove, R. A., & Nietfeld, J. L. (2015). The impact of metacognitive instruction on creative problem solving. Journal of Experimental Education, 83(3), 291-318. https://doi.org/10.1080/00220973.2013.876604
  • Harrison, G. M., & Vallin, L. M. (2018). Evaluating the metacognitive awareness inventory using empirical factor-structure evidence. Metacognition and Learning, 13(1), 15-38. https://doi.org/10.1007/s11409-017-9176-z
  • Heirweg, S., De Smul, M., Merchie, E., Devos, G., & Van Keer, H. (2020). Mine the process: investigating the cyclical nature of upper primary school students’ self-regulated learning. Instructional Science, 48(4), 337-369. https://doi.org/10.1007/s11251-020-09519-0
  • Henseler, J., Ringle, C. M., & Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the Academy of Marketing Science, 43(1), 115- 135. https://doi.org/10.1007/s11747-014-0403-8
  • Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
  • Izquierdo, I., Olea, J., & Abad, F. J. (2014). Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema, 26(3), 395- 400. https://doi.org/10.7334/psicothema2013.349
  • Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2021). semTools: Useful tools for structural equation modeling In R Foundation for Statistical Computing (Version 0.5-5) https://CRAN.R-project.org/package=semTools
  • Korkmaz, S., Goksuluk, D., & Zararsiz, G. (2014). MVN: An R package for assessing multivariate normality. R Journal, 6(2), 151-162. https://doi.org/10.32614/rj-2014-03
  • Lima-Filho, R. N., & Bruni, A. L. (2015). Metacognitive awareness inventory: Translation and validation from a confirmatory analysis. Psicologia: Ciência e Profissão, 35(4), 1275-1293. https://doi.org/10.1590/1982-3703002292013
  • Magno, C. (2010). The role of metacognitive skills in developing critical thinking. Metacognition and Learning, 5(2), 137-156. https://doi.org/10.1007/s11409-010-9054-4
  • Marsh, H. W., Hau, K.-T., & Grayson, D. (2005). Goodness of fit in structural equation models. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics: A festschrift for Roderick P. McDonald (pp. 275-340). Lawrence Erlbaum.
  • McNamara, D. S. (2011). Measuring deep, reflective comprehension and learning strategies: Challenges and successes. Metacognition and Learning, 6(2), 195-203. https://doi.org/10.1007/s11409-011-9082-8
  • Muis, K. R., Winne, P. H., & Jamieson-Noel, D. (2007). Using a multitrait-multimethod analysis to examine conceptual similarities of three self-regulated learning inventories. British Journal of Educational Psychology, 77(1), 177-195. https://doi.org/10.1348/000709905X90876
  • Muñiz, J., Elosua, P., & Hambleton, R. K. (2013). Directrices para la traducción y adaptación de los tests: Segunda Edición [Guidelines for test translation and adaptation: Second edition.]. Psicothema, 25(2), 151-157. https://doi.org/10.7334/psicothema2013.24
  • Norman, E., Pfuhl, G., Saele, R. G., Svartdal, F., Lag, T., & Dahl, T. I. (2019). Metacognition in psychology. Review of General Psychology, 23(4), 403-424. https://doi.org/10.1177/1089268019883821
  • Ohtani, K., & Hisasaka, T. (2018). Beyond intelligence: a meta-analytic review of the relationship among metacognition, intelligence, and academic performance. Metacognition and Learning, 13(2), 179-212. https://doi.org/10.1007/s11409-018-9183-8
  • Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the Motivated Strategies for Learning Questionnaire (MSLQ). Educational and Psychological Measurement, 53(3), 801-813. https://doi.org/10.1177/0013164493053003024
  • Pishghadam, R., & Khajavy, G. H. (2013). Intelligence and metacognition as predictors of foreign language achievement: A structural equation modeling approach. Learning and Individual Differences, 24, 176-181. https://doi.org/10.1016/j.lindif.2012.12.004
  • Pour, A. V., & Ghanizadeh, A. (2017). Validating the Persian version of Metacognitive Awareness Inventory and scrutinizing the role of its components in IELTS academic reading achievement. Modern Journal of Language Teaching Methods, 7(3), 46-73. https://doi.org/10.26655/mjltm.2017.3.1
  • Reisoglu, I., Toksoy, S. E., & Erenler, S. (2020). An analysis of the online information searching strategies and metacognitive skills exhibited by university students during argumentation activities. Library & Information Science Research, 42(3), Article 101019. https://doi.org/10.1016/j.lisr.2020.101019
  • Rodríguez, C., Torrance, M., Betts, L., Cerezo, R., & García, T. (2017). Effects of ADHD on writing composition product and process in schoolage students. Journal of Attention Disorders, 24(12), 1735-1745. https://doi.org/10.1177/1087054717707048
  • R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. www.R-project.org
  • Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02
  • Satorra, A., & Bentler, P. (1988). Scaling Corrections for Statistics in Covariance Structure Analysis. Department of Statistics at UCLA. https://escholarship.org/uc/item/8dv7p2hr
  • Schraw, G., & Dennison, R. S. (1994). Assessing Metacognitive Awareness. Contemporary Educational Psychology, 19(4), 460-475. https://doi.org/https://doi.org/10.1006/ceps.1994.1033
  • Teo, T., & Lee, C. (2012). Assessing the factorial validity of the Metacognitive Awareness Inventory (MAI) in an Asian country: A confirmatory factor analysis. International Journal of Educational and Psychological Assessment, 10(2), 92-103. https://researchdirect.westernsydney.edu.au/islandora/object/uws: 13188/
  • Turan, S., Demirel, O., & Sayek, I. (2009). Metacognitive awareness and self-regulated learning skills of medical students in different medical curricula. Medical Teacher, 31(10), Article e477-83. https://doi.org/10.3109/01421590903193521
  • Veenman, M. V. J., Van Hout-Wolters, B. H. A. M., & Afflerbach, P. (2006). Metacognition and learning: Conceptual and methodological considerations. Metacognition and Learning, 1(1), 3-14. https://doi.org/10.1007/s11409-006-6893-0
  • Weinstein, C. E., Schulte, A., & Palmer, D. R. (1987). The Learning and Study Strategies Inventory. H&H Publishing.
  • Whitehead, A. E., & Jackman, P. C. (2021). Towards a framework of cognitive processes during competitive golf using the Think Aloud method. Psychology of Sport and Exercise, 53, 1-10, Article 101869. https://doi.org/10.1016/j.psychsport.2020.101869