Teaching behaviours under observationan instrument for assessing teaching quality in Spain
- Carmen María Fernández García 1
- Mercedes Inda Caro 1
- Ridwan Maulana 2
- Susana Torío López 1
-
1
Universidad de Oviedo
info
-
2
University of Groningen
info
ISSN: 1135-6405, 1578-4118
Year of publication: 2022
Volume: 34
Issue: 2
Pages: 466-513
Type: Article
More publications in: Culture and Education, Cultura y Educación
Abstract
Teachers constitute a key point in the educational process. Therefore, having information about their behaviours inside the classroom can give us very useful data when the intention is to improve teaching effectiveness. This study aims to describe teaching behaviours observed in 344 teachers in 56 public and private schools in Asturias (Spain). Descriptive analyses and analysis of variance have been run in order to answer the research questions. A stepwise regression has been performed too, to identify which teaching skill domains are more important in promoting student engagement. Results have shown positive, significant relationships between all the domains and student academic engagement. Activating teaching, efficient classroom management and teaching-learning strategies seem to be the main teaching skills for increasing student engagement. Interesting differences have also been found in student engagement depending on the standard of teachers’ teaching behaviour.
Bibliographic References
- André, S., Maulana, R., Helms-Lorenz, M., Telli, S., Chun, S., Fernández-García, C. M., De Jager, T., Irnidayanti, Y., Inda-Caro, M., Lee, O., Safrina, R., Coetzee, T., & Jeon, M. (2020). Student perceptions in measuring teaching behavior across six countries: A multi-group confirmatory factor analysis approach to measurement invariance. Frontiers in Psychology, 11, 1–19.
- Blaich, C., Wise, K., Pascarella, E. T., & Roksa, J. (2016). Instructional clarity and organization: It’s not new or fancy, but it matters. Change: The Magazine of Higher Learning, 48(4), 6–13.
- Bonwell, C., & Eison, J. A. (1991). Active learning: Creating excitement in the classroom (ASHE-ERIC Higher Education Reports No. 1). The George Washington University, School of Education and Higher Education.
- Briole, S., & Maurin, E. (2019). Does evaluating teachers make a difference? IZA Discussion Papers, 123017, 1–38.
- Cardwell, M. E. (2011). Patterns of relationships between teacher engagement and student engagement. Education Doctoral, 49, 1–125.
- Carriedo, N. (1995). Hacia la contextualización: La enseñanza de estrategias de comprensión de las ideas principales en el aula. Comunicación, Lenguaje y Educación, 28(4), 123–134.
- Christensen, H., Vigild, M., Thomsen, E., Szabo, P., & Horsewell, A. (2009). Activating teaching methods, studying responses and learning. Arctic Technology Centre & Learning Lab DTU.
- Coe, R., & Merino, C. (2003). Magnitud del efecto; Una guía para investigadores y usuarios. Revista de Psicología de la PUCP, 21(1), 146–177.
- Cole, M. (1984). La zona de desarrollo próximo: Donde cultura y conocimiento se generan mutuamente. Infancia y Aprendizaje, 7(25), 3–17.
- Coll, C. (1984). Estructura grupal, interacción entre alumnos y aprendizaje escolar. Infancia y Aprendizaje, 27(28), 119–138.
- Coll, C. (1988). Significado y sentido en el aprendizaje escolar. Reflexiones en torno al concepto de aprendizaje significativo. Infancia y Aprendizaje, 11(41), 131–142.
- Connell, J. P., & Wellborn, J. G. (1991). Competence, autonomy, and relatedness: A motivational analysis of self-system processes. In M. R. Gunnar, & L. A. Sroufe (Eds.), Minnesota Symposia on Child Psychology. Self-processes and development (pp. 43–77). Erlbaum.
- Consejo Escolar de Estado & Ministerio de Educación y Formación Profesional. (2018). Informe 2018 sobre el estado del sistema educativo.
- Cubero, R., Cubero, M., Santamaría, A., Saavedra, J., & Yossef, J. J. (2007). Aprendizaje y psicología histórico-cultural. Aportaciones de una perspectiva social del aula. Investigación en la escuela, 62, 5–16.
- Danielson, C. (1996). Enhancing professional practice: A framework for teaching. Association for Supervision and Curriculum Development (ASCD).
- Danielson, C. (2012). Observing classroom practice. Educational Leadership, 70(3), 32–37.
- Danielson, C. (2013). Rubrics from the framework for teaching evaluation instrument. Danielson Group.
- De Jager, T. (2011). Guidelines to assist the implementation of differentiated learning activities in South African secondary schools. International Journal of Inclusive Education, 17(1), 80–94.
- De Jager, T., Coetzee, M.-C., Maulana, R., Helms-Lorenz, M., & Van de Grift, W. (2017). Profile of South African secondary-school teachers’ teaching quality: Evaluation of teaching practices using an observation instrument. Educational Studies, 43(4), 410–429.
- De Jong, R., & Westerhof, K. J. (2001). The quality of student ratings of teacher behaviour. Learning Environments Research, 4(1), 51–85.
- Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(1), 5–18.
- Emmer, E. T., & Stough, L. M. (2001). Classroom management: A critical part of educational psychology, with implications for teacher education. Educational Psychologist, 36(2), 103–112.
- Fernández-García, C. M., Maulana, R., Inda-Caro, M., Helms-Lorenz, M., & García-Pérez, O. (2019). Student perceptions of secondary education teaching effectiveness: General profile, the role of personal factors and educational level. Frontiers in Psychology, 10, 1–11.
- Finn, J. D. (1993). School engagement and students at risk. National Center for Educational Statistics.
- Fredricks, J., Blumenfeld, P., & Paris, A. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109.
- Fritz, M., & MacKinnon, D. (2007). Required sample size to detect the mediated effect. Psychological Science, 12(3), 233–238.
- Fuller, F. (1969). Concerns of teachers: A developmental conceptualization. American Educational Research Journal, 6(2), 207–226.
- Furrer, C., & Skinner, E. (2003). Sense of relatedness as a factor in children’s academic engagement and performance. Journal of Educational Psychology, 95(1), 148–162.
- Gage, N. A., Scott, T., Hirn, R., & MacSuga-Gage, A. S. (2018). The relationship between teachers’ implementation of classroom management practices and student behavior in elementary school. Behavioral Disorders, 43(2), 302–315.
- García-Garrido, J. L. (2002). La nueva Ley de Calidad: Reflexiones en la perspectiva internacional. Revista de Educación, 329, 23–38.
- Gargallo, B., Pérez-Pérez, C., García-García, F. J., Giménez, J. A., & Portillo, N. (2020). La competencia aprender a aprender en la universidad: Propuesta de modelo teórico. Educación XX1, 23(1), 19–44.
- Gispert, I., & Onrubia, J. (1997). Analizando la práctica educativa con herramientas socio-culturales: Traspaso del control y aprendizaje en situaciones de aula. Cultura y Educación, 9(2/3), 105–115.
- Goodnow, J. J. (1996). Acceptable ignorance, negotiable disagreement: Alternative reviews of learning. In D. R. Olson, & N. Torrance (Eds.), The handbook of education and human development (pp. 345–367). Blackwell Publishers.
- Hambleton, R. K., Merenda, P., & Spielberger, C. (Eds.). (2005). Adapting educational and psychological tests for cross-cultural assessment. Erlbaum.
- Hamre, B. K., Pianta, R. C., Downer, J. T., DeCoster, J., Mashburn, A. J., Jones, S. M., Brown, J. L., Cappella, E., Atkins, M., Rivers, S. E., Brackett, M. A., & Hamagami, A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. The Elementary School Journal, 113(4), 461–487.
- Hanushek, E. A. (2016). What matters for student achievement. Education Next, 16(2), 19–26.
- Hattie, J. A. C. (2003, October). Teachers make a difference: What is the research evidence? Paper presented at the Building Teacher Quality: What does the research tell us ACER Research Conference.
- Hospel, V., & Galand, B. (2016). Are both classroom autonomy support and structure equally important for students’ engagement? A multilevel analysis. Learning and Instruction, 41, 1–10.
- Howe, C., Hennessy, S., Mercer, N., Vrikki, M., & Wheatley, L. (2019). Teacher–student dialogue during classroom teaching: Does it really impact on student outcomes? Journal of the Learning Sciences, 28(4–5), 462–512.
- Hoyt, D. P., & Pallet, W. H. (1999). Appraising teaching effectiveness: Beyond student ratings. Idea Paper, 36, 1–14.
- Inda-Caro, M., Fernández-García, C. M., Maulana, R., & Viñuela-Hernández, M. P. (2021). The effect of contextual, personal, and curricular factors on students’ engagement. Revista de Educación, 391, 181–198.
- Jensen, B., Grajeda, S., & Haertel, E. (2018). Measuring cultural dimensions of classroom interactions. Educational Assessment, 23(4), 250–276.
- Jensen, B., Wallace, T. L., Steinberg, M. P., Gabriel, R. E., Dietiker, L., Davis, D. S., Kelcey, B., Minor, E., Halpin, P., & Rui, N. (2019). Complexity and scale in teaching effectiveness research: Reflections from the MET Study. Education Policy Analysis Archives, 27(7), 1–17.
- John-Steiner, V., & Mahn, H. (1996). Sociocultural approaches to learning and development: A Vygotskyan framework. Educational Psychologist, 31(3/4), 191–206.
- Kelly, S., Bringe, R., Aucejo, E., & Fruehwirth, J. (2020). Using global observation protocols to inform research on teaching effectiveness and school improvement: Strengths and emerging limitations. Education Policy Analysis Archives, 28(62), 1–29.
- Klem, A. M., & Connell, J. O. (2004). Relationships matter: Linking teacher support to student engagement and achievement. Journal of School Health, 74(7), 262–273.
- Kugel, P. (1993). How professors develop as teachers. Studies in Higher Education, 18(3), 315–328.
- Kyriakides, L., Christoforou, C., & Charalambous, C. Y. (2013). What matters for student learning outcomes: A meta – Analysis of studies exploring factors of effective teaching. Teaching and Teacher Education, 36, 143–152.
- Kyriakides, L., Creemers, B. P. M., & Antoniou, P. (2009). Teacher behaviour and student outcomes: Suggestions for research on teacher training and professional development. Teaching and Teacher Education, 25(1), 12–23.
- Martínez-Usarralde, M. J. (2015). Spain. In W. Hörner, H. Döbert, L. R. Reuter, & B. Von Kopp (Eds.), The education systems of Europe. Second edition (pp. 759–777). Springer.
- Maulana, R., Helms-Lorenz, M., & Van De Grift, W. (2015a). A longitudinal study of induction on the acceleration of growth in teaching quality of beginning teachers through the eyes of their students. Teaching and Teacher Education, 51, 225 245.
- Maulana, R., Helms-Lorenz, M., & Van De Grift, W. (2015b). Development and evaluation of a questionnaire measuring pre – Service teachers’ teaching behaviour: A Rasch modelling approach. School Effectiveness and School Improvement; an International Journal of Research, Policy and Practice, 26(2), 169–194.
- Maulana, R., Helms-Lorenz, M., & Van de Grift, W. (2017). Validating a model of effective teaching behaviour of pre – Service teachers. Teachers and Training. Theory and Practice, 23(4), 471–493.
- Maulana, R., & Opdenakker, M.-C. (2013). Teachers’ interpersonal involvement as a predictor of students’ academic motivation among Indonesian secondary school students: A multilevel growth curve analysis. The Asia-Pacific Education Researcher, 23(3), 591–603.
- Maulana, R., Opdenakker, M.-C., & Bosker, R. (2013). Teacher–student interpersonal relationships do change and affect academic motivation: A multilevel growth curve modelling. British Journal of Educational Psychology, 84(3), 459–482.
- Maulana, R., Opdenakker, M.-C., Stroet, K., & Bosker, R. (2012). Observed lesson structure during the first year of secondary education: Exploration of changeand link with academic engagement. Teaching and Teacher Education, 28(6), 835–885.
- Mercado, R. (1991). Los saberes docentes en el trabajo cotidiano de los maestros. Infancia y Aprendizaje, 14(55), 59–72.
- Ministerio de Educación, Cultura y Deporte de España. (2016) . PISA 2015. Programa para la evaluación internacional de los alumnos. Informe español.
- Muijs, D., & Reynolds, D. (2000). School effectiveness and teacher effectiveness in mathematics: Some preliminary findings from the evaluation of the Mathematics Enhancement Programme (Primary). School Effectiveness and School Improvement, 11(3), 273–303.
- Noben, I., Maulana, R., Deinum, J. F., & Adriaan-Hofman, W. H. (2020). Measuring university teachers’ teaching quality: A Rasch modelling approach. Learning Environments Research, 24(1), 87–107.
- Oliver, R. M., & Reschly, D. J. (2007). Effective classroom management: Teacher preparation and professional development. National Comprehensive center for Teacher Quality.
- Opdenakker, M. V., & Minnaert, A. (2011). Relationships between learning environment characteristics and academic engagement. Psychological Reports, 109(1), 259–284.
- Organisation for Economic Cooperation and Development (2018). PISA 2015: PISA results in focus.
- Pérez, M. (2013). La actitud indagadora del profesor: Un proceso para desarrollar competencias en los docentes. Profesorado. Revista de curriculum y formación del profesorado, 17(3), 57–72.
- Pianta, R. C., & Hamre, B. K. (2009). Conceptualization, measurement and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38(2), 109–119.
- Prado, M., & Cubero, M. (2013). Reflexionando acerca de cómo estudiar el proceso de enseñanza-aprendizaje en el contexto natural del aula universitaria. Cultura y Educación, 25(3), 273–284.
- Puelles, M. (2008). Las grandes leyes educativas de los últimos doscientos años. Participación educativa, 7, 7–15.
- Reddy, L. A., & Dudek, C. M. (2014). Teacher progress monitoring of instructional and behavioral management practices: An evidence-based approach to improving classroom practices. International Journal of School & Educational Psychology, 2(2), 71–84.
- Reddy, L. A., Fabiano, G., Dudek, C. M., & Hsu, L. (2013). Development and construct validity of the classroom strategies scale-observer form. School Psychology Quarterly, 28(4), 317–341.
- Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement and academic achievement. Journal of Educational Psychology, 104(3), 700–712.
- Sammons, P., & Bakkum, L. (2011). Effective schools, equity and teacher effectiveness: A review to the literature. Profesorado, Revista de Curriculum y Formación del Profesorado, 15(3), 9–26.
- Skinner, E. A., & Belmont, M. (1993). Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year. Journal of Educational Psychology, 85(4), 571–581.
- Skinner, E., Furrer, C., Marchand, G., & Kindermann, T. (2008). Engagement and disaffection in the classroom: Part of a larger motivational dynamic? Journal of Educational Psychology, 100(4), 765–781.
- Skinner, E. A., Kindermann, T. A., & Furrer, C. J. (2008). A motivational perspective on engagement and disaffection: Conceptualization and assessment of children’s’ behavioural and emotional participation in academic activities in the classroom. Educational and Psychological Measurement, 69(3), 493–525.
- Tuytens, M., & Devos, G. (2014). How to activate teachers through teacher evaluation. School Effectiveness and School Improvement, 25(4), 509–530.
- Van de Grift, W. (2007). Quality of teaching in four European countries: A review of the literature and application of an assessment instrument. Educational Research, 49(2), 127–152.
- Van de Grift, W. (2014). Measuring teaching quality in several European countries. School Effectiveness and School Improvement. An International Journal of Research, Policy and Practice, 25(3), 295–311.
- Van de Grift, W., Helms-Lorenz, M., & Maulana, R. (2014). Teaching skills of student teachers: Calibration of an evaluation instrument and its value in predicting student academic engagement. Studies in Educational Evaluation, 43, 150–159.
- Van de Grift, W., & Lam, J. (1998). Het didactisch handelen in het basisonderwijs. Tijdschrift voor Onderwijsresearch, 23(2), 224–241.
- Van der Lans, R. M., Maulana, R., Helms-Lorenz, M., Fernández-García, C. M., Chun, S., De Jager, T., Irnidayanti, Y., Inda-Caro, M., Lee, O., Coetzee, T., Fadhilah, N., Jeon, M., & Moorer, P. (2021). Student perceptions of teaching quality in five countries: A partial credit model approach to assess measurement invariance. SAGE Open, 11(3), 1–20.
- Van der Lans, R. M., Van de Grift, W., & Van Veen, K. (2015). Developing a teacher evaluation instrument to provide formative feedback using student ratings of teaching acts. Educational Measurement: Issues and Practices, 34(3), 18–27.
- Van der Lans, R. M., Van de Grift, W., Van Veen, K., & Fokkens-Bruinsma, M. (2016). Once is not enough: Establishing reliability criteria for feedback and evaluation decision based on classroom observations. Studies in Educational Evaluation, 50, 88–95.
- Viñao, A. (2016). La Ley Orgánica de Mejora de la Calidad Educativa (LOMCE) de 2013: ¿una reforma más? Historia y Memoria de la Educación, 3(3), 137–170.
- Vygotsky, L. S. (1979). Pensamiento y lenguaje. La Pléyade.
- Vygotsky, L. S. (1984). Aprendizaje y desarrollo intelectual en la edad escolar. Infancia y Aprendizaje, 27(28), 105–116.
- Wang, M. C., Haertel, G. D., & Walberg, H. J. (1993). Toward a Knowledge base for school learning. Review of Educational Research, 63(3), 249–294.
- White, M. C. (2018). Rater performance standards for classroom observation measures. Educational Researcher, 47(8), 492–501.
- Woolley, M. E., & Bowen, G. (2007). In the context of risk: Supportive adults and the school engagement of middle school students. Family Relations, 56(1), 92–104.