The evaluation of family support programmes in Spainan analysis of their quality standards

  1. Victoria Hidalgo 1
  2. Beatriz Rodríguez-Ruiz 2
  3. Francisco J. García Bacete 3
  4. Raquel A. Martínez-González 2
  5. Isabel López-Verdugo 1
  6. Jiménez García, Lucía
  1. 1 Universidad de Sevilla
    info

    Universidad de Sevilla

    Sevilla, España

    ROR https://ror.org/03yxnpp24

  2. 2 Universidad de Oviedo
    info

    Universidad de Oviedo

    Oviedo, España

    ROR https://ror.org/006gksa02

  3. 3 Universitat Jaume I, Castellón
Revista:
Psicología educativa

ISSN: 1135-755X

Año de publicación: 2023

Volumen: 29

Número: 1

Páginas: 35-43

Tipo: Artículo

DOI: 10.5093/PSED2023A9 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: Psicología educativa

Resumen

A partir de las propuestas de la Society for Prevention Research sobre los estándares de evidencia necesarios para las intervenciones preventivas, contar con una evaluación rigurosa se considera como uno de los principales requisitos de los programas basados en la evidencia. A pesar de su importancia, muchos programas de apoyo familiar no cuentan con diseños de evaluación que cumplan con los estándares de calidad más consensuados. El objetivo de este artículo fue analizar los procesos de evaluación de cincuenta y siete programas españoles identificados en el marco del proyecto COST European Family Support Network. Los resultados obtenidos muestran una imagen bastante positiva de los estándares de calidad que caracterizan la evaluación de los programas, aunque es necesario ampliar el número de diseños que incluyan grupos de comparación, que contemplen medidas de los efectos en el bienestar infantil y que lleven a cabo evaluaciones de seguimiento para medir los efectos a largo plazo de las intervenciones. Se analizan los resultados desde un enfoque plural de la evaluación, que además del rigor metodológico considera la necesidad de tener en cuenta la utilidad, la viabilidad y el rigor ético de las investigaciones de evaluación.

Referencias bibliográficas

  • Acquah, D., & Thévenon, O. (2020). Delivering evidence-based services for all vulnerable families. A review of main policy issues. OECD Social, Employment and Migration Working Papers, 243. https://doi. org/10.1787/1bb808f2-en
  • Aldenderfer, M., & Blashfield, R. (1987). Cluster analysis. Jossey-Bass. Almeida, A., Cruz, O., & Canário, A. C. (2022). Evidence-based family and parenting support evaluation strategies: The position of EurofamNet. EurofamNet.
  • Altafim, E. R. P., McCoy, D. C., & Linhares, M. B. M. (2021). Unpacking the impacts of a universal parenting program on child behavior. Child Development, 92(2), 626-637. https://doi.org/10.1111/cdev.13491
  • Arnason, A., Langarica, N., Dugas, L. R., Mora, N., Luke, A., & Markossian, T. (2020). Family-based lifestyle interventions: What makes them successful? A systematic literature review. Preventive Medicine Reports, 21, Article 101299. https://doi.org/10.1016/j.pmedr.2020.101299
  • Asmussen, K. (2011). The evidence-based parenting practitioner’s handbook. Routledge.
  • Asmussen, K., & Brim, L. (2018). What works to enhance the effectiveness of the healthy child programme: An evidence update. Early Intervention Foundation. https://www.eif.org.uk/report/what-works-to-enhance-theeffectiveness-of-the-healthy-child-programme-an-evidence-update
  • Asmussen, K., Waddell, S., Molloy, D., & Chowdry, H. (2017). Commissioning parenting and family support for troubled families. Early Intervention Foundation. https://www.eif.org.uk/report/commissioning-parentingand-family-support-for-troubled-families
  • Barlow, J., Bergman, H., Kornør, H., Wei, Y., & Bennett, C. (2016). Group-based parent training programmes for improving emotional and behavioural adjustment in young children. Cochrane Database of Systematic Reviews, 8, Article CD003680. https://doi.org/10.1002/14651858. CD003680.pub3
  • Barlow, J., & Coren, E. (2018). The effectiveness of parenting programs: A review of Campbell reviews. Research on Social Work Practice, 28(1), 99-102. https://doi.org/10.1177%2F1049731517725184
  • Boddy, J., Smith, M., & Statham, J. (2011). Understandings of efficacy: Cross-national perspectives on ‘what works’ in supporting parents and families. Ethics and Education, 6(2), 181-196. https://doi.org/10.1080/ 17449642.2011.622992
  • Bronfenbrenner, U. (Ed.). (2005). Making human beings human: Bioecological perspectives on human development. Sage Publications.
  • Canavan, J. (2019). Pluralist evaluation for the real worlds of intervention. In L. Moran & J. Canavan (Eds.), Realising children’s rights through supporting parents (pp.112-125). UNESCO Child and Family Research Centre. https://cdn.flipsnack.com/widget/v2/widget. html?hash=ftkarl897
  • Chacón, S., Sanduvete, S., Portell, M., & Anguera, M. T. (2013). Reporting a program evaluation: Needs, program plan, intervention, and decisions. International Journal of Clinical and Health Psychology, 13(1), 58-66. https://doi.org/10.1016/S1697-2600(13)70008-5
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge.
  • Council of Europe. (2006). Recommendation Rec (2006)19 of the Committee of Ministers to member states on policy to support positive parenting. https://rm.coe.int/native/09000016805d6dda
  • Council of Europe. (2011). Recommendation Rec (2011)12 of the Committee of Ministers to member states on children’s rights and social services friendly to children and families. https://rm.coe.int/168046ccea
  • Council of Europe. (2016). Council of Europe strategy for the rights of the child (2016–2021). https://www.coe.int/en/web/children/children–s– strategy
  • Daly, M. (2007). Parenting in contemporary Europe: A positive approach. Council of Europe.
  • Daly, M., Bray, R., Bruckauf, Z., Byrne, J., Margaria, A., Pécnik, N., & SammsVaughan, M. (2015). Family and parenting support: Policy and provision in a global context. Innocenti Insight, UNICEF Office of Research. https://www.unicef-irc.org/publications/770-family-and-parentingsupport-policy-and-provision-in-a-global-context.html
  • Davies, L. M., Janta, B., & Gardner, F. (2019). Positive parenting interventions. Empowering parents with positive parenting techniques for lifelong health and well-being. Publications Office of the European Union. https://op.europa.eu/es/publication-detail/-/publication/d4226270- 6a28-11e9-9f05-01aa75ed71a1
  • European Cooperation in Science & Technology. (2018). Memorandum of Understanding for the implementation of the COST Action “The European Family Support Network. A bottom-up, evidence-based and multidisciplinary approach” (EurofamNet) CA18123. https://www. cost.eu/actions/CA18123/
  • European Family Support Network. (2020). Foundation document for the European Family Support Network. Social Work & Social Sciences Review, 21(2), 5-7. https://journals.whitingbirch.net/index.php/ SWSSR/article/view/1407/1456
  • Fives, A., Canavan, J., & Dolan, P. (2017). Evaluation study design – a pluralist approach to evidence. European Early Childhood Education Research Journal, 25(1), 153-170. https://doi.org/10.1080/135029 3X.2016.1266227
  • Flay, B., Biglan, A., Boruch, R. F., González, F., Gottfredson, D., Kellam, S., Moscicki, E. K., Schinke, S., Valentine, J. C., & Ji, P. (2005). Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science, 6(3), 151-175. https://doi.org/10.1007/s11121-005- 5553-y
  • Gottfredson, D. C., Cook, T. D., Gardner, F. E, Gorman-Smith, D., Howe, G. W., Sandler, I. N., & Zafft, K. M. (2015). Standards of evidence for efficacy, effectiveness, and scale-up research in prevention science: Next generation. Prevention Science, 16(7), 893-926. https://doi. org/10.1007/s11121-015-0555-x
  • Hidalgo, V., Pérez-Padilla, J., Sánchez, J., Ayala-Nunes, L., Maya, J., Grimaldi, V., & Menéndez, S. (2018). An analysis of different resources and programmes supporting at-risk families in Spain, Early Child Development and Care, 188(11), 1528-1539. https://doi.org/10.1080/0 3004430.2018.1491560
  • Jeong, J., Pitchik, H. O., & Fink, G. (2021). Short-term, medium-term and long-term effects of early parenting interventions in lowand middleincome countries: A systematic review. BMJ Global Health, 6(3), Article 004067. https://doi.org/10.1136/bmjgh-2020-004067
  • Jiménez, L., Antolín-Suárez, L., Lorence, B., & Hidalgo, V. (2019). Family education and support for families at psychosocial risk in Europe: Evidence from a survey of international experts. Health & Social Care in the Community, 27(2), 449-458. https://doi.org/10.1111/hsc.12665
  • Jiménez, L., Canavan, J., Catarina-Canario, A., Burgund-Isakov, A., Holzer, J., Buciuceanu-Vrabie, M., & Özdemir, M. (2021). Evidence-informed family education and support in contemporary Europe. Contributions from the European family support network. In M. P. Bermúdez (Ed.), Avances en ciencias de la educación. Investigación y práctica (pp. 328- 334). Dykinson.
  • Li, N., Peng, J., & Li, Y. (2021) Effects and moderators of Triple P on the social, emotional, and behavioral problems of children: Systematic review and meta-analysis. Frontiers in Psychology, 12, Article 709851. https://doi.org/10.3389/fpsyg.2021.709851
  • Magioni, P., & Williams, L. C. A. (2016). Parenting programs to prevent corporal punishment: A systematic review. Paidéia, 26(63), 121-129. https://doi.org/10.1590/1982-43272663201614
  • Martínez-González, R. A., Rodríguez, B., Álvarez, L., & Becedóniz, C. (2016). Evidence in promoting positive parenting through the ProgramGuide to Develop Emotional Competences. Psychosocial Intervention, 25(2),111-117. https://doi.org/10.1016/j.psi.2016.04.001
  • McCall, R. B. (2009). Evidence-based programming in the context of practice and policy. Social Policy Report, 23(3), 1-11. https://doi. org/10.1002/j.2379-3988.2009.tb00060.x
  • McCall, R. B., & Green, B. L. (2004). Beyond the methodological gold standards of behavioral research: Considerations for practice and policy. Social Policy Report, 18(2), 1-20. https://doi.org/10.1002/j.2379-3988.2004. tb00025.x
  • Ministerio de Derechos Sociales y Agenda 2030. (2021a). El sistema público de servicios sociales: Plan concertado de prestaciones básicas de servicios sociales en corporaciones locales 2019-2020. Ministerio de Derechos Sociales y Agenda 2030. https://www.mdsocialesa2030. gob.es/derechos-sociales/servicios-sociales/docs/prestaciones-pc/ memorias-pc/MemoriaPlanConcertado_2019-2020.pdf
  • Ministerio de Derechos Sociales y Agenda 2030. (2021b). Guía de ayudas sociales y servicios para las familias 2021. Ministerio de Derechos Sociales y Agenda 2030. https://www.mdsocialesa2030.gob.es/ derecho-sociales/familias/guia_ayudas_sociales/docs/2021_GUIA_DE_ AYUDAS_PARA_LAS_FAMILIAS_(final)._ACCESIBLE.pdf
  • Orte, C., Ballester, L., Vives, M., Amer, J., & March, M. X. (2017). Cultural adaptation of family evidence-based drug prevention programs in Spain. In M. Israelashvili & J. L. Romano (Eds.). The Cambridge handbook of international prevention science (pp. 873–895). Cambridge University Press.
  • Özdemir, M. (2015). How much do we know about the long-term effectiveness of parenting programmes? Advances, shortcomings,
  • Özdemir, M., Vastamäki, S., Leijten, P., & Sampaio, F. (in press). The European Family Support Network (EurofamNet) quality standards for family support programs. EurofamNet.
  • Proctor, K. B., & Brestan-Knight, E. (2016). Evaluating the use of assessment paradigms for preventive interventions: A review of the Triple P Positive Parenting Program. Children and Youth Services Review, 62, 72-82. https://doi.org/10.1016/j.childyouth.2016.01.018
  • Rayce, S. B., Rasmussen, I. S., Klest, S. K., Patras, J., & Pontoppidan, M. (2017). Effects of parenting interventions for at–risk parents with infants: A systematic review and meta–analyses. British Medical Journal Open, 7, Article e015707. https://doi.org/10.1136/bmjopen-2016-015707
  • Rodrigo, M. J. (2016). Quality of implementation in evidence-based positive parenting programs in Spain: Introduction to the special issue. Psychosocial Intervention, 25(2), 63-68. https://doi.org/10.1016/j. psi.2016.02.004
  • Rodrigo, M. J., Byrne, S., & Álvarez, M. (2017). Interventions to promote positive parenting in Spain. In M. Israelashvili & J. L. Romano (Eds.). The Cambridge handbook of international prevention science (pp. 929-956). Cambridge University Press.
  • Rodrigo, M. J., Hidalgo, V., Byrne, S., Bernedo, I. M., & Jiménez, L. (2022). Quality of evidence in the evaluation of programmes under the Positive Parenting Initiative in Spain: Introduction to the special issue. Psicología Educativa. Advance online publication. https://doi. org/10.5093/psed2022a5
  • Rodrigo, M. J., Máiquez, M. L., Martín, J. C., & Rodríguez, B. (2015). La parentalidad positiva desde la prevención y la promoción. In M.J. Rodrigo (Coord.), Manual práctico de parentalidad positiva (pp. 25- 43). Síntesis.
  • Sama-Miller, E., Akers, L., Mraz–Esposito, A., Coughlin, R., & Zukiewicz, M. (2019). Home visiting evidence of effectiveness review: Executive summary. Office of Planning, Research and Evaluation, Research, and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services.
  • Schindler, H. S., Fisher, P. A., & Shonkoff, J. P. (2017). From innovation to impact at scale: Lessons learned from a cluster of research – community partnerships. Child Development, 88(5), 1435-1446. https://doi.org/10.1111/cdev.12904
  • Scott, S. (2010). National dissemination of effective parenting programmes to improve child outcomes. The British Journal of Psychiatry, 196(1), 1-3. https://doi.org/10.1192/bjp.bp.109.067728
  • Small, S. A., Cooney, S. M., & O’Connor, C. (2009). Evidence-informed program improvement: Using principles of effectiveness to enhance the quality and impact of family-based prevention programs. Family Relations, 58(1), 1-13. https://doi.org/10.1111/j.1741-3729.2008.00530.x
  • Thévenon, O. (2020). Family support services across the OECD. DELSA/ ELSA/WP1/RD(2020)2. Directorate for Employment, Labour and Social Affairs Employment, Labour and Social Affairs Committee, Organisation for Economic Co-operation and Development.
  • United Nations General Assembly. (1989). Convention on the rights of the child. United Nations. Treaty Series, 1577, 3. https://www.refworld.org. es/docid/50ac92492
  • Van Assen, A. G., Knot-Dickscheita, J., Posta, W. J., & Grietensb, H. (2020). Home-visiting interventions for families with complex and multiple problems: A systematic review and meta-analysis of out-of-home placement and child outcomes. Children and Youth Services Review, 114, Article 104994. https://doi.org/10.1016/j.childyouth.2020.104994
  • Yarbrough, D. B., Shulha, L. M., Hopson, R. K., & Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users. Sage.