Viabilidad de los Procedimientos de Aprendizaje Automático Automatizado para el Estudio de las Evidencias de la Validez de CriterioEl Caso del VIA-IS

  1. Mercedes Ovejero 1
  2. Jesús M. Alvarado 1
  3. Jaime Ballesteros 2
  1. 1 Universidad Complutense de Madrid, Facultad de Psicología
  2. 2 Sermes CRO, Departamento de Biometría.
Revista:
Revista iberoamericana de diagnóstico y evaluación psicológica

ISSN: 1135-3848

Año de publicación: 2022

Título del ejemplar: Avances en Medición en Psicología

Volumen: 5

Número: 66

Páginas: 117-126

Tipo: Artículo

DOI: 10.21865/RIDEP66.5.09 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: Revista iberoamericana de diagnóstico y evaluación psicológica

Resumen

El enfoque tradicional de la validez de criterio se basa en el uso de correlaciones y regresión lineal empleados en una única muestra. Los avances en la algoritmia del aprendizaje automático supervisado han permitido el desarrollo de herramientas automatizadas (AutoML) que suponen un ahorro de tiempo y de coste computacional de la exploración de la capacidad predictiva de las puntuaciones de un test sobre criterios relevantes para el modelo teórico. El presente trabajo aplicó el pipeline de AutoML al estudio de la capacidad predictiva del cuestionario VIA-IS de fortalezas personales sobre la satisfacción general con la vida. Los resultados muestran que el AutoML permite explorar de forma rápida y eficiente gran cantidad de algoritmos predictivos, obteniéndose mejores medidas generales de ajuste y que las fortalezas gratitud, curiosidad, esperanza, apreciación del a belleza y la bondad son las que contribuyen en mayor grado a pronosticar la satisfacción vital.

Referencias bibliográficas

  • Ali, M. (2020). PyCaret: An open source, lowcode machine learning library in Python. Disponible en: https://www.pycaret.org.
  • American Educational Research Association, American Psychological Association & National Council on Measurement in Education (AERA, APA, NCME) (2018). Standards for educational and psychological testing. American Psychological Association.
  • Azañedo, C. M., Fernández-Abascal, E. G., & Barraca, J. (2014). Character strengths in Spain: Validation of the Values in Action Inventory of Strengths (VIA-IS) in a Spanish sample. Clínica y Salud, 25, 123-130. https://doi.org/10.1016/j.clysa.2014.06.002
  • Baumann, D., Ruch, W., Margelisch, K., Gander, F., & Wagner, L. (2019). Character strengths and life satisfaction in later life: An analysis of different living conditions. Applied Research in Quality of Life, 15, 329-347. https://doi.org/10.1007/s11482-018-9689-x
  • Brdar, I., Anić, P., & Rijavec, M. (2011). Character strengths and well-being: Are there gender differences? En Bridar, I. (Ed.), The human pursuit of well-being (pp. 145-156). Springer.
  • Buschor, C., Proyer, R. T., & Ruch, W. (2013). Self- and peer-rated character strengths: How do they relate to satisfaction with life and orientations to happiness? Journal of Positive Psychology, 8, 116-127. https://doi.org/10.1080/17439760.2012.758305
  • Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. SAGE.
  • Diener, E. D., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49, 71-75. https://doi.org/10.1207/s15327752jpa4901_13
  • He, X., Zhao, K., & Chu, X. (2021). AutoML: A survey of the state-of-the-art. KnowledgeBased Systems, 212. https://doi.org/10.1016/j.knosys.2020.106622
  • Hutter, F., Kotthoff, L., & Vanschoren, J. (2019). Automated Machine Learning. Methods, systems, challenges. Springer.
  • Karmaker, S. K., Hassan, M. M., Smith, M. J., Xu, L., Zhai, C., & Veeramachaneni, K. (2022). AutoML to date and beyond: Challenges and opportunities. ACM Computing Surveys, 54, 1-36. https://doi.org/10.1145/3470918
  • Kimberlin, C. L., & Winterstein, A. G. (2008). Validity and reliability of measurement instruments used in research. American Journal of Health-System Pharmacy, 65, 2276-2284. https://doi.org/10.2146/ajhp070364
  • Kretzschmar, A., Harzer, C., & Ruch, W. (2022). Character strengths in adults and adolescents: Their measurement and association with wellBeing. Journal of Personality Assessment. https://doi.org/10.31234/osf.io/caemw
  • Ledesma, R. D., Ferrando, P. J., & Tosi, J. D. (2018). Uso del análisis factorial exploratorio en RIDEP. Recomendaciones para autores y revisores. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica, 52, 173-180. https://doi.org/10.21865/RIDEP52.3.13.
  • Linley, P. A., Maltby, J., Wood, A. M., Joseph, S., Harrington, S., Peterson, C., ... & Seligman, M. E. (2007). Character strengths in the United Kingdom: The VIA Inventory of Strengths. Personality and Individual Differences, 43, 341-351. https://doi.org/10.1016/j.paid.2006.12.004.
  • Messick, S. (1989). Validity. En R. Linn (Ed.), Educational Measurement (pp. 13-103). Macmillan.
  • Niemiec, R. M. (2013). VIA character strengths: Research and practice (The first 10 years). En H. Henrik Knoop y A. Delle Fave (Eds.), Well-being and cultures (pp. 11-29). Springer.
  • Ovejero, M. M., Brabete, A. C., & Alvarado, J. M. (2018). Reliability Generalization as a seal of quality of substantive meta-analyses: The case of the VIA Inventory of Strengths (VIA-IS) and their relationships to life satisfaction. Psychological Reports. https://doi.org/10.1177%2F0033294118779198
  • Ovejero, M. M., Cardenal, V., & Ortiz-Tallo, M. (2016). Fortalezas humanas y bienestar biopsicosocial: Revisión sistemática. Escritos De Psicología - Psychological Writings, 9, 414. https://doi.org/10.24310/espsiescpsi.v9i3.13212
  • Park, N., Peterson, C., & Seligman, M. E. (2004). Strengths of character and well-being. Journal of Social and Clinical Psychology, 23, 603619. https://doi.org/10.1521/jscp.23.5.603.50748
  • Pavot, W., & Diener, E. (2008). The Satisfaction with Life Scale and the emerging construct of life satisfaction. The Journal of Positive Psychology, 3, 137-152. https://doi.org/10.1080/17439760701756946
  • Pavot, W., & Diener, E. (2009). Review of the Satisfaction with Life Scale. En E. Diener (Ed.), Assessing well-being (pp. 101-117). Springer. https://doi.org/10.1007/978-90-481-2354-4_5
  • Peterson, C., Ruch, W., Beermann, U., Park, N., & Seligman, M. E. (2007). Strengths of character, orientations to happiness, and life satisfaction. The Journal of Positive Psychology, 2, 149-156. https://doi.org/10.1080/17439760701228938
  • Peterson, C., & Seligman, M. E. (2004). Character strengths and virtues: A handbook and classification. Oxford University Press.
  • Proyer, R. T., Gander, F., Wyss, T., & Ruch, W. (2011). The relation of character strengths to past, present, and future life satisfaction among German‐speaking women. Applied Psychology: Health and Well‐Being, 3, 370384. https://doi.org/10.1111/j.17580854.2011.01060.x.
  • Rose, L. T., & Fischer, K. W. (2011). Garbage in, garbage out: Having useful data is everything. Measurement: Interdisciplinary Research & Perspective, 9, 222-226 https://doi.org/10.1080/15366367.2011.632338
  • Shimai, S., Otake, K., Park, N., Peterson, C., & Seligman, M. E. (2006). Convergence of character strengths in American and Japanese young adults. Journal of Happiness Studies, 7, 311-322. https://doi.org/10.1007/s10902-005-3647-7
  • Sullivan, G. M. (2011). A primer on the validity of assessment instruments. Journal of Graduate Medical Education, 3, 119-120. https://doi.org/10.4300/jgme-d-11-00075.1
  • Taherdoost, H. (2016). Validity and reliability of the research instrument. How to test the validation of a questionnaire/survey in a research. SSRN Electronic Journal. https://dx.doi.org/10.2139/ssrn.3205040
  • The Pandas Development Team (2020). Pandasdev/pandas: Pandas. https://doi.org/10.5281/zenodo.3509134.
  • Toro, R., Peña-Sarmiento, M., Avendaño-Prieto, B. L., Mejía-Vélez, S., & Bernal-Torres, A. (2022). Análisis empírico del coeficiente alfa de Cronbach según opciones de respuesta, muestra y observaciones atípicas. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação, 63, 17-30. https://doi.org/10.21865/RIDEP63.2.02.
  • Trognon, A., Cherifi, Y., Demange, L., & Prudent, C. (2022). Viability of machinelearning strategies to solve psychometric problems. Research Square. https://doi.org/10.21203/rs.3.rs-1314080/v1
  • Vacha-Haase, T., & Thompson, B. (2011). Score reliability: A retrospective look back at 12 years of reliability generalization studies. Measurement and Evaluation in Counseling and Development, 44, 159-168. https://doi.org/10.1177/0748175611409845
  • Warne, R. M. (2008). Applied statistics: From bivariate through multivariate techniques. Sage.
  • Watson, D., Krutzinna, J., Bruce, I., Griffiths, C., McInnes, I., Barnes, M., & Floridi, L. (2019). Clinical Applications of Machine Learning Algorithms: Beyond the Black Box. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.3352454.