Development of the CarMen-Q Questionnaire for mental workload assessment

  1. Susana Rubio-Valdehita 1
  2. María Inmaculada López-Núñez 1
  3. Ramón López-Higes 1
  4. Eva María Díaz-Ramiro 1
  1. 1 Universidad Complutense de Madrid

    Universidad Complutense de Madrid

    Madrid, España

    ROR 02p0gd045


ISSN: 0214-9915

Year of publication: 2017

Volume: 29

Issue: 4

Pages: 570-576

Type: Article

More publications in: Psicothema


Background: Mental workload has emerged as one of the most important occupational risk factors present in most psychological and physical diseases caused by work. In view of the lack of specifi c tools to assess mental workload, the objective of this research was to assess the construct validity and reliability of a new questionnaire for mental workload assessment (CarMen-Q). Method: The sample was composed of 884 workers from several professional sectors, between 18 and 65 years old, 53.4% men and 46.6% women. To evaluate the validity based on relationships with other measures, the NASA-TLX scale was also administered. Results: Confi rmatory factor analysis showed an internal structure made up of four dimensions: cognitive, temporal and emotional demands and performance requirement. The results show satisfactory evidence of validity based on relationships with NASA-TLX and good reliability. Conclusions: The questionnaire has good psychometric properties and can be an easy, brief, useful tool for mental workload diagnosis and prevention

Bibliographic References

  • Bian, H. (2011). Structural Equation Modelling with Amos II. Office for the Faculty of Excellence. Retrieved from https://www.scribd.comvdoc/283895591/SEMwith-AMOS-II-pdf
  • Cain, B. (2007). A review of the mental workload literature. Defence Research and Development Toronto (Canada). Retrieved from http:/
  • Changxiu, S., Xuqun, Y., & Chenming, Z. (2017). Analysis of mental workload in online shopping: Are augmented and virtual reality consistent? Frontiers in Psychology, 8, 71. doi: 10.3389vfpsyg.2017.00071
  • Chiorri, C., Garbarino, S., Bracco, F., & Magnavita, N. (2015). Personality traits moderate the effect of workload sources on perceived workload in flying column police officers. Frontiers in Psychology, 6, 1835. doi: 10.3389/fpsyg.2015.01835
  • Dewe, P. (1991). Primary appraisal, secondary appraisal and coping: Their role in stressful work encounters. Journal of Occupational Psychology, 64, 331-51. doi: 10.1111/j.2044-8325.1991.tb00564.x
  • DiDomenico, A., & Nussbaum, M. A. (2011). Effects of different physical workload parameters on mental workload and performance. International Journal of Industrial Ergonomics, 41, 255-260. doi: 10.1016/j.ergon.2011.01.008
  • Do wning, S. M. (2006). Twelve steps for effective test development. In S. M. Downing and T. M. Haladyna (Eds.), Handbook of Test Development (pp. 3-25). London: LEA.
  • European Commission (2008). European Pact for health and mental health. Retrieved from
  • Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18, 39-50.
  • Goh, J., Pfeffer, J., & Zenios, S. A. (2015). Workplace stressors & health outcomes: Health policy for the workplace. Behavioral Science & Policy, 1, 43-52. doi: 10.1353/bsp.2015.0001
  • González, J. L. (2003). Carga mental y fatiga en el trabajo. Análisis en función de variables de personalidad en una muestra de servicios especiales de enfermería [Mental workload and fatigue at work. Analysis based on personality variables in a sample of special services nursing] (Doctoral dissertation). Universidad Autónoma de Madrid: Madrid.
  • Hart, S. G. (2006). NASA-Task Load Index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50, 904-908.
  • Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139-183.
  • International Standardization Organization (1991). Ergonomic principles related to mental workload. General terms and definition, ISO 10075. Geneva: International Standardization Organization.
  • Johnson, S., Cooper, C., Cartwright, S., Donald, I., Taylor, P., & Millet, C. (2005). The experience of work-related stress across occupations. Journal of Managerial Psychology, 20, 178-187. doi: 10.1108/02683940510579803
  • Moreno, B., & Báez, C. (2010). Factores y riesgos psicosociales: formas, consecuencias, medidas y buenas prácticas [Psychosocial factors and risks: forms, consequences, measures and good practices]. Madrid: UAM. Retrieved from
  • Nunnally, B. H., & Bernstein, J. C. (1994). Psychometric Theory. London, UK: McGraw-Hill.
  • Rolo-González, G., Díaz-Cabrera, D., & Hernández-Fernaud, E. (2009). Development of a Subjective Mental Workload Scale (SCAM). Revista de Psicología del Trabajo y de las Organizaciones, 25, 29-37.
  • Rubio, S., Díaz, E., Martín, J., & Puente, J. (2004). Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and Workload Profile methods. Applied Psychology: An International Review, 53, 61-86. doi: 10.1111/j.1464-0597.2004.00161.x
  • Stansfeld, S., & Candy, B. (2006). Psychosocial work environment and mental health—a meta-analytic review. Scandinavian Journal of Work, Environment & Health, 32, 443-462. doi: 10.5271/sjweh.1050
  • Szalma, J. L. (2008). Individual differences in stress reaction. In P. A. Hancock and J. L. Szalma (Eds.), Performance under Stress (pp. 323-357). Hampshire: Ashgate.
  • Tabachnick, B., & Fidell, L. (2013). Using Multivariate Statistics. Boston: Pearson.
  • Verwey, W. B. (2000). On-line driver workload estimation. Effects of road situation and age on secondary task measures. Ergonomics, 43(2), 187-209.
  • Yeh, Y., & Wickens, C. D. (1988). Dissociation of performance and subjective measures of workload. Human Factors, 30, 111-120.
  • Young, M. S., Brookhuis, K. A., Wickens, C. D., & Hancock, P. A. (2015). State of science: Mental workload in ergonomics. Ergonomics, 58, 1-17. doi: 10.1080/00140139.2014.956151