Design and Evaluation Process of a Personal and Motive-Based Competencies Questionnaire in Spanish-Speaking Contexts

  1. Batista Foguet, Joan Manuel
  2. Sipahi-Dantas, Alaide
  3. Guillén, Laura
  4. Martínez Arias, María del Rosario
  5. Serlavós, Ricard
Revista:
The Spanish Journal of Psychology

ISSN: 1138-7416

Año de publicación: 2016

Volumen: 19

Tipo: Artículo

DOI: 10.1017/SJP.2016.14 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: The Spanish Journal of Psychology

Resumen

Most questionnaires used for managerial purposes have been developed in Anglo-Saxon countries and then adapted for other cultures. However, this process is controversial. This paper fills the gap for more culturally sensitive assessment instruments in the specific field of human resources while also addressing the methodological issues that scientists and practitioners face in the development of questionnaires. First, we present the development process of a Personal and Motive-based competencies questionnaire targeted to Spanish-speaking countries. Second, we address the validation process by guiding the reader through testing the questionnaire construct validity. We performed two studies: a first study with 274 experts and practitioners of competency development and a definitive study with 482 members of the general public. Our results support a model of nineteen competencies grouped into four higher-order factors. To assure valid construct comparisons we have tested the factorial invariance of gender and work experience. Subsequent analysis have found that women self-rate themselves significantly higher than men on only two of the nineteen competencies, empathy (p < .001) and service orientation (p < .05). The effect of work experience was significant in twelve competencies (p < .001), in which less experienced workers self-rate higher than experienced workers. Finally, we derive theoretical and practical implications.

Referencias bibliográficas

  • Afthanorhan, W. M. A. B. W., & Ahmad, S. (2013). Modeling the multimediator on motivation among youth in higher education institution towards volunteerism program. Mathematical Theory and Modeling, 3, 64–70.
  • Armstrong, M., & Taylor, S. (2014). Armstrong’s handbook of human resource management practice . Philadelphia, PA: Kogan Page Publishers.
  • Bagozzi, R. P. (1984). A prospectus for theory construction in marketing. Journal of Marketing, 48, 11–29. http://dx.doi.org/10.2307/1251307
  • Bar-On, R. (2006). The Bar-On model of emotional-social intelligence. Psicothema, 18, 124–131.
  • Bartram, D. (2005). The Great Eight Competencies: A criterion-centric approach to validation. Journal of Applied Psychology, 90, 1185–1203. http://dx.doi.org/10.1037/0021-9010.90.6.1185
  • Batista-Foguet, J. M., Boyatzis, R., Guillén, L., & Serlavos, R. (2008). Assessing emotional intelligence competencies in two global contexts. In Emmerling, R. (Ed.), Emotional intelligence: Theoretical and cultural perspectives. (pp. 89–114), San Francisco, CA: Nova Science Publishers.
  • Batista-Foguet, J. M., Saris, W., Boyatzis, R., Guillén, L., & Serlavòs, R. (2009). Effect of response scale on assessment of emotional intelligence competencies. Personality and Individual Differences, 46, 575–580. http://dx.doi.org/10.1016/j.paid.2008.12.011
  • Bisbe, J., Batista-Foguet, J. M., & Chenhall, R. (2007). Defining management accounting constructs: The risks of theoretical misspecification. Accounting, Organizations and Society, 32, 789–820.
  • Cheung, F. M. (2004). Use of Western- and indigenously-developed personality tests in Asia. Applied Psychology: An International Review, 53, 173–191. http://dx.doi.org/10.1111/j.1464-0597.2004.00167.x
  • Costa, P. T., & McCrae, R. R. (1992). Four ways five factors are basic. Personality and Individual differences, 13, 653–665. http://dx.doi.org/10.1016/0191-8869(92)90236-I
  • Cuesta, M., & Fonseca-Pedrero, E. (2014). Estimating the reliability coefficient of tests in presence of missing values. Psicothema, 26, 516–524.
  • Du Gay, P., Salaman, G., & Rees, B. (1996). The conduct of management and the management of conduct: Contemporary managerial discourse and the constitution of the “Competent” manager. Journal of Management Studies, 33, 263–282.
  • Dulewicz, V., Higgs, M., & Slaski, M. (2003). Measuring emotional intelligence: Construct and criterion-related validity. Journal of Managerial Psychology, 18, 405–420. http://dx.doi.org/10.1108/02683940310484017
  • Emmerling, R. J., & Boyatzis, R. E. (2012). Emotional and social intelligence competencies: Cross cultural implications. Cross Cultural Management: An International Journal, 19(1), 4–18. http://dx.doi.org/10.1108/13527601211195592
  • Extremera, N., Fernandez-Berrocal, P., & Salovey, P. (2006). Spanish version of the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT). 2.0: Reliabilities, age and gender differences. Psicothema, 18, 42–48.
  • Fernández-Alonso, R., Suárez-Alvarez, J., & Muñiz, J. (2012). Imputación de datos perdidos en las evaluaciones diagnósticas educativas [Imputation of missing data on educational diagnostic assessments]. Psicothema, 24, 167–175.
  • Gouveia, V., Milfont, T. L., Gouveia, R. S. V., Neto, J. R. N., & Galvão, L. (2012). Brazilian-Portuguese empathy quotient: Evidences of its construct validity and reliability. The Spanish Journal of Psychology, 15, 777–782. http://dx.doi.org/10.5209/rev_SJOP.2012.v15.n2.38889
  • Guillén, L., & Saris, W. (2013). Competencies, personality traits, and job outcomes of middle managers: A motive-based approach. Human Performance, 26, 1–27.
  • Heise, D. R., & Bohrnstedt, G. W. (1970). Validity, invalidity and reliability. In Borgatta, E. F. & Bohrnstedt, G. W (Eds.), Sociological Methodology, (pp.104–129). San Francisco, CA: Jossey-Bass. http://dx.doi.org/10.2307/270785
  • Hossiep, R., & Parchen, M. (2006). BIP. Bochumer Inventar zur berufsbezogenen Persönlichkeitsbeschreibung [BIP, Bochum Inventory of Personality and Skills]. Göttingen, Germany: Hogrefe. Adaptación española: Arribas, D. & Pereña, J. (2006). BIP, Inventario Bochum de Personalidad y Competencias. [BIP, Bochum Inventory of Personality and Skills]. Madrid, Spain: TEA Ediciones.
  • Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. http://dx.doi.org/10.1080/10705519909540118
  • Jarvis, C. B., Mackenzie, S. B., & Podsakoff, P. M. (2003). A critical review of construct indicators and measurement model misspecification in marketing and consumer research. Journal of Consumer Research, 30, 199–218. http://dx.doi.org/10.1086/376806
  • Libbrecht, N., De Beuckelaer, A., Lievens, F., & Rockstuhl, T. (2014). Measurement invariance of the Wong and Law Emotional Intelligence Scale scores: Does the measurement structure hold across far eastern and European countries? Applied Psychology, 63, 223–237. http://dx.doi.org/10.1111/j.1464-0597.2012.00513.x
  • McClelland, D. C., & Boyatzis, R. E. (1982). Leadership motive pattern and long term success in management. Journal of Applied Psychology, 67, 737–743. http://dx.doi.org/10.1037//0021-9010.67.6.737
  • McClelland, D., Atkinson, J., Clark, R., & Lowell, E. (1953). The achievement motive. New York, NY: Appleton-Century-Crofts. http://dx.doi.org/10.1037/11144-000
  • McEnrue, M. P., & Groves, K. (2006). Choosing among tests of emotional intelligence: What is the evidence? Human Resource Development Quarterly, 17, 9–42. http://dx.doi.org/10.1002/hrdq.1159
  • Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. http://dx.doi.org/10.1007/BF02294825
  • Mestre, M. V., Samper, P., Frías, M. D., & Tur, A. M. (2009). Are women more empathetic than men? A longitudinal study in adolescence. The Spanish Journal of Psychology, 12, 76–83. http://dx.doi.org/10.1017/S1138741600001499
  • Nunnally, J. C. (1978). Psychometric theory (2nd Ed.). New York, NY: McGraw Hill.
  • Paulhus, D. L. (1991). Measurement and control of response bias. In Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (Eds.), Measures of personality and social psychological attitudes (pp. 17–59). San Diego, CA: Academic Press. http://dx.doi.org/10.1016/B978-0-12-590241-0.50006-X
  • Petrides, K. V., & Furnham, A. (2001). Trait emotional intelligence: Psychometric investigation with reference to established trait taxonomies. European Journal of Personality, 15, 425–488. http://dx.doi.org/10.1002/per.416
  • Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models, or detection of misspecifications? Structural Equation Modeling: A Multidisciplinary Journal, 16, 561–582. http://dx.doi.org/10.1080/10705510903203433
  • Scullen, S. E., Mount, M. K., & Judge, T. A. (2003). Evidence of construct validity of developmental ratings of managerial performance. Journal of Applied Psychology, 88, 50–66. http://dx.doi.org/10.1037/0021-9010.88.1.50
  • Steenkamp, J-B. E. M., de Jong, M. G., & Baumgartner, H. (2010). Socially desirable response tendencies in survey research. Journal of Marketing Research, 47, 199–214. http://dx.doi.org/10.1509/jmkr.47.2.199
  • Taylor, S. N., & Hood, J. N. (2011). It may not be what you think: Gender differences in predicting emotional and social competence. Human Relations, 64, 627–652. http://dx.doi.org/10.1177/0018726710387950
  • Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. http://dx.doi.org/10.1177/109442810031002
Fuente de los datos: Dialnet