Do overall dimension ratings from assessment centres show external construct-related validity?

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Standard

Do overall dimension ratings from assessment centres show external construct-related validity? / Wirz, Andreja; Melchers, Klaus G.; Kleinmann, Martin; Lievens, Filip; Annen, Hubert; Blum, Urs; Ingold, Pia V.

I: European Journal of Work and Organizational Psychology, Bind 29, Nr. 3, 03.05.2020, s. 405-420.

Publikation: Bidrag til tidsskriftTidsskriftartikelForskningfagfællebedømt

Harvard

Wirz, A, Melchers, KG, Kleinmann, M, Lievens, F, Annen, H, Blum, U & Ingold, PV 2020, 'Do overall dimension ratings from assessment centres show external construct-related validity?', European Journal of Work and Organizational Psychology, bind 29, nr. 3, s. 405-420. https://doi.org/10.1080/1359432X.2020.1714593

APA

Wirz, A., Melchers, K. G., Kleinmann, M., Lievens, F., Annen, H., Blum, U., & Ingold, P. V. (2020). Do overall dimension ratings from assessment centres show external construct-related validity? European Journal of Work and Organizational Psychology, 29(3), 405-420. https://doi.org/10.1080/1359432X.2020.1714593

Vancouver

Wirz A, Melchers KG, Kleinmann M, Lievens F, Annen H, Blum U o.a. Do overall dimension ratings from assessment centres show external construct-related validity? European Journal of Work and Organizational Psychology. 2020 maj 3;29(3):405-420. https://doi.org/10.1080/1359432X.2020.1714593

Author

Wirz, Andreja ; Melchers, Klaus G. ; Kleinmann, Martin ; Lievens, Filip ; Annen, Hubert ; Blum, Urs ; Ingold, Pia V. / Do overall dimension ratings from assessment centres show external construct-related validity?. I: European Journal of Work and Organizational Psychology. 2020 ; Bind 29, Nr. 3. s. 405-420.

Bibtex

@article{a84849737aa94582a0a7cdde0aaba54d,
title = "Do overall dimension ratings from assessment centres show external construct-related validity?",
abstract = "There have been repeated calls for an external construct validation approach to advance our understanding of the construct-related validity of assessment centre dimension ratings beyond existing internal construct-related validity findings. Following an external construct validation approach, we examined whether linking assessment centre overall dimension ratings to ratings of the same dimensions that stem from sources external to the assessment centre provides evidence for construct-related validity of assessment centre ratings. We used data from one laboratory assessment centre sample and two field samples. External ratings of the same dimensions stemmed from assessees, assessees{\textquoteright} supervisors, and customers. Results converged across all three samples and showed that different dimension-same source correlations within the assessment centres were larger than same dimension-different source correlations. Moreover, confirmatory factor analyses revealed source factors but no dimension factors in the latent factor structure of overall dimension ratings from the assessment centre and from external sources. Hence, consistent results across the three samples provide no support that assessment centre overall dimension ratings and ratings of the same dimensions from other sources can be attributed to dimension factors. This questions arguments that assessment centre overall dimension ratings should have construct-related validity.",
keywords = "Assessment centre, construct-related validity, external construct validation, performance evaluation",
author = "Andreja Wirz and Melchers, {Klaus G.} and Martin Kleinmann and Filip Lievens and Hubert Annen and Urs Blum and Ingold, {Pia V.}",
note = "Funding Information: This work was supported by two grants from the Swiss National Science Foundation (Schweizerischer Nationalfonds) [100014-117917,100014-130106/1] to Klaus G. Melchers and Martin Kleinmann. We thank Sabrina Engeli, Pascale Lutz, and Stefan Schultheiss for their help with data collection for Study 1. Publisher Copyright: {\textcopyright} 2020, {\textcopyright} 2020 Informa UK Limited, trading as Taylor & Francis.",
year = "2020",
month = may,
day = "3",
doi = "10.1080/1359432X.2020.1714593",
language = "English",
volume = "29",
pages = "405--420",
journal = "European Journal of Work and Organizational Psychology",
issn = "1359-432X",
publisher = "Routledge",
number = "3",

}

RIS

TY - JOUR

T1 - Do overall dimension ratings from assessment centres show external construct-related validity?

AU - Wirz, Andreja

AU - Melchers, Klaus G.

AU - Kleinmann, Martin

AU - Lievens, Filip

AU - Annen, Hubert

AU - Blum, Urs

AU - Ingold, Pia V.

N1 - Funding Information: This work was supported by two grants from the Swiss National Science Foundation (Schweizerischer Nationalfonds) [100014-117917,100014-130106/1] to Klaus G. Melchers and Martin Kleinmann. We thank Sabrina Engeli, Pascale Lutz, and Stefan Schultheiss for their help with data collection for Study 1. Publisher Copyright: © 2020, © 2020 Informa UK Limited, trading as Taylor & Francis.

PY - 2020/5/3

Y1 - 2020/5/3

N2 - There have been repeated calls for an external construct validation approach to advance our understanding of the construct-related validity of assessment centre dimension ratings beyond existing internal construct-related validity findings. Following an external construct validation approach, we examined whether linking assessment centre overall dimension ratings to ratings of the same dimensions that stem from sources external to the assessment centre provides evidence for construct-related validity of assessment centre ratings. We used data from one laboratory assessment centre sample and two field samples. External ratings of the same dimensions stemmed from assessees, assessees’ supervisors, and customers. Results converged across all three samples and showed that different dimension-same source correlations within the assessment centres were larger than same dimension-different source correlations. Moreover, confirmatory factor analyses revealed source factors but no dimension factors in the latent factor structure of overall dimension ratings from the assessment centre and from external sources. Hence, consistent results across the three samples provide no support that assessment centre overall dimension ratings and ratings of the same dimensions from other sources can be attributed to dimension factors. This questions arguments that assessment centre overall dimension ratings should have construct-related validity.

AB - There have been repeated calls for an external construct validation approach to advance our understanding of the construct-related validity of assessment centre dimension ratings beyond existing internal construct-related validity findings. Following an external construct validation approach, we examined whether linking assessment centre overall dimension ratings to ratings of the same dimensions that stem from sources external to the assessment centre provides evidence for construct-related validity of assessment centre ratings. We used data from one laboratory assessment centre sample and two field samples. External ratings of the same dimensions stemmed from assessees, assessees’ supervisors, and customers. Results converged across all three samples and showed that different dimension-same source correlations within the assessment centres were larger than same dimension-different source correlations. Moreover, confirmatory factor analyses revealed source factors but no dimension factors in the latent factor structure of overall dimension ratings from the assessment centre and from external sources. Hence, consistent results across the three samples provide no support that assessment centre overall dimension ratings and ratings of the same dimensions from other sources can be attributed to dimension factors. This questions arguments that assessment centre overall dimension ratings should have construct-related validity.

KW - Assessment centre

KW - construct-related validity

KW - external construct validation

KW - performance evaluation

UR - http://www.scopus.com/inward/record.url?scp=85078810241&partnerID=8YFLogxK

U2 - 10.1080/1359432X.2020.1714593

DO - 10.1080/1359432X.2020.1714593

M3 - Journal article

AN - SCOPUS:85078810241

VL - 29

SP - 405

EP - 420

JO - European Journal of Work and Organizational Psychology

JF - European Journal of Work and Organizational Psychology

SN - 1359-432X

IS - 3

ER -

ID: 291670286