A detection theory approach to the evaluation of assessors in assessment centres

Stillman, J.A. and Jackson, Duncan (2005) A detection theory approach to the evaluation of assessors in assessment centres. Journal of Occupational and Organizational Psychology 78 (4), pp. 581-594. ISSN 0963-1798.

Abstract

The ratings given to job applicants in an assessment centre (AC) will be influenced both by an assessor's sensitivity to the evidence of suitability provided by the applicants, and by whether the assessor has a liberal or a conservative rating tendency. In this study we explore the usefulness of signal detection methodology for evaluating and comparing both aspects of performance. A group of eight managerial assessors in a real-world AC rated 195 applicants for retail sales positions. The sensitivity and response bias of assessors was evaluated using receiver operating characteristic (ROC) analyses, and their performance was evaluated by means of critical operating characteristic (COC) analyses. RscorePlus software (Harvey, 2002) was used for these purposes. We conclude that, in this and similar organizational contexts, such analyses are potentially useful for estimating and comparing the performances of assessors, thereby highlighting the need for, and subsequently evaluating the effectiveness of, any remedial intervention.

Metadata

Statistics

DownloadsShow export options

Export as XMLJSONCSV

Activity Overview

6 month trend

1Download

6 month trend

154Hits

Additional statistics are available via IRStats2.

Archive Staff Only (login required)

Edit/View Item