Thanks to Ken for sending along this reference. The authors, who acknowledge being associated with the testing industry, present evidence on diverse issues that complicate judgements about the utility of standardized tests. For example, validity coefficients for tests are stronger when calculated on the basis of grades in individual courses, presumably because this avoids the problem of weaker students getting higher grades by taking easier courses. They also discuss stereotype threat and several findings that contradict its involvement in high stakes testing (e.g., the LACK of underprediction for disadvantaged groups). Its well worth a read. The abstract states:
"The authors review criticisms commonly leveled against cognitively loaded tests used for employment and higher education admissions decisions, with a focus on largescale databases and meta-analytic evidence. They conclude that (a) tests of developed abilities are generally valid for their intended uses in predicting a wide variety of aspects of short-term and long-term academic and job performance, (b) validity is not an artifact of socioeconomic status, (c) coaching is not a major determinant of test performance, (d) tests do not generally exhibit bias by underpredicting the performance of minority group members, and (e) test-taking motivational mechanisms are not major determinants of test performance in these highstakes settings." Take care Jim James M. Clark Professor of Psychology 204-786-9757 204-774-4134 Fax [EMAIL PROTECTED] >>> Ken Steele <[EMAIL PROTECTED]> 29-May-08 2:42 PM >>> A review article of these issues has appeared in timely fashion- Sackett, P. R., Borneman, M. J., & Connelly, B. J. (2008). High-stakes testing in higher education and employment: Appraising the evidence for validity and fairness. American Psychologist, 63 (4), 215-227. Ken --------------------------------------------------------------- Kenneth M. Steele, Ph.D. [EMAIL PROTECTED] Department of Psychology http://www.psych.appstate.edu Appalachian State University Boone, NC 28608 USA --------------------------------------------------------------- --- To make changes to your subscription contact: Bill Southerly ([EMAIL PROTECTED]) --- To make changes to your subscription contact: Bill Southerly ([EMAIL PROTECTED])
