Print Handheld Contrast

Standard Setting

Standard Setting involves interpreting test items (questions) to determine a test's cut score. For an introduction to Cut Scores, take a look at the link below.

PowerPoint Presentations:

• Determining Cut Scores

What is the Value of a Cutscore?

In an effort to maximize the quality of care provided to the public and provide the highest quality recertification experience, the Southwest Ontario Regional Base Hospital Program (SWORBHP) conducted its first standard setting study on July 13, 2010. Standard setting is the scientific process that test makers use to
establish the cutscore or passing standard for a certification examination. Most modern certification programs approach the test development process from a criterion-referenced perspective. A criterion-referenced test determines a test outcome (e.g., pass or fail) by comparing a test score to absolute criteria
(Haertel, 2006). This is different than normreference testing which determines test outcomes by comparing a test score to the scores of other examinees. SWORBHP’s certification program approaches testing from a criterionreferenced perspective. Standard setting is the process that is used to determine what the absolute
passing criteria will be for examinees taking a criterion-referenced exam. During the SWORBHP standard setting, a psychometrician led a group of subject matter experts through a series of activities designed to
synthesize the opinions of the group and render a cutscore for the Primary Care Paramedic (PCP) recertification examination. SWORBHP utilized a method called the modified-Angoff method (Angoff, 1971). The first part of the process was a discussion in which the group of participants collaborated together to develop a conceptual definition of minimal competency.

Brian D. Bontempo, Ph.D.
Mountain Measurement, Inc.
www.mountainmeasurement.com

Reference:
Haertel, E. H. (2006). Reliability. In R. L. Brennan
(Ed.), Educational Measurement (4th ed., pp. 65-
110). Westport, CT: American Council on Education/
Praeger.

Angoff, W.H. (1971). Scales, norms and equivalent
scores. In R.L. Thorndike (Ed.), Educational Measurement
(2nd ed.). Washington DC: American
Council on Education.