Definition of Themes

Test Material Development is addressed in two segments. The first concentrates on establishing the purpose(s) of the assessment and defining the content that should be included in the evaluation. The second segment addresses assessment formats including multiple choice items, constructed responses and simulation based methods. Matching methods to assessment needs is emphasized in these segments.

Scoring, Analysis and Reporting addresses the processes used to summarize and disseminate assessment data. Methods for generating individual test scores, aggregating performance data, equating scores, and providing meaningful feedback to examinees will be highlighted.

Standard Setting describes the processes used to establish cut-scores for an assessment. Both test-centered and examinee-centered approaches will be discussed. For norm referenced evaluations, techniques for identifying poorly performing individuals will be identified.

Test Score Validation highlights the activities that can be undertaken to provide evidence that the test scores and associated interpretations are justifiable and fair. Techniques that can be used to discover potential threats to the validity of assessment scores will be identified.