A well-functioning distractor in a multiple-choice item should generally:
A good distractor attracts more low achievers than high achievers.
In a multiple-choice item, a distractor is selected more frequently by high achievers than by low achievers. What does this pattern most strongly suggest?
A distractor chosen more by high achievers than low achievers may be misleading or flawed.
An item has a discrimination index approaching 1.00. This indicates that the item:
A discrimination index near 1.00 means the item sharply separates higher- from lower-achieving students.
An item has a discrimination index of 0.20. Based on the stated acceptable range, the most appropriate interpretation is:
A discrimination index of 0.20 is below the commonly accepted range, so the item discriminates inadequately.
An item has a difficulty value of 85%. A novice test developer describes it as “very difficult” because the numerical value is high. What conceptual error has been made?
A difficulty value of 85% means most students answered correctly, so the item is easy, not very difficult.
A test developer wants most items to avoid being either excessively easy or excessively difficult. Which difficulty range is identified as generally desirable?
Items with difficulty between 30% and 70% are generally considered desirable, neither too easy nor too hard.
Two items have difficulty indices of 25% and 65%. Which conclusion follows most directly from the stated interpretation?
A higher difficulty percentage means more students answered correctly, so the 65% item is easier than the 25% item.
An item is answered correctly by 54 of 60 students. Based on the stated interpretation of item difficulty, the item is:
54 of 60 is 90% correct; a high difficulty percentage means most students answered correctly, so the item is relatively easy.
An item is answered correctly by 18 out of 60 students. Using the stated difficulty formula, the item’s difficulty percentage is:
Difficulty percentage = (correct responses / total students) × 100 = 18/60 × 100 = 30%.
Which situation most clearly illustrates the distinction between reliability and validity?
Measuring an unintended construct consistently is reliable but not valid, which separates the two concepts.
A test produces highly consistent scores but systematically measures the wrong construct. Which conclusion is most defensible?
Consistency alone does not guarantee validity: a test can consistently measure the wrong construct, so it is reliable but may lack validity.
A 60-item examination is divided into two comparable halves, and the consistency of performance across the halves is examined. This procedure primarily investigates:
Checking consistency between two halves of one test is split-half reliability.
A teacher creates two equivalent versions of an examination and examines whether students perform consistently across the two versions. Which reliability procedure is being used?
Comparing performance on two equivalent versions of a test is parallel-forms (equivalent-forms) reliability.
Two teachers independently score the same set of essays and produce highly similar results. This provides evidence of:
Agreement between independent scorers is inter-rater reliability.
A test produces nearly identical scores when administered to the same learners under comparable conditions several weeks apart. Which form of reliability is most directly demonstrated?
Consistent scores from the same learners across two occasions show test-retest reliability.
A researcher argues that a test is valid because its questions “look appropriate.” Another researcher demonstrates that it actually represents the intended curriculum comprehensively. The second argument provides stronger evidence of:
Showing that a test comprehensively represents the intended curriculum is evidence of content validity, which is stronger than mere appearance.
A newly developed employment test is intended to measure a concrete job-related outcome. Researchers examine whether test scores correspond accurately with that external outcome. This evidence primarily concerns:
Criterion validity examines how well test scores correspond with an external outcome measure.
A newly developed examination appears, at first glance, to be appropriate for measuring scientific reasoning because its questions visibly resemble scientific reasoning tasks. Which validity concept is being considered?
Face validity is the surface impression that a test appears to measure what it should.
A mathematics examination claims to measure the complete syllabus, but almost all questions come from only one chapter. Which validity concern is most directly raised?
Content validity concerns whether a test adequately covers the whole content domain; drawing from one chapter undermines it.
An item is intended to measure critical-thinking ability, but students can obtain high scores merely by recognizing familiar vocabulary. The primary concern is that the item may lack:
If an item meant to measure critical thinking only rewards vocabulary recognition, it does not measure the intended construct, so construct validity is lacking.
A test intended to estimate cognitive functioning rather than mastery of a particular taught curriculum would most appropriately be classified as an:
Intelligence tests estimate general cognitive functioning rather than mastery of a taught curriculum.
A counselor uses ambiguous stimuli to encourage students to reveal aspects of personality that may not be directly expressed through conventional questioning. This procedure is most closely associated with:
Projective techniques use ambiguous stimuli to reveal personality traits not easily expressed directly.
A test is specifically designed to estimate how well a learner may perform in a future educational or occupational context. Its defining purpose is:
Aptitude tests are designed to predict future performance.
An examination is intended to determine whether a student has acquired the knowledge and skills taught during a particular instructional program. It is primarily an:
Achievement tests measure what has been learned from a particular instructional program.