Two teachers independently score the same set of essays and produce highly similar results. This provides evidence of:
Agreement between independent scorers is inter-rater reliability.
Assessment and Evaluation MCQs
📚 Table of Content
A teacher creates two equivalent versions of an examination and examines whether students perform consistently across the two versions. Which reliability procedure is being used?
Comparing performance on two equivalent versions of a test is parallel-forms (equivalent-forms) reliability.
A 60-item examination is divided into two comparable halves, and the consistency of performance across the halves is examined. This procedure primarily investigates:
Checking consistency between two halves of one test is split-half reliability.
A test produces highly consistent scores but systematically measures the wrong construct. Which conclusion is most defensible?
Consistency alone does not guarantee validity: a test can consistently measure the wrong construct, so it is reliable but may lack validity.
Which situation most clearly illustrates the distinction between reliability and validity?
Measuring an unintended construct consistently is reliable but not valid, which separates the two concepts.
An item is answered correctly by 18 out of 60 students. Using the stated difficulty formula, the item’s difficulty percentage is:
Difficulty percentage = (correct responses / total students) × 100 = 18/60 × 100 = 30%.
A mathematics examination claims to measure the complete syllabus, but almost all questions come from only one chapter. Which validity concern is most directly raised?
Content validity concerns whether a test adequately covers the whole content domain; drawing from one chapter undermines it.
A newly developed examination appears, at first glance, to be appropriate for measuring scientific reasoning because its questions visibly resemble scientific reasoning tasks. Which validity concept is being considered?
Face validity is the surface impression that a test appears to measure what it should.
A newly developed employment test is intended to measure a concrete job-related outcome. Researchers examine whether test scores correspond accurately with that external outcome. This evidence primarily concerns:
Criterion validity examines how well test scores correspond with an external outcome measure.
A researcher argues that a test is valid because its questions “look appropriate.” Another researcher demonstrates that it actually represents the intended curriculum comprehensively. The second argument provides stronger evidence of:
Showing that a test comprehensively represents the intended curriculum is evidence of content validity, which is stronger than mere appearance.
A test produces nearly identical scores when administered to the same learners under comparable conditions several weeks apart. Which form of reliability is most directly demonstrated?
Consistent scores from the same learners across two occasions show test-retest reliability.
An item is intended to measure critical-thinking ability, but students can obtain high scores merely by recognizing familiar vocabulary. The primary concern is that the item may lack:
If an item meant to measure critical thinking only rewards vocabulary recognition, it does not measure the intended construct, so construct validity is lacking.
A school purchases a test developed by specialists and administered according to established procedures rather than creating its own classroom examination. This is best described as a:
A test developed by specialists and given under established procedures is a standardized test.
Which distinction is most fundamental when differentiating teacher-made and standardized tests?
The basic difference is who develops the test: classroom teachers for teacher-made tests, specialists for standardized tests.
An examination is intended to determine whether a student has acquired the knowledge and skills taught during a particular instructional program. It is primarily an:
Achievement tests measure what has been learned from a particular instructional program.
A test is specifically designed to estimate how well a learner may perform in a future educational or occupational context. Its defining purpose is:
Aptitude tests are designed to predict future performance.
A counselor uses ambiguous stimuli to encourage students to reveal aspects of personality that may not be directly expressed through conventional questioning. This procedure is most closely associated with:
Projective techniques use ambiguous stimuli to reveal personality traits not easily expressed directly.
A test intended to estimate cognitive functioning rather than mastery of a particular taught curriculum would most appropriately be classified as an:
Intelligence tests estimate general cognitive functioning rather than mastery of a taught curriculum.
A teacher asks, “In no more than 150 words, explain two causes of water pollution and describe one consequence of each.” The item is best classified as:
A word limit and specified points to cover make this a restricted-response essay.
A student is instructed to “Discuss the educational consequences of social inequality, selecting and organizing evidence as you consider appropriate.” The item gives substantial freedom concerning content selection and organization. It is:
Freedom to select and organize content is the mark of an extended-response essay.
Why is a restricted-response essay generally expected to produce greater scoring reliability than an extended-response essay?
Restricted-response items limit the range and organization of acceptable answers, which makes scoring more consistent.
A teacher wants students to independently select evidence, synthesize several perspectives, organize an argument, and reach a defensible conclusion. Which format provides the greatest opportunity for these behaviors?
Extended-response essays give learners the most opportunity to select evidence, synthesize and organize an argument.
Which feature most directly explains why copying another student’s response is comparatively difficult in an extended-response examination?
In extended-response tests students must generate and organize their own answers, so copying is comparatively difficult.
A student scores 80% on a criterion-referenced examination. Another student scores 60%. The first student’s score does not alter the second student’s interpretation because the test is primarily concerned with:
Criterion-referenced scores are interpreted against predetermined standards, so one student's score does not affect another's interpretation.
Which characteristic would most strongly distinguish a criterion-referenced test from a norm-referenced test?
Criterion-referenced tests focus on a clearly defined learning domain, unlike norm-referenced tests that sample broadly to rank students.