A researcher rejects the study of unobservable mental events and investigates only measurable stimulus-response relationships. His position most closely reflects:
Behaviorism focuses only on observable stimulus-response relationships.
A test developer wants to ensure that a 60-item examination adequately samples both the intended subject-matter content and the desired cognitive processes rather than overemphasizing a few easily tested areas. Which tool should be developed before constructing the final test?
A Table of Specification plans content coverage and cognitive levels so the test samples the domain adequately.
A researcher asks respondents to evaluate Brand X by explicitly comparing it with Brand Y as the reference point. Which type of rating scale is being used?
A comparative rating scale evaluates something by explicitly comparing it with a reference item.
A researcher records students’ satisfaction using categories such as “Very dissatisfied,” “Dissatisfied,” “Neutral,” “Satisfied,” and “Very satisfied.” The defining feature of this instrument is that it:
A descriptive rating scale uses verbal categories arranged along a continuum.
A student maintains drafts, written assignments, artwork, presentations, and other selected work over time so that the development of learning can be examined. This is most appropriately described as a:
A portfolio is a purposeful collection of student work showing progress over time.
A teacher records brief, systematic notes about a student’s specific classroom behaviors, skills, and attitudes whenever significant incidents occur. These records are:
Anecdotal records are brief notes on specific behaviors written when significant incidents occur.
A teacher evaluates a student’s oral presentation using performance descriptions such as “advanced,” “proficient,” and “partially proficient.” The instrument is best characterized as a:
A scoring rubric uses performance-level descriptions such as advanced, proficient and partially proficient.
Students are asked to rate their classmates using the same rating instrument that their teacher uses to assess them. This procedure is best described as:
Students rating their classmates is peer appraisal.
A teacher prepares a list of specific behaviors and records whether each behavior is present or absent by marking “Yes” or “No.” This instrument is a:
A checklist records only the presence or absence of listed behaviors.
A researcher observes classroom behavior at a predetermined time, in a predetermined location, under specified conditions. This is most clearly:
Observation at a set time and place under specified conditions is controlled observation.
A teacher observes students during a naturally occurring group activity without imposing predetermined experimental conditions. Which observational technique is most appropriate?
Natural observation takes place in real settings without imposing predetermined conditions.
A researcher claims that a test is valid simply because students receive nearly identical scores every time it is administered. Which response is most conceptually accurate?
Consistency shows reliability only; further evidence is needed to show the test measures what it is intended to measure.
A test has excellent content coverage, but different examiners award substantially different scores to identical responses. Which combination best describes the situation?
Good content coverage means high content validity, while inconsistent scoring by different examiners means weak inter-rater reliability.
A teacher administers an examination to the same students on two occasions under comparable conditions. The first administration produces substantially different results from the second, even though no meaningful change in students’ learning has occurred. Which conclusion is most justified?
Large score differences between two administrations without a change in learning indicate weak test-retest reliability.
A test intended to measure mathematical reasoning contains many questions involving difficult reading passages. Students with strong mathematical reasoning but weaker reading ability perform poorly. Which validity concern is most directly raised?
Difficult reading passages make the test also measure reading ability, so it does not purely measure mathematical reasoning (construct validity concern).
An aptitude test is designed to predict students’ future performance in a professional training program. Researchers compare students’ test scores with their subsequent performance in that program. Which type of validity is most directly investigated?
Comparing test scores with later performance in the program (predictive evidence) is criterion validity.
A newly designed test appears appropriate to teachers because its questions seem, on the surface, to measure the stated learning objectives. However, no empirical evidence has yet been established regarding whether it actually measures the intended construct. The initial judgment represents:
Judging a test by surface appearance without empirical evidence is face validity.
A 40-item test is divided into two comparable halves. The teacher examines whether students who perform well on one half also perform well on the other half. Which reliability procedure is being used?
Comparing performance across two halves of one test is split-half reliability.
A school prepares Form A and Form B of an achievement test. Both forms contain different questions but are designed to measure the same content and skills at comparable levels of difficulty. The consistency between the two forms provides evidence of:
Consistency between two equivalent forms with different items is parallel-forms reliability.
A researcher administers the same personality questionnaire to the same group of participants twice, three weeks apart. The scores show a very high degree of consistency. Which type of reliability is being examined?
Giving the same test to the same group twice and comparing scores examines test-retest reliability.
Two teachers independently score the same set of students’ essays. Teacher A gives consistently higher marks than Teacher B because the two teachers apply different interpretations of the scoring criteria. Which quality of the assessment is most directly affected?
Systematic score differences caused by different interpretations of the criteria reduce inter-rater reliability.
A mathematics test is designed to cover ten major topics taught during the semester. However, 70% of the questions focus on only two topics. Which aspect of validity is most directly threatened?
When most items come from two of ten topics, the test does not represent the content domain, threatening content validity.
A teacher develops a test intended to measure students’ critical-thinking ability. Students obtain very similar scores when the test is administered repeatedly, but the questions mainly require memorization of definitions. Which conclusion is most appropriate?
Consistent scores show reliability, but memorization items do not measure critical thinking, so construct validity may be lacking.
Which progression most accurately captures the conceptual movement in SOLO taxonomy?
SOLO progresses from one idea to several disconnected ideas, then integrated relationships, then new generalization.