Test-Retest Reliability
Also called: retest reliability, temporal stability
Test-retest reliability measures how consistently an assessment ranks or scores people across two or more occasions when the underlying characteristic is expected to remain reasonably stable. It is commonly estimated with a correlation or agreement statistic. The result depends on the time interval, population, testing conditions, and whether real change is plausible.
Reviewed July 14, 2026 · 2 min read
When faced with a complex decision, I prioritize a methodical approach over intuitive leaps.
How it is estimated
The same assessment is administered to the same people at two points in time. Researchers then compare the scores. A strong relationship suggests people maintain a similar relative position, while an agreement analysis can test whether absolute values also remain close.
The interval matters. A retest after one hour may be inflated because people remember answers. A retest after several years includes genuine personality development and life changes. There is no universally correct interval.
Why results can differ
Differences can reflect measurement error, but not every difference is an error. Scores may change because of:
- temporary mood, fatigue, or context;
- learning or memory effects;
- changed interpretation of an item;
- genuine development in the measured trait;
- a different device, language, or administration condition.
Researchers should choose conditions that match the intended interpretation.
Personality stability is not immobility
Personality traits are relatively enduring, not frozen. A useful personality assessment should show enough stability to support its claims while allowing real change. Strong retest reliability over a sensible interval supports precision; it does not prove construct validity.
Adaptive tests and retesting
An adaptive assessment may present different items during the second session. Retest evidence then evaluates whether the standardized algorithm and item bank produce comparable trait estimates, not whether every question is repeated.
Go deeper: Why personality-test results can change
Sources
- Internal Consistency, Retest Reliability, and Personality Scale Validity — Personality and Social Psychology Review
- Test-Retest Reliability of a Forced-Choice Personality Measure — ETS Research Report
- Standards for Educational and Psychological Testing — AERA, APA, and NCME