Incremental validity is a type of statistical validity that assesses whether a new psychometric assessment has more predictive ability than existing methods of assessment.[1] It seeks to determine whether the new assessment adds information that cannot be obtained with simpler, already existing methods.[2]
New psychometric instruments are often assessed on whether it can increase knowledge of an outcome variable beyond what is already known based on existing instruments.[3] If the instrument is less successful than an existing tool, then it is incrementally invalid.
Incremental validity is usually assessed using multiple regression methods, involving a regression model with other variables fitted to the data and another model with the focal variable added. Using an F-test to determine significance, a significant difference in the R-square statistic reflects the percent of variance explained by the added variable, indicating whether that variable offers significant additional predictive power for the dependent variable over other variables. Using the change in R-square is more appropriate than mere raw correlations, because the raw correlations do not reflect the overlap of the newly introduced measure and the existing measures.[3]
For example, the College Board has used multiple regression models to assess the incremental validity of a revised SAT test.[4]
- ^ Sackett, Paul R.; Lievens, Filip (2008). "Personnel Selection". Annual Review of Psychology. 59: 419–450. doi:10.1146/annurev.psych.59.103006.093716. PMID 17854285. S2CID 44560725.
- ^ Lillenfield et al. 2005 "What's wrong with this picture?" www.psychologicalscience.org http://www.psychologicalscience.org/newsresearch/publications/journals/sa1_2.pdf Archived 2010-12-24 at the Wayback Machine
- ^ a b Haynes, S.N.; Lench, H.C. (2003). "Incremental Validity of New Clinical Assessment Measures" (PDF). Psychological Assessment. 15 (4): 456–466. doi:10.1037/1040-3590.15.4.456. PMID 14692842. Retrieved 13 December 2013.
- ^ Bridgeman, B.; McCamley-Jenkins, L.; Ervin, N. (2000). "Predictions of Freshman Grade-Point Average From the Revised and Recentered SAT® I: Reasoning Test" (PDF). Ets Rr 00-1. Educational Testing Service, Princeton, NJ. Retrieved 13 December 2013.