Generalizability Theory's Role in Validity Research: Innovative Applications in Health Science Education

Abstract While generalizability (G) theory is widely recognized as a method for estimating the reliability (precision) of measures, its unique approach to partitioning and quantifying variance also yields validity (accuracy) evidence. The eclectic set of validity applications discussed here demonstrate G theory’s potential for addressing a wide array of health science education measurement questions. Each G study example is linked to one of Kane’s four types of validity inferences. Because each application of G theory is unique, the examples do not represent the possible range of applications, but rather demonstrate the methodological flexibility of G theory in addressing complex validity questions. Further advances will require researchers to develop and share additional innovations in G study design and work together to develop a consensus regarding its role in validity research.