Longitudinal Milestone Assessment Extending Through Subspecialty Training: The Relationship Between ACGME Internal Medicine Residency Milestones and Subsequent Pulmonary and Critical Care Fellowship Milestones.

PURPOSE The Accreditation Council for Graduate Medical Education (ACGME) milestones were implemented across medical subspecialties in 2015. Although milestones were proposed as a longitudinal assessment tool potentially providing opportunities for early implementation of individualized learning plans in fellowship, the association of subspecialty fellowship ratings with prior residency ratings remains unclear. This study aimed to assess the relationship between internal medicine (IM) residency milestones and pulmonary-critical care medicine (PCCM) fellowship milestones. METHOD A multicenter retrospective cohort analysis was conducted for all PCCM trainees enrolled in ACGME-accredited PCCM fellowship programs in 2017-2018 who had complete prior IM milestone ratings from 2014-2017. Only professionalism and interpersonal and communication skills (ICS) were included based on shared anchors between IM and PCCM milestones. Using a generalized estimating equations model, the association of PCCM milestones ≤ 2.5 during the first year of fellowship with corresponding IM subcompetencies was assessed at each time-point, nested by program. Statistical significance was determined using logistic regression. RESULTS The study included 354 unique PCCM fellows. For both ICS and professionalism subcompetencies, fellows with higher IM ratings were less likely to obtain PCCM ratings ≤ 2.5 during the first fellowship year. Each ICS subcompetency was significantly associated with future lapses in fellowship (ICS01: β = -0.67, P = 0.003; ICS02: β = -0.70, P = 0.001; ICS03: β = -0.60, P = 0.004) at various residency timepoints. Similar associations were noted for PROF03 (β = -0.57, P = 0.007). CONCLUSIONS Findings demonstrated an association between IM milestone ratings and low milestone ratings during PCCM fellowship. IM trainees with low ratings in several professionalism and ICS subcompetencies were more likely to be rated ≤ 2.5 during their first year in PCCM fellowship. This highlights a potential use of longitudinal milestones to target educational gaps at the beginning of PCCM fellowship.