Safety, quality & education

How Well Do Accreditation Council for Graduate Medical Education Milestones Track Readiness for Anesthesiology Certifying Examinations in a National Resident Cohort?

Anesth AnalgPublished Retrospective cohort study

Authors' conclusion

There was a modest correlation between the last Medical Knowledge Milestone achieved and the ADVANCED Examination. However, the weak correlations between residency Milestones and the SOE or OSCE performance suggest that the Milestones system, as currently implemented by anesthesiology training programs, does not predict certifying examination performance.

Study context

Population
Anesthesiology residents (PGY-4, CA-3) completing an Accreditation Council for Graduate Medical Education (ACGME)-accredited residency July 2021–June 2022 with first-time American Board of Anesthesiology (ABA) examination performance available by 20231,799 ADVANCED, 1383 Standardized Oral Examination (SOE)/Objective Structured Clinical Examination (OSCE) matched
Participants
1,849 residents
Exposure
Milestones 2.0 ratings vs ABA ADVANCED, SOE and OSCE Z-scores
Outcome
Correlation between average rating across all 23 Milestones (last 6 months of residency) and Z-scores of the ADVANCED, SOE and OSCE among first-time takers
Methodological detailsnational cohort, correlation analysis
  • National cohort
  • Correlation analysis

Main finding

As reported in the abstract

Correlation of average Milestones rating with examination Z-scores

ADVANCED: r (95% CI 0.089-0.180), P < .001

0.135

SOE: r (95% CI 0.065-0.169), P < .001

0.117

OSCE: r (95% CI 0.060-0.164), P < .001

0.112

Observational data: associations, not effects.

Further findings

Domain-specific: ADVANCED vs Medical Knowledge Milestone

R, P < .001
0.289

Domain-specific: SOE task ratings vs related Milestones

No statistically significant associations; ρ, P = .31 to 0.81
0.027 to 0.091

Domain-specific: OSCE stations vs related Milestones

Interpretation of Monitors and Echocardiograms: ρ, P = .031
0.093
Ethical Issues: ρ, P = .003
0.049
Application of Ultrasonography: ρ, P = .775
0.052
Communication with other Professionals: ρ, P = .086
0.052

Original publication

How Well Do Accreditation Council for Graduate Medical Education Milestones Track Readiness for Anesthesiology Certifying Examinations in a National Resident Cohort? Anesth Analg. Published 10 July 2025. doi:10.1213/ane.0000000000007597

Composed by AI from the published abstract and checked against it. How Briefs are made →

Get them every week

New studies on this topic in My Week and in your Monday e-mail.

We e-mail you a sign-in link and a code. No password, no spam.