Safety, quality & education

Validity and reliability of simulation-based assessment tools for European Training Requirement-defined competencies in anaesthesiology: a two-centre observational pilot study

Br J AnaesthPublished Prospective observational pilot study

Authors' conclusion

These findings suggest that simulation-based assessments using structured tools can validly and reliably evaluate technical and nontechnical competencies outlined in the European anaesthesiology training curriculum.

Study context

Population
Anaesthesiology trainees at two university hospitals in Germany and Spain, May–September 2022, managing two simulated perioperative emergencies
Participants
43 participants
Exposure
Fourth-year vs third-year anaesthesiology trainees
  • Fourth-yearn = 20
  • Third-yearn = 23reference
Outcome
Validity and inter-rater reliability of two scenario-specific checklists, a global rating scale (GRS) and the Anaesthetists' Non-Technical Skills (ANTS) tool in assessing European curriculum-defined competencies
Methodological detailstwo-centre, blinded raters, video-recorded simulation
  • Two-centre
  • Blinded raters
  • Video-recorded simulation

Main finding

As reported in the abstract

Inter-rater reliability, Scenario 1: moderate (ICC range)

0.50 to 0.67

Inter-rater reliability, Scenario 2: moderate-to-good (ICC range)

0.67 to 0.76

Observational data: associations, not effects.

Original publication

Validity and reliability of simulation-based assessment tools for European Training Requirement-defined competencies in anaesthesiology: a two-centre observational pilot study. Br J Anaesth. Published 30 January 2026. doi:10.1016/j.bja.2025.12.047

Composed by AI from the published abstract and checked against it. How Briefs are made →

Get them every week

New studies on this topic in My Week and in your Monday e-mail.

We e-mail you a sign-in link and a code. No password, no spam.