Skip to main content

Training data analysis 2018

Our national Training Evaluation Survey collates feedback from the Training Evaluation Form (TEF), taking place in the early part of the year, prior to the GMC survey. It provides the College, schools and individual units detailed feedback on the training and education trainees undertake.

This allows the recognition of good training and is a driver for improvement in training where problems are identified. You can see a complete version of the questions that are posed (PDF 732kb). The form is a part of the RCOG training matrix and gains validity through its high response rate.

The questions on the survey were developed and are reviewed each year by the Training Evaluation Committee which reports to the Specialty Education Advisory Committee (SEAC). The committee has representation and input from SEAC and the Trainees’ Committee.

The college now has access to 3 years of data and this provides a degree of detailed analysis that is not possible via the generic questions in the GMC survey.

The committee has been working on the data analysis and has developed a number of indicators (which mirrors the methodology of the GMC survey). These indicators combine the response to a number of questions.

The indicators are:

  • Education - Support and supervision
  • Education - Local training
  • Education - Regional training
  • Gynaecological training - General
  • Gynaecological training - Procedural
  • Gynaecological training - Basic ultrasound
  • Obstetric training - General
  • Obstetric training - Procedural
  • Obstetric training - Basic ultrasound
  • Professional development
  • Clinical governance, hospital processes and resources
  • Working environment
  • Behaviours experienced
  • Overall recommendation

Each year the data collected through the TEF is circulated to Heads of school and Chairs of trainees committees to allow local analysis and for good training to be recognised and for standards to be improved where needed. In addition, detailed analyses are undertaken at a national level of specific areas of training that are highlighted as in need of special attention by SEAC and the Trainees’ Committee. These analyses not only draw data from the TEF but also use other available data sources such as the eportfolio and the GMC survey.

The key purpose of these analyses is to drive change and improve quality of education and training both at school level and within individual units. Its power to galvanise change has already been demonstrated.

In 2016 the quality of regional training schemes was raised as an issue both by the TEF and GMC surveys. This data was used by schools to promote positive change and the overall satisfaction in 2017 improved from 48% to 67%, a startling positive change to the good.

The key areas targeted for more detailed analysis in the 2018 round are listed below. These reports were also considered by the relevant educational committees in the college.

 

You can read detailed reports for the following subject areas below, including a summary of the conclusions and recommendations (PDF) from each report, collected together in the same place.

 

Subspecialty training (PDF)
Analysis by Dr Michelle MacKintosh, Dr Joanne Bailey and Miss Melanie Davies

Educational supervision (PDF)
Analysis by Dr Marie O’Sullivan and Miss Karen Joash

Gynaecology training (PDF)
Analysis by Mr Fevzi Shakir, Dr James McLaren and Dr Angharad Jones

Regional teaching (PDF)
Analysis by Miss Sarah Flint and Dr Rachel Lee

Working patterns and impact of the new junior doctors' contract (PDF)
Analysis by Dr Ka Ying Bonnie Ng Dr Abdelmageed Abdelrahman and Dr Jo Mountfield

Access to specialist clinics (PDF)
Analysis by Dr Justin Chu and Miss Sarah Flint

Workplace behaviour (PDF)
Analysis by Dr Sarah Quinn and Dr Rachna Bahl

Ultrasound training
Analysis by Miss Dhivya Chandrasekaran and Miss Manjiri Khare

Less Than Full-Time training (LTFT) (PDF)
Analysis by Dr Andrea Day, Dr Jennifer Davies and Dr Susanna Crowe

ATSM/APM training (PDF)
Analysis by Dr Andrea Liu and Mrs Sarah Reynolds.

 

TEF awards and good practice

The college has also recognised the top achieving Trusts in the survey across the 4 countries. Details of the TEF award-winners and highly commended units can be accessed here, by clicking on the “TEF Awards” tab.

You can see further details on how these units achieved their outstanding results.

 

Further work

The Training Evaluation Committee has already updated the questions for the 2019 TEF and will be validating data regarding trainees’ status (maternity leave, OOP, etc.) in the new year. It is important that trainees are encouraged to complete the survey as this is extremely useful data which does drive improvements in quality.

As in previous years, in 2019 the information entered in the form will also be distributed to Schools of Obstetrics and Gynaecology and regional trainee representatives in order that they can monitor training quality. Individual school quality panels will have access to all summarised data for each hospital by training level (i.e. ST1-2, ST3-5 and ST6-7). In order to protect trainees, names and LTFT status will not be given to individual schools. Free text comments will also be available to the schools pooled by hospital and training level (i.e. ST1-2, ST3-5 and ST6-7).

As with this year, the results of the 2019 survey will be publically available on the college website. The same caveat will apply as occurs with the GMC survey in that responses will only be published where there are at least 3 respondents, to protect trainee anonymity.