Skip to main content

Training data analysis 2017

Our national Training Evaluation Survey collates feedback from the Trainee Evaluation Form (TEF), taking place in the early part of the year, prior to the GMC survey. It provides the College, schools and individual units detailed feedback on the training and education trainees undertake.

This allows the recognition of good training and is a driver for improvement in training where problems are identified. You can see a complete version of the questions that are posed (PDF 324kb). The form is a part of the RCOG training matrix and gains validity through its high response rate.

The questions on the survey were developed and are reviewed each year by the Training Evaluation Committee which reports to the Specialty Education Advisory Committee (SEAC). The committee has representation and input from SEAC and the Trainees’ Committee.

The college now has access to 2 years of data and this provides a degree of detailed analysis that is not possible via the generic questions in the GMC survey.

The committee has been working on the data analysis and has developed a number of indicators (which mirrors the methodology of the GMC survey). These indicators combine the response to a number of questions and the details of how the indicators are calculated can be found in the TEF guidance (PDF 826kb).

The indicators are:

  • Education - Support and supervision
  • Education - Local training
  • Education - Regional training
  • Gynaecological training - General
  • Gynaecological training - Procedural
  • Gynaecological training - Basic ultrasound
  • Obstetric training - General
  • Obstetric training - Procedural
  • Obstetric training - Basic ultrasound
  • Professional development
  • Clinical governance, hospital processes and resources
  • Working environment
  • Behaviours experienced
  • Overall recommendation

Each year the data collected through the TEF is circulated to Heads of school and Chairs of trainees committees to allow local analysis and for good training to be recognised and for standards to be improved where needed. In addition, detailed analyses are undertaken at a national level of specific areas of training that are highlighted as in need of special attention by SEAC and the Trainees’ Committee. These analyses not only draw data from the TEF but also use other available data sources such as the eportfolio and the GMC survey.

The key purpose of these analyses is to drive change and improve quality of education and training both at school level and within individual units. Its power to galvanise change has already been demonstrated.

In 2016 the quality of regional training schemes was raised as an issue both by the TEF and GMC surveys. This data was used by schools to promote positive change and the overall satisfaction in 2017 improved from 48% to 67%, a startling positive change to the good.

The key areas targeted for more detailed analysis in the 2017 round are listed below. These reports were also considered by the relevant educational committees in the college.

Read detailed reports for the following subject areas:

Subspecialty training
Analysis by Dr Michelle MacKintosh, Dr Joanne Bailey and Professor Mark Kilby
Educational supervision
Analysis by Dr Marie O’Sullivan and Miss Karen Joash
Gynaecology training
Analysis by Mr Fevzi Shakir, Miss Donna Ghosh and Dr Sarah Murray
Regional teaching
Analysis by Miss Sarah Flint and Dr Rachel Lee
Working patterns and impact of the new junior doctors' contract
Analysis by Dr Abdelmageed Abdelrahman and Dr Jo Mountfield
Access to specialist clinics
Analysis by Dr Justin Chu and Miss Sarah Flint
Workplace behaviour
Analysis by Dr Janet Berry and Dr Rachna Bahl
Ultrasound training
Analysis by Miss Dhivya Chandrasekaran and Miss Manjiri Khare
Less Than Full-Time training (LTFT)
Analysis by Dr Sarah Coleridge and Dr Jennifer Davies
ATSM/APM training
Analysis by Dr Reena Aggarwal and Mrs Sarah Reynolds.

 

You can also see a summary of the conclusions and recommendations from each report, collected together in the same place.

 

Further work

The Training Evaluation Committee has already updated the questions for the 2018 TEF and will be validating data regarding trainees’ status (maternity leave, OOP, etc.) in the new year. It is important that trainees are encouraged to complete the survey as this is extremely useful data which does drive improvements in quality.

As in previous years, in 2018 the information entered in the form will also be distributed to Schools of Obstetrics and Gynaecology and regional trainee representatives in order that they can monitor training quality. Individual school quality panels will have access to all summarised data for each hospital by training level (i.e. ST1-2, ST3-5 and ST6-7). In order to protect trainees, names and LTFT status will not be given to individual schools. Free text comments will also be available to the schools pooled by hospital and training level (i.e. ST1-2, ST3-5 and ST6-7).

We have also agreed that next year the results of the survey will be publically available on the college website. The same caveat will apply as occurs with the GMC survey in that responses will only be published where there are at least 3 respondents, to protect trainee anonymity.

Because of the excellent response rate and richness of data we obtain from the Training Evaluation Survey, the specialty-specific questions in the GMC survey have been significantly reduced making it shorted for trainees to complete.

The college has also recognised the top achieving Trusts in the survey across the 4 countries and further details on the winners and information about how they achieved this will also be published in the near future.