British surgeons' experiences of mandatory online workplace-based assessment

Summary Objectives An online workplace-based assessment tool, the Intercollegiate Surgical Curriculum Programme (ISCP), has become mandatory for all British surgical trainees appointed since August 2007. A compulsory £125 annual trainee fee has also been introduced to fund its running costs.The study sought to evaluate user satisfaction with the ISCP. Design and setting A total of 539 users across all surgical specialties (including 122 surgeons acting as assessors) were surveyed in late 2008 by online questionnaire regarding their experiences with the ISCP. Results Sixty-seven percent had used the tool for at least one year. It was rated above average by only 6% for its registration process and only 11% for recording meetings and objectives. Forty-nine percent described its online assessments as poor or very poor, only 9% considering them good or very good. Seventy-nine percent rated the website’s user friendliness as average or worse, as did 72% its peer-assessment tool and 61% its logbook of procedures. Seventy-six percent of respondents had carried out paper assessments due to difficulties using the website. Six percent stated that the ISCP had impacted negatively on their training opportunities, 41% reporting a negative impact overall upon their training; only 6% reported a positive impact. Ninety-four percent did not consider the trainee fee good value, only 2% believing it should be paid by the trainee. Conclusions The performance of the ISCP leaves large numbers of British surgeons unsatisfied. Its assessments lack appropriate evidence of validity and its