AB1134 Reumeval: Online System for Teacher Evaluation of Rotation in Rheumatology Mir. Results of the Pilot

Objectives Analyze the results of a pilot study to measure the functionality of a new online evaluation system of knowledge in Rheumatology MIR rotating units for this specialty. Methods It has been developed an online computer test platform for knowledge in Rheumatology with measurable results. 10 centers in the Valencian Community were asked to prepare questions of moderate and attainable complexity to MIR residents from other specialties. The evaluation procedure is carried out in two stages: a first test of 30 questions starts the rotation, which includes demographic data. At the end of the Rheumatology rotation, the MIR perform the second test similarly and lastly, they answer a satisfaction questionnaire about the rotation performed. Each question has 4 options, the valid answer is 1 point and an incorrect answer subtracts 0.25 points. Results It has been developed a set of 300 multiple choice questions, of which >10% include images. These questions cover topics from the entire spectrum of the specialty. To confirm the suitability of the questions at the expected level of MIR rotating one Delphi round was held between the participants, 59 were detected not suitable questions that were replaced by more affordable. The results obtained so far correspond to the last 10 months. In assessing 42 physicians participated in MIR formation of which 32 were women (76%). 2 in the province of Castellόn, 6 Valencia and 5 of Alicante results of 13 centers of Valencian Community were obtained. Most respondents were residents of 2nd year (64%) and from the Family and Community Medicine specialty (69%). Of a total of 30 questions in the questionnaire, in the first test (start of rotation) the mean of the correct questions was 18.90±3.81, with a mean failure of 10.50±3.37 and a mean of unanswered questions of 0.60±1.64. In the second test (final rotation), the mean of the correct questions was 21.30±3.59, with a mean failure of 8.43±3.62 and a mean of unanswered questions of 0.26±0.75. An average increase between the two assessments 4.38±2.67 relative to the total score was observed. This corresponds to an average increase of 0.89±1.46 standardized points (range 0-10) after performing the rotation in Rheumatology. The completion time was 22.2±8.57 minutes in the first test and 25.67±11.82 in the second. The satisfaction rates after rotation were >90% in all cases. Acceptance of the system was excellent by tutors and residents. Conclusions REUMEVAL is an online system that allows an objective assessment of the increase in knowledge of Rheumatology MIR performing rotary units of this specialty. In this pilot study we test the system acceptance by the MIR and their tutors, as well as a demonstrable increase in knowledge after rotation. Acknowledgements Acknowledgements: Study conducted with the support of the Valencian Society of Rheumatology and partial sponsorship of MSD Disclosure of Interest None declared DOI 10.1136/annrheumdis-2014-eular.2037