Using participatory design to engage physicians in the development of a provider-level performance dashboard and feedback system

Abstract Problem Definition Performance feedback, in which clinicians are given data on select metrics, is widely used in the context of quality improvement. However, there is a lack of practical guidance describing the process of developing performance feedback systems. Initial Approach This study took place at University of California, San Francisco (UCSF) with hospitalist physicians. We used participatory design methodology to develop a performance dashboard and feedback system. Twenty hospitalist physicians participated in a series of six design sessions and two surveys. Each design session and survey systematically addressed key components of the feedback system, including design, metric selection, data delivery, and incentives. We then used the Capability Opportunity Motivation and Behavior (COM-B) model to identify behavior change interventions to facilitate engagement with the dashboard during a pilot implementation. Key Insights, Lessons Learned In regards to performance improvement, physicians preferred collaboration over competition and internal motivation over external incentives. Physicians preferred that the dashboard be used as a tool to aid in clinical practice improvement and not punitively by leadership. Metrics that were clinical or patient-centered were perceived as more meaningful and more likely to motivate behavior change. Next Steps The performance dashboard has been introduced to the entire hospitalist group, and we continue to evaluate implementation by monitoring engagement and physician attitudes. This will be followed by targeted feedback interventions to attempt to improve performance.