"I know what the companies are wanting more of": Professional Participants in Online Usability Studies

Researchers who use remote unmoderated usability testing services often rely on panels of on-demand participants. In this exploratory study, we wanted to better understand the effects of participants completing many usability studies over time, particularly how this experience may shape the content and quality of user feedback. We present a user study with 15 diverse "professional participants" and discuss some of the panel conditioning effects described by participants.