Estimating the Ability of Crowd Workers: An Exploratory Experiment Using the Japanese-English Translation Work

Crowdsourcing (CS) has its superiority in regards to the quick access to workers throughout the world. On the other hand, when viewed from the prospect of clients who are seeking workers, it is difficult to estimate workers’ performance prior to ordering a task in CS. Crowdsourcing service providers (CSP) produce some indices which may be useful in estimating workers’ performance, however, the correlation between workers’ performance and these indices has not been verified.