We’re finalists (top 20 of 1,000+) at the Knights Challenge 2015 with Daemo. Daemo is a crowdsourcing platform built by a worldwide crowd of workers, requesters, and researchers. Daemo introduces Boomerang, a reputation system that incentivizes alignment between opinion and ratings by increasing the likelihood that the rater will work in the future with any users they rate highly. Daemo also introduces prototype tasks, which require that all new tasks go through a prototype feedback iteration phase with a small number of workers so that requesters can revise their instructions and task design before launch. Our early field experiments suggest that Boomerang results in stronger correlation between ratings and ground-truth opinions, and that use of prototype tasks improves final task quality and results.
Read more here:
