https://openreview.net/forum?id=VBATVIBIMos
RelRoll: A Relative Elicitation Mechanism for Scoring Annotation with A Case Study on Speech...
We invesitgate RelRoll, a meachnism allowing non-experts to give reliable rating annotations through relative labels.