How Many Truth Levels? Six? One Hundred? Even More? Validating Truthfulness of Statements via Crowdsourcing

  • Kevin Roitero
  • Gianluca Demartini
  • Stefano Mizzaro
  • Damiano Spinai
CIKM Workshop on Rumours and Deception in Social Media (RDSM'18), 2018

We report on collecting truthfulness values (i) by means of crowd-sourcing and (ii) using fine-grained scales. In our experiment we collect truthfulness values using a bounded and discrete scale with 100 levels as well as a magnitude estimation scale, which is unbounded, continuous and has infinite amount of levels. We compare the two scales and discuss the agreement with a groundtruth provided by experts on a six-level scale.

@InProceedings{roitero2018how,
author={Roitero, Kevin and Demartini, Gianluca and Mizzaro, Stefano and Spina, Damiano},
title={How Many Truth Levels? Six? One Hundred? Even more? Validating Truthfulness of Statements via Crowdsourcing},
booktitle={CIKM Workshop on Rumours and Deception in Social Media (RDSM'18)},
year={2018}
}
Damiano Spina
Assign a menu in the Right Menu options.