A reliability analysis of Mechanical Turk data.

•MTurk workers completed several forms of the same self-report scale.•Generally, score reliability was lower for MTurk workers than the normative sample.•Survey length and payment did not affect reliability.•However, more reliable scores were provided when workers verified attentiveness.