Dealing with Deepfakes: Reddit, Online Content Moderation, and Situational Crime Prevention

Abstract

Purpose: The study makes use of situational crime prevention framework for analyzing online community reactions to the banning of deepfake pornographic content from Reddit.

Methodology/approach: Qualitative text analysis of user comments posted to Reddit’s rule-change announcement (N = 582) was carried out. Analysis relied on the original 25 techniques of situational crime prevention that were adapted into a table of activities and mechanisms meant specifically for use with online platforms.

Findings: Analysis indicates that Reddit users voiced several shortcomings that are currently present in Reddit’s platform management approach. In particular, users emphasized issues related to the lack of a consistent and transparent approach to community rule enforcement, as users believed the rule changes to be sudden and poorly reasoned. The general reactionary nature of Reddit’s approach to moderating community-harming actions also was a point of emphasis, alongside the platform’s continued rigid stance on freedom of expression, even with regard to illegal and demeaning content. Regarding Reddit and the new rules on involuntary pornography and the sexualization of minors, enforcement of sitewide policy appears contingent on external influences, such as attention from mainstream media or financial matters, rather than stemming from an inherent stance on decreasing community-harming activities.

Research limitations: The study only pertains to a specific rule change by Reddit and subsequent reactions from the platform’s community. Future research is needed to test the applicability of the adapted table of 25 techniques of situational crime prevention in the context of other online platforms.

Originality/value: First, the study applies the situational crime prevention approach in the context of moderating online platforms. Second, results from the study shed light on current practices in online content moderation from the perspective of criminological theory, as well as inform specific actions that can be taken to decrease the presence of community-harming phenomena and improve the enforcement of sitewide policy rules in general. Finally, by adapting the original 25 techniques of situational crime prevention to online content moderation, the study suggests a tentative roadmap for similar research in the future.

Citation

Kikerpill, K., Siibak, A. and Valli, S. (2021), "Dealing with Deepfakes: Reddit, Online Content Moderation, and Situational Crime Prevention", Wiest, J.B. (Ed.) Theorizing Criminality and Policing in the Digital Media Age (Studies in Media and Communications, Vol. 20), Emerald Publishing Limited, Leeds, pp. 25-45. https://doi.org/10.1108/S2050-206020210000020008