To read this content please select one of the options below:

Transformer network-based word embeddings approach for autonomous cyberbullying detection

Subbaraju Pericherla (Computer Science and Engineering, Pondicherry Engineering College, Pondicherry, India)
E. Ilavarasan (Pondicherry Engineering College, Pondicherry, India)

International Journal of Intelligent Unmanned Systems

ISSN: 2049-6427

Article publication date: 28 May 2021




Nowadays people are connected by social media like Facebook, Instagram, Twitter, YouTube and much more. Bullies take advantage of these social networks to share their comments. Cyberbullying is one typical kind of harassment by making aggressive comments, abuses to hurt the netizens. Social media is one of the areas where bullying happens extensively. Hence, it is necessary to develop an efficient and autonomous cyberbullying detection technique.


In this paper, the authors proposed a transformer network-based word embeddings approach for cyberbullying detection. RoBERTa is used to generate word embeddings and Light Gradient Boosting Machine is used as a classifier.


The proposed approach outperforms machine learning algorithms such as logistic regression, support vector machine and deep learning models such as word-level convolutional neural networks (word CNN) and character convolutional neural networks with short cuts (char CNNS) in terms of precision, recall, F1-score.


One of the limitations of traditional word embeddings methods is context-independent. In this work, only text data are utilized to identify cyberbullying. This work can be extended to predict cyberbullying activities in multimedia environment like image, audio and video.



Pericherla, S. and Ilavarasan, E. (2021), "Transformer network-based word embeddings approach for autonomous cyberbullying detection", International Journal of Intelligent Unmanned Systems, Vol. ahead-of-print No. ahead-of-print.



Emerald Publishing Limited

Copyright © 2021, Emerald Publishing Limited

Related articles