Intelligent spam filtering for massive short message stream

Abstract

Purpose

The purpose of this paper is to provide an intelligent spam filtering method to meet the real‐time processing requirement of the massive short message stream and reduce manual operation of the system.

Design/methodology/approach

An integrated framework based on a series of algorithms is proposed. The framework consists of message filtering module, log analysis module and rules handling module, and dynamically filters the short message spam, while generating the filtering rules. Experiments using Java are used to execute the proposed work.

Findings

The experiments are carried out both on the simulation model (off‐line) and on the actual plant (on‐line). All experiment data are considered in both normal and spam real short messages. The results show that use of the integrated framework leads to a comparable accuracy and meet the real‐time filtration requirement.

Originality/value

The approach in the design of the filtering system is novel. In addition, implementation of the proposed integrated framework allows the method not only to reduce the computational cost which leads to a high processing speed but also to filter spam messages with a high accuracy.

Citation

Xia, H., Fu, Y., Zhou, J. and Xia, Q. (2013), "Intelligent spam filtering for massive short message stream", COMPEL - The international journal for computation and mathematics in electrical and electronic engineering, Vol. 32 No. 2, pp. 586-596. https://doi.org/10.1108/03321641311296963