Harnessing BERT for Advanced Email Filtering in CybersecurityShow others and affiliations
2025 (English)In: Proceedings - 2025 8th International Conference on Information and Computer Technologies, ICICT 2025, Institute of Electrical and Electronics Engineers Inc. , 2025, p. 66-71Conference paper, Published paper (Refereed)
Abstract [en]
In the realm of digital communication and cybersecurity, the identification and filtering of ham and spam messages pose significant challenges due to the overwhelming volume of unsolicited and unwanted emails. This paper presents an in-depth analysis of various ML and DL techniques for efficient and robust spam detection systems, critical for enhancing cybersecurity defenses. Seven ML algorithms-RF, LR, SVM, XGBoost, GB, NB, and KNN-along with four deep learning models-CNN, LSTM, BiLSTM, and RNN-are evaluated for their effectiveness in spam classification. Additionally, we fine-tuned the BERT model, achieving a ground breaking accuracy of 99.37%, surpassing the 99.14% accuracy of the Bidirectional and Auto-Regressive Transformers (BART) model reported in recent research. Using a publicly available dataset of labeled ham and spam messages, the models were trained and tested, and their performance was assessed based on accuracy, precision, recall, and F1 score. The results demonstrate the superiority of the BERT model in spam detection, setting a new benchmark for cybersecurity. The success of BERT is attributed to its advanced capability to capture intricate patterns and contextual information, essential for distinguishing legitimate messages from spam, thus bolstering cybersecurity efforts.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2025. p. 66-71
Series
International Conference on Information and Computer Technologies (ICICT), E-ISSN 2769-4542
Keywords [en]
cybersecurit, Spam Detection, Machine Learning, Deep Learning, Transformer Model, Text Classification
National Category
Computer Sciences Computer Systems
Research subject
Cyber Security
Identifiers
URN: urn:nbn:se:ltu:diva-114231DOI: 10.1109/ICICT64582.2025.00017Scopus ID: 2-s2.0-105010758437OAI: oai:DiVA.org:ltu-114231DiVA, id: diva2:1987887
Conference
8th International Conference on Information and Computer Technologies (ICICT 2025), Hawaii-Hilo, USA, March 14-16, 2025
Note
ISBN for host publication: 979-8-3315-0518-9
2025-08-082025-08-082025-10-21Bibliographically approved