SignEEG v1.0: Multimodal Dataset with Electroencephalography and Hand-written Signature for Biometric Systems Show others and affiliations
2024 (English) In: Scientific Data, E-ISSN 2052-4463, Vol. 11, article id 718Article in journal (Refereed) Published
Abstract [en]
Handwritten signatures in biometric authentication leverage unique individual characteristics for identification, offering high specificity through dynamic and static properties. However, this modality faces significant challenges from sophisticated forgery attempts, underscoring the need for enhanced security measures in common applications. To address forgery in signature-based biometric systems, integrating a forgery-resistant modality, namely, noninvasive electroencephalography (EEG), which captures unique brain activity patterns, can significantly enhance system robustness by leveraging multimodality’s strengths. By combining EEG, a physiological modality, with handwritten signatures, a behavioral modality, our approach capitalizes on the strengths of both, significantly fortifying the robustness of biometric systems through this multimodal integration. In addition, EEG’s resistance to replication offers a high-security level, making it a robust addition to user identification and verification. This study presents a new multimodal SignEEG v1.0 dataset based on EEG and hand-drawn signatures from 70 subjects. EEG signals and hand-drawn signatures have been collected with Emotiv Insight and Wacom One sensors, respectively. The multimodal data consists of three paradigms based on mental, & motor imagery, and physical execution: i) thinking of the signature’s image, (ii) drawing the signature mentally, and (iii) drawing a signature physically. Extensive experiments have been conducted to establish a baseline with machine learning classifiers. The results demonstrate that multimodality in biometric systems significantly enhances robustness, achieving high reliability even with limited sample sizes. We release the raw, pre-processed data and easy-to-follow implementation details.
Place, publisher, year, edition, pages Nature Research , 2024. Vol. 11, article id 718
National Category
Computer Sciences Signal Processing
Research subject Operation and Maintenance Engineering; Machine Learning
Identifiers URN: urn:nbn:se:ltu:diva-108479 DOI: 10.1038/s41597-024-03546-z ISI: 001261561300002 PubMedID: 38956046 Scopus ID: 2-s2.0-85197457964 OAI: oai:DiVA.org:ltu-108479 DiVA, id: diva2:1887241
Note Validerad;2024;Nivå 2;2024-08-07 (hanlid);
Full text license: CC BY
2024-08-072024-08-072025-10-21 Bibliographically approved