Search results
1 – 10 of 65Manju Priya Arthanarisamy Ramaswamy and Suja Palaniswamy
The aim of this study is to investigate subject independent emotion recognition capabilities of EEG and peripheral physiological signals namely: electroocoulogram (EOG)…
Abstract
Purpose
The aim of this study is to investigate subject independent emotion recognition capabilities of EEG and peripheral physiological signals namely: electroocoulogram (EOG), electromyography (EMG), electrodermal activity (EDA), temperature, plethysmograph and respiration. The experiments are conducted on both modalities independently and in combination. This study arranges the physiological signals in order based on the prediction accuracy obtained on test data using time and frequency domain features.
Design/methodology/approach
DEAP dataset is used in this experiment. Time and frequency domain features of EEG and physiological signals are extracted, followed by correlation-based feature selection. Classifiers namely – Naïve Bayes, logistic regression, linear discriminant analysis, quadratic discriminant analysis, logit boost and stacking are trained on the selected features. Based on the performance of the classifiers on the test set, the best modality for each dimension of emotion is identified.
Findings
The experimental results with EEG as one modality and all physiological signals as another modality indicate that EEG signals are better at arousal prediction compared to physiological signals by 7.18%, while physiological signals are better at valence prediction compared to EEG signals by 3.51%. The valence prediction accuracy of EOG is superior to zygomaticus electromyography (zEMG) and EDA by 1.75% at the cost of higher number of electrodes. This paper concludes that valence can be measured from the eyes (EOG) while arousal can be measured from the changes in blood volume (plethysmograph). The sorted order of physiological signals based on arousal prediction accuracy is plethysmograph, EOG (hEOG + vEOG), vEOG, hEOG, zEMG, tEMG, temperature, EMG (tEMG + zEMG), respiration, EDA, while based on valence prediction accuracy the sorted order is EOG (hEOG + vEOG), EDA, zEMG, hEOG, respiration, tEMG, vEOG, EMG (tEMG + zEMG), temperature and plethysmograph.
Originality/value
Many of the emotion recognition studies in literature are subject dependent and the limited subject independent emotion recognition studies in the literature report an average of leave one subject out (LOSO) validation result as accuracy. The work reported in this paper sets the baseline for subject independent emotion recognition using DEAP dataset by clearly specifying the subjects used in training and test set. In addition, this work specifies the cut-off score used to classify the scale as low or high in arousal and valence dimensions. Generally, statistical features are used for emotion recognition using physiological signals as a modality, whereas in this work, time and frequency domain features of physiological signals and EEG are used. This paper concludes that valence can be identified from EOG while arousal can be predicted from plethysmograph.
Details
Keywords
Abhinandan Chatterjee, Pradip Bala, Shruti Gedam, Sanchita Paul and Nishant Goyal
Depression is a mental health problem characterized by a persistent sense of sadness and loss of interest. EEG signals are regarded as the most appropriate instruments for…
Abstract
Purpose
Depression is a mental health problem characterized by a persistent sense of sadness and loss of interest. EEG signals are regarded as the most appropriate instruments for diagnosing depression because they reflect the operating status of the human brain. The purpose of this study is the early detection of depression among people using EEG signals.
Design/methodology/approach
(i) Artifacts are removed by filtering and linear and non-linear features are extracted; (ii) feature scaling is done using a standard scalar while principal component analysis (PCA) is used for feature reduction; (iii) the linear, non-linear and combination of both (only for those whose accuracy is highest) are taken for further analysis where some ML and DL classifiers are applied for the classification of depression; and (iv) in this study, total 15 distinct ML and DL methods, including KNN, SVM, bagging SVM, RF, GB, Extreme Gradient Boosting, MNB, Adaboost, Bagging RF, BootAgg, Gaussian NB, RNN, 1DCNN, RBFNN and LSTM, that have been effectively utilized as classifiers to handle a variety of real-world issues.
Findings
1. Among all, alpha, alpha asymmetry, gamma and gamma asymmetry give the best results in linear features, while RWE, DFA, CD and AE give the best results in non-linear feature. 2. In the linear features, gamma and alpha asymmetry have given 99.98% accuracy for Bagging RF, while gamma asymmetry has given 99.98% accuracy for BootAgg. 3. For non-linear features, it has been shown 99.84% of accuracy for RWE and DFA in RF, 99.97% accuracy for DFA in XGBoost and 99.94% accuracy for RWE in BootAgg. 4. By using DL, in linear features, gamma asymmetry has given more than 96% accuracy in RNN and 91% accuracy in LSTM and for non-linear features, 89% accuracy has been achieved for CD and AE in LSTM. 5. By combining linear and non-linear features, the highest accuracy was achieved in Bagging RF (98.50%) gamma asymmetry + RWE. In DL, Alpha + RWE, Gamma asymmetry + CD and gamma asymmetry + RWE have achieved 98% accuracy in LSTM.
Originality/value
A novel dataset was collected from the Central Institute of Psychiatry (CIP), Ranchi which was recorded using a 128-channels whereas major previous studies used fewer channels; the details of the study participants are summarized and a model is developed for statistical analysis using N-way ANOVA; artifacts are removed by high and low pass filtering of epoch data followed by re-referencing and independent component analysis for noise removal; linear features, namely, band power and interhemispheric asymmetry and non-linear features, namely, relative wavelet energy, wavelet entropy, Approximate entropy, sample entropy, detrended fluctuation analysis and correlation dimension are extracted; this model utilizes Epoch (213,072) for 5 s EEG data, which allows the model to train for longer, thereby increasing the efficiency of classifiers. Features scaling is done using a standard scalar rather than normalization because it helps increase the accuracy of the models (especially for deep learning algorithms) while PCA is used for feature reduction; the linear, non-linear and combination of both features are taken for extensive analysis in conjunction with ML and DL classifiers for the classification of depression. The combination of linear and non-linear features (only for those whose accuracy is highest) is used for the best detection results.
Shruti Garg, Rahul Kumar Patro, Soumyajit Behera, Neha Prerna Tigga and Ranjita Pandey
The purpose of this study is to propose an alternative efficient 3D emotion recognition model for variable-length electroencephalogram (EEG) data.
Abstract
Purpose
The purpose of this study is to propose an alternative efficient 3D emotion recognition model for variable-length electroencephalogram (EEG) data.
Design/methodology/approach
Classical AMIGOS data set which comprises of multimodal records of varying lengths on mood, personality and other physiological aspects on emotional response is used for empirical assessment of the proposed overlapping sliding window (OSW) modelling framework. Two features are extracted using Fourier and Wavelet transforms: normalised band power (NBP) and normalised wavelet energy (NWE), respectively. The arousal, valence and dominance (AVD) emotions are predicted using one-dimension (1D) and two-dimensional (2D) convolution neural network (CNN) for both single and combined features.
Findings
The two-dimensional convolution neural network (2D CNN) outcomes on EEG signals of AMIGOS data set are observed to yield the highest accuracy, that is 96.63%, 95.87% and 96.30% for AVD, respectively, which is evidenced to be at least 6% higher as compared to the other available competitive approaches.
Originality/value
The present work is focussed on the less explored, complex AMIGOS (2018) data set which is imbalanced and of variable length. EEG emotion recognition-based work is widely available on simpler data sets. The following are the challenges of the AMIGOS data set addressed in the present work: handling of tensor form data; proposing an efficient method for generating sufficient equal-length samples corresponding to imbalanced and variable-length data.; selecting a suitable machine learning/deep learning model; improving the accuracy of the applied model.
Details
Keywords
Jiwon Chung, Hyunbin Won, Hannah Lee, Soah Park, Hyewon Ahn, Suhyun Pyeon, Jeong Eun Yoon and Sumin Koo
The objective of this study was to develop wearable suit platforms with various anchoring structure designs with the intention of improving wearability and enhancing user…
Abstract
Purpose
The objective of this study was to develop wearable suit platforms with various anchoring structure designs with the intention of improving wearability and enhancing user satisfaction.
Design/methodology/approach
This study selected fabrics and materials for the suit platform through material performance tests. Two anchoring structure designs, 11-type and X-type are compared with regular clothing under control conditions. To evaluate the comfort level of the wearable suit platform, a satisfaction survey and electroencephalogram (EEG) measurements are conducted to triangulate the findings.
Findings
The 11-type exhibited higher values in comfort indicators such as α, θ, α/High-β and lower values in concentration or stress indicators such as β, ϒ, sensorimotor rhythm (SMR)+Mid-β/θ, and a spectral edge frequency of 95% compared to the X-type while walking. The 11-type offers greater comfort and satisfaction compared to the X-type when lifting based on the EEG measurements and the participants survey.
Originality/value
It is recommended to implement the 11-type when designing wearable suit platforms. These findings offer essential data on wearability, which can guide the development of soft wearable robots.
Details
Keywords
Jinwei Zhao, Shuolei Feng, Xiaodong Cao and Haopei Zheng
This paper aims to concentrate on recent innovations in flexible wearable sensor technology tailored for monitoring vital signals within the contexts of wearable sensors and…
Abstract
Purpose
This paper aims to concentrate on recent innovations in flexible wearable sensor technology tailored for monitoring vital signals within the contexts of wearable sensors and systems developed specifically for monitoring health and fitness metrics.
Design/methodology/approach
In recent decades, wearable sensors for monitoring vital signals in sports and health have advanced greatly. Vital signals include electrocardiogram, electroencephalogram, electromyography, inertial data, body motions, cardiac rate and bodily fluids like blood and sweating, making them a good choice for sensing devices.
Findings
This report reviewed reputable journal articles on wearable sensors for vital signal monitoring, focusing on multimode and integrated multi-dimensional capabilities like structure, accuracy and nature of the devices, which may offer a more versatile and comprehensive solution.
Originality/value
The paper provides essential information on the present obstacles and challenges in this domain and provide a glimpse into the future directions of wearable sensors for the detection of these crucial signals. Importantly, it is evident that the integration of modern fabricating techniques, stretchable electronic devices, the Internet of Things and the application of artificial intelligence algorithms has significantly improved the capacity to efficiently monitor and leverage these signals for human health monitoring, including disease prediction.
Jia Jin, Yi He, Chenchen Lin and Liuting Diao
Social recommendation has been recognized as a kind of e-commerce with large potential, but how social recommendations influence consumer decisions is still unclear. This paper…
Abstract
Purpose
Social recommendation has been recognized as a kind of e-commerce with large potential, but how social recommendations influence consumer decisions is still unclear. This paper aims to investigate how recommendations from different social ties influence consumers’ purchase intentions through both behavior and brain activity.
Design/methodology/approach
Utilizing behavioral (N = 70) and electroencephalogram (EEG) (N = 49) experiments, this study explored participants’ behavior and brain responses after being recommended by different social ties. The data were analyzed using statistical inference and event-related potential (ERP) analysis.
Findings
Behavioral results show that social tie strength positively impacts purchase intention, which can be fitted by a logarithmic model. Moreover, recommender-to-customer similarity and product affect mediate the effect of tie strength on purchase intention serially. EEG findings show that recommendations from weak tie strength elicit larger N100, N200 and P300 amplitudes than those from strong tie strength. These results imply that weak tie strength may motivate individuals to recruit more mental resources in social recommendation, including unconscious processing of consumer attention and conscious processing of cognitive conflict and negative emotion.
Originality/value
This study considers the effects of continuous social ties on purchase intention and models them mathematically, exploring the intrinsic mechanisms by which strong and weak ties influence purchase intentions through recommender-to-customer similarity and product affect, contributing to the applications of the stimulus-organism-response (SOR) model in the field of social recommendation. Furthermore, our study adopting EEG techniques bridges the gap of relying solely on self-report by providing an avenue to obtain relatively objective findings about the consumers’ early-occurred (unconscious) attentional responses and late-occurred (conscious) cognitive and emotional responses in purchase decisions.
Details
Keywords
Tülay Karakas, Burcu Nimet Dumlu, Mehmet Ali Sarıkaya, Dilek Yildiz Ozkan, Yüksel Demir and Gökhan İnce
The present study investigates human behavioral and emotional experiences based on human-built environment interaction with a specific interest in urban graffiti displaying fear…
Abstract
Purpose
The present study investigates human behavioral and emotional experiences based on human-built environment interaction with a specific interest in urban graffiti displaying fear and pleasure-inducing facial expressions. Regarding human behavioral and emotional experience, two questions are asked for the outcome of human responses and two hypotheses are formulated. H1 is based on the behavioral experience and posits that the urban graffiti displaying fear and pleasure-inducing facial expressions elicit specified behavioral fear and pleasure responses. H2 is based on emotional experience and states that the urban graffiti displaying fear and pleasure-inducing facial expressions elicit specified emotional fear and pleasure responses.
Design/methodology/approach
The research design is developed as a multi-method approach, applying a lab-based experimental strategy (N:39). The research equipment includes a mobile electroencephalogram (EEG) and a Virtual Reality (VR) headset. The behavioral and emotional human responses concerning the representational features of urban graffiti are assessed objectively by measuring physiological variables, EEG signals and subjectively by behavioral variables, systematic behavioral observation and self-report variables, Self-assessment Manikin (SAM) questionnaire. Additionally, correlational analyses between behavioral and emotional results are performed.
Findings
The findings of behavioral and emotional evaluations and correlational results show that specialized fear and pleasure response patterns occur due to the affective characteristics of the urban graffiti's representational features, supporting our hypotheses. As a result, the characteristics of behavioral fear and pleasure response and emotional fear and pleasure response are identified.
Originality/value
The present paper contributes to the literature on human-built environment interactions by using physiological, behavioral and self-report measurements as indicators of human behavioral and emotional experiences. Additionally, the literature on urban graffiti is expanded by studying the representational features of urban graffiti as a parameter of investigating human experience in the built environment.
Details
Keywords
Priya Mishra and Aleena Swetapadma
Sleep arousal detection is an important factor to monitor the sleep disorder.
Abstract
Purpose
Sleep arousal detection is an important factor to monitor the sleep disorder.
Design/methodology/approach
Thus, a unique nth layer one-dimensional (1D) convolutional neural network-based U-Net model for automatic sleep arousal identification has been proposed.
Findings
The proposed method has achieved area under the precision–recall curve performance score of 0.498 and area under the receiver operating characteristics performance score of 0.946.
Originality/value
No other researchers have suggested U-Net-based detection of sleep arousal.
Research limitations/implications
From the experimental results, it has been found that U-Net performs better accuracy as compared to the state-of-the-art methods.
Practical implications
Sleep arousal detection is an important factor to monitor the sleep disorder. Objective of the work is to detect the sleep arousal using different physiological channels of human body.
Social implications
It will help in improving mental health by monitoring a person's sleep.
Details
Keywords
Xiaoxia Zhang, Jin Zhang, Peiyan Du and Guohe Wang
In this paper, the brain potential changes caused by touching fabrics for handle evaluation were recorded by event related potential (ERP) method, compared with subjective…
Abstract
Purpose
In this paper, the brain potential changes caused by touching fabrics for handle evaluation were recorded by event related potential (ERP) method, compared with subjective evaluation scores and physical index of KES, explore the cognitive mechanism of the transformation of tactile sensation into neural impulses triggered by subtle mechanical stimuli such as material, texture, density and morphology in fabrics. By combining subjective evaluation of fabric tactile sensation, objective physical properties of fabrics and objective neurobiological signals, explore the neurophysiological mechanism of tactile cognition and the signal characteristics and time process of tactile information processing.
Design/methodology/approach
The ERP technology was first proposed by a British psychologist named Grey Walter. It is an imaging technique of noninvasive brain cognition, whose potential changes are related to the human physical and mental activities. ERP is different from electroencephalography (EEG) and evoked potentials (EP) on the fact that it cannot only record stimulated physical information which is transmitted to brain, but also response to the psychological activities which related to attention, identification, comparison, memory, judgment and cognition as well as to human’s neural physiological changes which are caused by cognitive process of the feeling by stimulation.
Findings
According to potential changes in the cerebral cortex evoked by touching four types of silk fabrics, human brain received the physical stimulation in the early stage (50 ms) of fabrics handle evaluation, and the P50 component amplitude showed negative correlation with fabric smoothness sensations. Around 200 ms after tactile stimulus onset, the amplitude of P200 component show positive correlation with the softness sensation of silk fabrics. The relationship between the amplitude of P300 and the sense of smoothness and softness need further evidence to proof.
Originality/value
In this paper, the brain potential changes caused by touching fabrics for handle evaluation were recorded by event related potential (ERP) method, compared with subjective evaluation scores and physical index of KES, the results shown that the maximum amplitude of P50 component evoked by fabric touching is related to the fabrics’ smoothness and roughness emotion, which means in the early stage processing of tactile sensation, the rougher fabrics could arouse more attention. In addition, the amplitude of P200 component shows positive correlation with the softness sensation of silk fabrics.
Details
Keywords
Luigi Piper, Lucrezia Maria de Cosmo, M. Irene Prete, Antonio Mileti and Gianluigi Guido
This paper delves into evaluating the effectiveness of warning messages as a deterrent against excessive fat consumption. It examines how consumers perceive the fat content of…
Abstract
Purpose
This paper delves into evaluating the effectiveness of warning messages as a deterrent against excessive fat consumption. It examines how consumers perceive the fat content of food products when presented with two distinct label types: (1) a textual warning, providing succinct information about the fat content, and (2) a pictorial warning, offering a visual representation that immediately signifies the fat content.
Design/methodology/approach
Two quantitative studies were carried out. Study 1 employed a questionnaire to evaluate the efficacy of textual and pictorial warning messages on high- and low-fat food products. Similarly, Study 2 replicated this comparison while incorporating a neuromarketing instrument to gauge participants’ cerebral reactions.
Findings
Results indicate that pictorial warnings on high-fat foods significantly deter consumers’ purchasing intentions. Notably, these pictorial warnings stimulate the left prefrontal area of the cerebral cortex, inducing negative emotions in consumers and driving them away from high-fat food items.
Originality/value
While the influence of images over text in shaping consumer decisions is well understood in marketing, this study accentuates the underlying mechanism of such an impact through the elicitation of negative emotions. By understanding this emotional pathway, the paper presents fresh academic and managerial perspectives, underscoring the potency of pictorial warnings in guiding consumers towards healthier food choices.
Highlights
Textual warnings do not seem to discourage high-fat product consumption.
A pictorial warning represents the fat content of an equivalent product.
Pictorial warnings decrease the intention to purchase a high-fat product.
Pictorial warnings determine an increase in negative emotions.
Textual warnings do not seem to discourage high-fat product consumption.
A pictorial warning represents the fat content of an equivalent product.
Pictorial warnings decrease the intention to purchase a high-fat product.
Pictorial warnings determine an increase in negative emotions.
Details