Person: AKBULUT, FATMA PATLAR
Loading...
Email Address
Birth Date
Research Projects
Organizational Units
Job Title
Dr. Öğr. Üyesi
Last Name
AKBULUT
First Name
FATMA PATLAR
Name
3 results
Search Results
Now showing 1 - 3 of 3
Publication Restricted Hybrid Deep Convolutional Model-Based Emotion Recognition Using Multiple Physiological Signals(Taylor & Francis Ltd., 2022) AKBULUT, FATMA PATLAREmotion recognition has become increasingly utilized in the medical, advertising, and military domains. Recognizing the cues of emotion from human behaviors or physiological responses is encouraging for the research community. However, extracting true characteristics from sensor data to understand emotions can be challenging due to the complex nature of these signals. Therefore, advanced feature engineering techniques are required for accurate signal recognition. This study presents a hybrid affective model that employs a transfer learning approach for emotion classification using large-frame sensor signals which employ a genuine dataset of signal fusion gathered from 30 participants using wearable sensor systems interconnected with mobile devices. The proposed approach implements several learning algorithms such as Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), Recurrent Neural Network (RNN), and several other shallow methods on the sensor input to handle the requirements for the traditional feature extraction process. The findings reveal that the use of deep learning methods is satisfactory in affect recognition when a great number of frames is employed, and the proposed hybrid deep model outperforms traditional neural network (overall accuracy of 54%) and deep learning approaches (overall accuracy of 76%), with an average classification accuracy of 93%. This hybrid deep model also has a higher accuracy than our previously proposed statistical autoregressive hidden Markov model (AR-HMM) approach, with 88.6% accuracy. Accuracy assessment was performed by means of several statistics measures (accuracy, precision, recall, F-measure, and RMSE).Publication Open Access Analysis of Facial Emotion Expression in Eating Occasions Using Deep Learning(Springer, 2023) ELİF, YILDIRIM; AKBULUT, FATMA PATLAR; Çatal, ÇağatayEating is experienced as an emotional social activity in any culture. There are factors that influence the emotions felt during food consumption. The emotion felt while eating has a significant impact on our lives and affects different health conditions such as obesity. In addition, investigating the emotion during food consumption is considered a multidisciplinary problem ranging from neuroscience to anatomy. In this study, we focus on evaluating the emotional experience of different participants during eating activities and aim to analyze them automatically using deep learning models. We propose a facial expression-based prediction model to eliminate user bias in questionnaire-based assessment systems and to minimize false entries to the system. We measured the neural, behavioral, and physical manifestations of emotions with a mobile app and recognize emotional experiences from facial expressions. In this research, we used three different situations to test whether there could be any factor other than the food that could affect a person’s mood. We asked users to watch videos, listen to music or do nothing while eating. This way we found out that not only food but also external factors play a role in emotional change. We employed three Convolutional Neural Network (CNN) architectures, fine-tuned VGG16, and Deepface to recognize emotional responses during eating. The experimental results demonstrated that the fine-tuned VGG16 provides remarkable results with an overall accuracy of 77.68% for recognizing the four emotions. This system is an alternative to today’s survey-based restaurant and food evaluation systems.Publication Restricted Wearable Sensor-Based Evaluation of Psychosocial Stress in Patients With Metabolic Syndrome(Elsevier, 2020) AKBULUT, FATMA PATLAR; İkitimur, Barış; Akan, AydınThe prevalence of metabolic disorders has increased rapidly as such they become a major health issue recently. Despite the definition of genetic associations with obesity and cardiovascular diseases, they constitute only a small part of the incidence of disease. Environmental and physiological effects such as stress, behavioral and metabolic disturbances, infections, and nutritional deficiencies have now revealed as contributing factors to develop metabolic diseases. This study presents a multivariate methodology for the modeling of stress on metabolic syndrome (MES) patients. We have developed a supporting system to cope with MES patients' anxiety and stress by means of several biosignals such as ECG, GSR, body temperature, SpO(2), glucose level, and blood pressure that are measured by a wearable device. We employed a neural network model to classify emotions with HRV analysis in the detection of stressor moments. We have accurately recognized the stressful situations using physiological responses to stimuli by utilizing our proposed affective state detection algorithm. We evaluated our system with a dataset of 312 biosignal records from 30 participants and the results showed that our proposed method achieved an average accuracy of 92% and 89% in distinguishing stress level in MES and other groups respectively. Both being the focus of an MES group and others proved to be highly arousing experiences which were significantly reflected in the physiological signal. Exposure to the stress in MES and cardiovascular heart disease patients increases the chronic symptoms. An early stage of comprehensive intervention may reduce the risk of general cardiovascular events in these particular groups. In this context, the use of e-health applications such as our proposed system facilitates these processes.