Multimodal Sentiment Analysis of Social Media Posts Using Deep Neural Networks
Publish place: International Journal of Web Research، Vol: 4، Issue: 1
Publish Year: 1400
نوع سند: مقاله ژورنالی
زبان: English
View: 268
This Paper With 9 Page And PDF Format Ready To Download
- Certificate
- من نویسنده این مقاله هستم
این Paper در بخشهای موضوعی زیر دسته بندی شده است:
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
JR_IJWR-4-1_001
تاریخ نمایه سازی: 11 آبان 1400
Abstract:
With the fast growth of social media, they have become the most important platform for posting multimodal content generated by users. Much of the data on social networks such as Instagram and Telegram is multimodal data. With the aim of analyzing such multimodal data in social networks, multimodal sentiment analysis has become one of the most significant subjects for researchers in the field of emotion recognition and data mining. Although multimodal sentiment analysis of social media data for English language has been addressed in several researches recently, few studies addressed the problem for the Persian language which is the official language of more than ۱۲۰ million of people around the word. In this study, a multimodal deep learning model is proposed to address this problem. The proposed method utilizes a bi-directional long short-term memory (bi-LSTM) for processing text posts and a VGG۱۶ convolutional network for analyzing images. A new dataset of Instagram and Telegram posts, MPerSocial, containing ۱۰۰۰ pairs of images and Persian comments is introduced in the current study and used for evaluating the proposed method. The results of experiments show that using the fusion of textual and image modalities improves sentiment polarity detection accuracy by ۲۰% and ۸% compared with the scenario in which image and text modalities in isolation. Also, the performance of the proposed model is better than three similar deep and four traditional machine learning models. All codes and dataset used in the current study are publicly available at GitHub.
Keywords:
Authors
Aria Naseri Karimvand
Department of Computer Eng., Shahrekord University, Shahrekord, Iran
Shahla Nemati
Department of Computer Engineering, Faculty of Engineering Shahrekord University Shahrekord, Iran
Reza Salehi Ghegeni
Department of Computer Eng., Shahrekord University, Shahrekord, Iran
Mohammad Ehsan Basiri
Computer Engineering Dept., Shahrekord University, Shahrekord, Iran