Improving the Performance of Text Sentiment Analysis using Deep Convolutional Neural Network Integrated with Hierarchical Attention Layer
Publish place: International Journal of Information and Communication Technology Research (IJICT، Vol: 11، Issue: 3
Publish Year: 1398
نوع سند: مقاله ژورنالی
زبان: English
View: 361
This Paper With 11 Page And PDF Format Ready To Download
- Certificate
- من نویسنده این مقاله هستم
این Paper در بخشهای موضوعی زیر دسته بندی شده است:
- هوش مصنوعی > شبکه عصبی
- هوش مصنوعی > یادگیری عمیق
- هوش مصنوعی > پردازش زبان طبیعی
- هوش مصنوعی > تحلیل احساس
استخراج به نرم افزارهای پژوهشی:
شناسه ملی سند علمی:
JR_ITRC-11-3_007
تاریخ نمایه سازی: 23 بهمن 1399
Abstract:
Sentiment analysis is considered as one of the most essential tasks in the field of natural language processing and cognitive science. In order to enhance the performance of sentiment analysis techniques, it is necessary to not only classify the sentences based on their sentimental labels but also to extract the informative words that contribute to the classification decision. In this regard, deep neural networks based on the attention mechanism have achieved considerable progress in recent years. However, there is still a limited number of studies on attention mechanisms for text classification and especially sentiment analysis. To fill this lacuna, a Convolution Neural Network (CNN) integrated with attention layer is presented in this paper that is able to extract informative words and assign them higher weights based on the context. In the attention layer, the proposed model employs a context vector and tries to measure the importance of a word as the similarity between the context vector and word vector. Then, by integrating the new vectors obtained from the attention layer into sentence vectors, the new generated vectors are used for classification. In order to verify the performance of the proposed model, various experiments were conducted on the Stanford datasets. Based on the results of the experiments, the proposed model not only significantly outperforms other existing studies but also is able to consider the context to extract the informative words which can be considered as a value in analysis and application.
Keywords:
Authors
Hossein Sadr
Department of Computer Engineering, Rasht Branch, Islamic Azad University, Rasht, Iran
Mir Mohsen Pedram
Department of Electrical and Computer Engineering, Faculty of Engineering, Kharazmi University ,Tehran, Iran
Mohammad Teshnelab
Industrial Control Center of Excellence, Faculty of Electrical and Computer Engineering, K. N. Toosi University, Tehran, Iran