Adaptive Rider Feedback Artificial Tree Optimization-Based Deep Neuro-Fuzzy Network for Classification of Sentiment Grade
DOI:
https://doi.org/10.26636/jtit.2023.165222Keywords:
deep learning network, feedback artificial tree, natural language processing (NLP), rider optimization algorithm, sentiment grade classificationAbstract
Sentiment analysis is an efficient technique for expressing users’ opinions (neutral, negative or positive) regarding specific services or products. One of the important benefits of analyzing sentiment is in appraising the comments that users provide or service providers or services. In this work, a solution known as adaptive rider feedback artificial tree optimization-based deep neuro-fuzzy network (RFATO-based DNFN) is implemented for efficient sentiment grade classification. Here, the input is pre-processed by employing the process of stemming and stop word removal. Then, important factors, e.g. SentiWordNet-based features, such as the mean value, variance, as well as kurtosis, spam word-based features, term frequency-inverse document frequency (TF-IDF) features and emoticon-based features, are extracted. In addition, angular similarity and the decision tree model are employed for grouping the reviewed data into specific sets. Next, the deep neuro-fuzzy network (DNFN) classifier is used to classify the sentiment grade. The proposed adaptive rider feedback artificial tree optimization (A-RFATO) approach is utilized for the training of DNFN. The A-RFATO technique is a combination of the feedback artificial tree (FAT) approach and the rider optimization algorithm (ROA) with an adaptive concept. The effectiveness of the proposed A-RFATO-based DNFN model is evaluated based on such metrics as sensitivity, accuracy, specificity, and precision. The sentiment grade classification method developed achieves better sensitivity, accuracy, specificity, and precision rates when compared with existing approaches based on Large Movie Review Dataset, Datafiniti Product Database, and Amazon reviews.
Downloads
References
[1] B. Liu, Sentiment Analysis and Opinion Mining. Cham: Springer, Synthesis Lectures on Human Language Technologies, 2012 (ISBN: 9783031010170).
View in Google Scholar
[2] F. Chen, Z. Yuan, and Y. Huang, “Multi-source data fusion for aspect-level sentiment classification”, Knowledge-Based Systems, vol. 187, Article no. 104831, 2020.
View in Google Scholar
[3] Y. Wang, M. Huang, Z. Zhu, and L. Zhao, “Attention-based LSTM for aspect-level sentiment classification”, in Proc. of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, pp. 606–615.
View in Google Scholar
[4] C. Chen, R. Zhuo, and J. Ren, “Gated recurrent neural network with sentimental relations for sentiment classification”, Information Sciences, vol. 502, pp. 268–278, 2019.
View in Google Scholar
[5] X. Li and W. Lam, “Deep multi-task learning for aspect term extraction with memory interaction”, in Proc. of the 2017 Conference on Empirical Methods in Natural Language Processing, 2017, pp. 2886–2892.
View in Google Scholar
[6] E. Cambria, S. Poria, A. Gelbukh, and M. Thelwall, “Sentiment analysis is a big suitcase”, IEEE Intelligent Systems, vol. 32, no. 6, pp. 74–80, 2017.
View in Google Scholar
[7] L. Yue, W. Chen, X. Li, W. Zuo, and M. Yin, “A survey of sentiment analysis in social media”, Knowledge and Information Systems, vol. 60, no. 2, pp. 617–663, 2019.
View in Google Scholar
[8] M. U. Salur and I. Aydin, “A novel hybrid deep learning model for sentiment classification”, IEEE Access, vol. 8, pp. 58080–58093, 2020.
View in Google Scholar
[9] Z. Wang and Z. Lin, “Optimal feature selection for learning-based algorithms for sentiment classification”, Cognitive Computation, vol. 12, no. 1, pp. 238–248, 2020.
View in Google Scholar
[10] C. Zhang, Q. Li, and D. Song, “Aspect-based sentiment classification with aspect-specific graph convolutional networks”, in Proc. of the 2019 Conf. on Empirical Methods in Natural Language Processing and the 9th International Joint Conf. on Natural Language Processing (EMNLP-IJCNLP), 2019, pp. 4568–4578.
View in Google Scholar
[11] A. Abdi, S. M. Shamsuddin, S. Hasan, and J. Piran, “Deep learning-based sentiment classification of evaluative text based on multifeature fusion”, Information Processing & Management, vol. 56, no. 4, pp. 1245–1259, 2019.
View in Google Scholar
[12] Y. Zhang, Z. Zhang, D. Miao, and J. Wang, “Three-way enhanced convolutional neural networks for sentence-level sentiment classification”, Information Sciences, vol. 477, pp. 55–64, 2019.
View in Google Scholar
[13] J. Serrano-Guerrero, J. A. Olivas, F. P. Romero, and E. Herrera-Viedma, “Sentiment analysis: A review and comparative analysis of web services”, Information Sciences, vol. 311, pp. 18–38, 2015.
View in Google Scholar
[14] S. Zhang, X. Xu, Y. Pang, and J. Han, “Multi-layer attention-based CNN for target-dependent sentiment classification”, Neural Processing Letters, vol. 51, no. 3, pp. 2089–2103, 2020.
View in Google Scholar
[15] C. Zhao, S. Wang, and D. Li, “Multi-source domain adaptation with joint learning for cross-domain sentiment classification”, Knowledge-Based Systems, vol. 191, Article no. 105254, 2020.
View in Google Scholar
[16] H. Chen, M. Sun, C. Tu, Y. Lin, and Z. Liu, “Neural sentiment classification with user and product attention”, in Proc. of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016, pp. 1650–1659.
View in Google Scholar
[17] M. Gangappa, K. C. Mai, and P. Sammulal, “Enhanced crow search optimization algorithm and hybrid NN-CNN classifiers for classification of land cover images”, Multimedia Research, vol. 2, no. 3, pp. 12–22, 2019.
View in Google Scholar
[18] S. Vasamsetti and C. Santhirani, “Hybrid particle swarm optimization-deep neural network model for speaker recognition”, Multimedia Research, vol. 3, no. 1, pp. 1–10, 2020.
View in Google Scholar
[19] G. Parente et al., “Anastomotic stricture definition after esophageal atresia repair: role of endoscopic stricture index”, Journal of Surgical Research, vol. 257, pp. 572–578, 2021.
View in Google Scholar
[20] G. Parente et al., “Pyelonephritis in pediatric uropathic patients: Differences from community-acquired ones and therapeutic protocol considerations. A 10-year single-center retrospective study”, Children, vol. 8, no. 6, 2021.
View in Google Scholar
[21] R. K. Bakshi, N. Kaur, R. Kaur, and G. Kaur, “Opinion mining and sentiment analysis”, in Proc. of 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), 2016, pp. 452–455.
View in Google Scholar
[22] D. Ma, S. Li, X. Zhang, and H. Wang, “Interactive attention networks for aspect-level sentiment classification”, in Proc. of the 26th International Joint Conference on Artificial Intelligence (IJCAI-17), pp. 4068–4074, 2017 [Online]. Available: https://www.ijcai.org/proceedings/2017/0568.pdf.
View in Google Scholar
[23] R. John Martin, “EEG feature engineering methods – A comprehensive review”, Multimedia Research, vol. 5, no. 2, 2022 [Online]. Available: https://publisher.resbee.org/mr/archive/v5i2/a5.html.
View in Google Scholar
[24] S. A. J. Al Raisi, “A review on congestion management methodologies and its applications”, Journal of Computational Mechanics, Power System and Control, vol. 3, no. 3, 2020.
View in Google Scholar
[25] M. Adil, R. Madani, S. Tavakkol, and A. Davoudi, “A first-order numerical algorithm without matrix operations”, arXiv preprint arXiv:2203.05027, 2022 [Online]. Available: https://arxiv.org/pdf/2203.05027.
View in Google Scholar
[26] L. Dong et al., “Adaptive recursive neural network for target-dependent Twitter sentiment classification”, in Proc. of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014, vol. 2, pp. 49–54.
View in Google Scholar
[27] K. S. Tai, R. Socher, and C. D. Manning, “Improved semantic representations from tree-structured long short-term memory networks”, in Proc. of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conf. on Natural Language Processing, 2015, vol. 1, pp. 1556–1566.
View in Google Scholar
[28] H. Kim and Y. S. Jeong, “Sentiment classification using convolutional neural networks”, Applied Sciences, vol. 9, no. 11, Article no. 2347, 2019.
View in Google Scholar
[29] X. Fu et al., “Semi-supervised aspect-level sentiment classification model based on variational autoencoder”, Knowledge-Based Systems, vol. 171, pp. 81–92, 2019.
View in Google Scholar
[30] P. Zhao, L. Hou, and O. Wu, “Modeling sentiment dependencies with graph convolutional networks for aspect-level sentiment classification”, Knowledge-Based Systems, vol. 193, Article no. 105443, 2020.
View in Google Scholar
[31] K. Zhang et al., “SC-BiCapsNet: a sentiment classification model based on bi-channel capsule network”, IEEE Access, vol. 7, pp. 171801–171813, 2019.
View in Google Scholar
[32] N. Jin, J. Wu, X. Ma, K. Yan, and Y. Mo, “Multi-task learning model based on multi-scale CNN and LSTM for sentiment classification”, IEEE Access, vol. 8, pp. 77060–77072, 2020.
View in Google Scholar
[33] B. Ohana and B. Tierney, “Sentiment classification of reviews using SentiWordNet”, in Proc. 9th IT&T Conference, 2009.
View in Google Scholar
[34] N. M. K. Saeed, N. A. Helal, N. L. Badr, and T. F. Gharib, “The impact of spam reviews on feature-based sentiment analysis”, in Proc. of 13th International Conference on Computer Engineering and Systems (ICCES), 2018.
View in Google Scholar
[35] S. Javaid et al., “Towards buildings energy management: using seasonal schedules under time of use pricing tariff via deep neuro-fuzzy optimizer”, in Proc. of 15th International Wireless Communications & Mobile Computing Conference (IWCMC), 2019, pp. 1594–1599.
View in Google Scholar
[36] Large movie review dataset [Online]. Available: http://ai.stanford.edu/~amaas/data/sentiment (accessed: Dec. 2020).
View in Google Scholar
[37] Consumer Reviews of Amazon Products dataset [Online]. Available: https://www.kaggle.com/datafiniti/consumer-reviews-of-amazon-products (accessed: Dec. 2020).
View in Google Scholar
[38] Amazon Reviews for Sentiment Analysis dataset, 2022 [Online]. Available: https://www.kaggle.com/datasets/bittlingmayer/amazonreviews (accessed: Nov. 2022).
View in Google Scholar
Downloads
Submitted
Published
Issue
Section
License
Copyright (c) 2023 Journal of Telecommunications and Information Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.
