Opinion mining using Double Channel CNN for Recommender System
2023, arXiv (Cornell University)
https://doi.org/10.48550/ARXIV.2307.07798Abstract
Much unstructured data has been produced with the growth of the Internet and social media. A significant volume of textual data includes users' opinions about products in online stores and social media. By exploring and categorizing them, helpful information can be acquired, including customer satisfaction, user feedback about a particular event, predicting the sale of a specific product, and other similar cases. In this paper, we present an approach for sentiment analysis with a deep learning model and use it to recommend products. A twochannel convolutional neural network model has been used for opinion mining, which has five layers and extracts essential features from the data. We increased the number of comments by applying the SMOTE algorithm to the initial dataset and balanced the data. Then we proceed to cluster the aspects. We also assign a weight to each cluster using tensor decomposition algorithms that improve the recommender system's performance. Our proposed method has reached 91.6% accuracy, significantly improved compared to previous aspectbased approaches.
References (46)
- B. Rocca, "Introduction to recommender systems," [Online]. Available: https://towardsdatascience.com/introduction-to- recommender-systems-6c66cf15ada. [Accessed 3 June 2019].
- D. Aminu, S. Naomie, R. Idris, and O. Akram, "Weighted aspect-based opinion mining using deep learning for recommender system," Expert Systems With Applications, vol. 140, p. 112871, 2020.
- Nazarizadeh, A., Banirostam, T., & Sayyadpour, M. (2022). Sentiment Analysis of Persian Language: Review of Algorithms, Approaches and Datasets. arXiv. https://doi.org/10.48550/ARXIV.2212.06041.
- A. Nazarizadeh, T. Banirostam and M. Sayyadpour, "Using Group Deep Learning and Data Augmentation in Persian Sentiment Analysis," 2022 8th Iranian Conference on Signal Processing and Intelligent Systems (ICSPIS), Behshahr, Iran, Islamic Republic of, 2022, pp. 1-5.
- Wu, Y., & Ester, M. (2015). FLAME: A probabilistic model combining aspect-based opinion mining and collaborative filtering. WSDM, 199- 208.
- Guang, Q., & Bing, L. (2009). Opinion word expansion and target extraction through double propagation. Computational Linguistics, 37 (1), 1-19.
- Jia, Y., Zhang, C., Lu, Q., & Wang, P. (2014). Users' brands preference based on SVD ++ in recommender systems. In Proceedings -2014 IEEE workshop on advanced research and technology in industry applications, WARTIA 2014 (pp. 1175-1178).
- Lafferty, J., Mccallum, A., Pereira, F. C. N., & Pereira, F. (2001). Conditional random fields. In Proceedings of the 18th international conference on machine learning 20 01 (ICML 20 01) (pp. 282-289).
- Irsoy, O., & Cardie, C. (2014). Opinion mining with deep recurrent neural networks. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 720-728).
- Liu, P., Joty, S., & Meng, H. (2015). Fine-grained opinion mining with recurrent neural networks and word embeddings. In Proceedings of the 2015 conference on empirical methods in natural language processing (EMNLP-2015) (pp. 1433-1443).
- Poria, S., Cambria, E., & Gelbukh, A. (2016). Aspect extraction for opinion mining with a deep convolutional neural network. Knowledge- Based Systems, 108, 42-49.
- Xu, H., Liu, B., Shu, L., & Yu, P. S. (2018). Double embeddings and CNN-based sequence labeling for aspect extraction. In Proceedings of the 56th annual meeting of the association for computational linguistics (pp. 592-601).
- Devi, D. V. N. V. N., Kumar, C. K., & Prasad, S. (2016). A feature- based approach for sentiment analysis by using support vector machine. In 2016 IEEE 6th international conference on advanced computing (IACC) (pp. 3-8).
- Yoon, J., & Kim, H. (2017). Multi-Channel Lexicon Integrated CNN- BiLSTM Models for Sentiment Analysis. In The 2017 Conference on computational linguistics and speech processing (pp. 244-253).
- Titov, I., & McDonald, R. (2008). A joint model of text and aspect ratings for sentiment summarization. In Proceedings of ACL08 HLT: 51 (pp. 308-316).
- Wang, F., & Chen, L. (2015). Review mining for estimating users' ratings and weights for product aspects. Web Intelligence, 13 (3), 137- 152.
- Dau, Aminu & Salim, Naomie & Idris, Rabiu & Osman, Akram. (2019). Recommendation System Exploiting Aspect-based Opinion Mining with Deep Learning Method. Information Sciences.
- Nitesh V. Chawla, Kevin W. Bowyer, Lawrence O. Hall, and W. Philip Kegelmeyer. 2002. SMOTE: synthetic minority over-sampling technique. J. Artif. Int. Res. 16, 1 (January 2002), 321-357.
- Jakob, N., & Ag, S. (2009). Beyond the stars: exploiting free-text user reviews to improve the accuracy of movie recommendations. TSA09, 57-64.
- McAuley, J., & Leskovec, J. (2013). Hidden factors and hidden topics: understanding rating dimensions with review text. In Proceedings of the 7th ACM conference on recommender systems (pp. 165-172).
- Ling, G., Lyu, M. R., & King, I. (2014). Ratings meet reviews, a combined approach to recommend. In Proceedings of the 8th ACM conference on recommender systems -RecSys '14 (pp. 105-112).
- Diao, Q., Qiu, M., Wu, C.-Y., Smola, A. J., Jiang, J., & Wang, C. (2014). Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining - KDD '14 (pp. 193-202).
- Zhang, Y., Lai, G., Zhang, M., Zhang, Y., Liu, Y., & Ma, S. (2014). Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In Proceedings of the 37th international ACM SIGIR conference on research & development in information retrieval -SIGIR '14 (pp. 83-92).
- Zheng, L., Noroozi, V., & Yu, P. S. (2017). Joint deep modeling of users and items using reviews for recommendation. In WSDM 2017 ACM (pp. 1-10).
- Catherine, R., & Cohen, W. (2017). TransNets: Learning to transform for recommendation. In RecSys'17 (pp. 288-296).
- Lu, Y., Smyth, B., Dong, R., & Smyth, B. (2018). Coevolutionary recommendation model: mutual learning between ratings and reviews. In Proceedings of the 2018 world wide web conference on world wide web -WWW '18 (pp. 773-782).
- Jing, H., & Smola, A. J. (2017). Neural survival Recommender. In WSDM 2017, ACM (pp. 515-524).
- Da'u, A., & Salim, N. (2019). Sentiment-aware deep recommender system with neural attention networks. IEEE Access, 7, 45472-45484.
- Bai, B., Fan, Y., Tan, W., & Zhang, J. (2017). DLTSR: A deep learning framework for recommendation of long-tail web services. IEEE Transactions on Services Computing, 1374 (c), pp. 1-13.
- Yu, M., Quan, T., Peng, Q. et al. A model-based collaborate filtering algorithm based on stacked AutoEncoder. Neural Comput & Applic 34, 2503-2511 (2022).
- Yang, Y., Zhu, Y. & Li, Y. Personalized recommendation with knowledge graph via dual-autoencoder. Appl Intell 52, 6196-6207 (2022).
- Snyder, B., & Barzilay, R. (2007). Multiple aspect ranking using the good grief algorithm. In Proceedings of NAACL HLT (pp. 300-307).
- Diao, Q., Qiu, M., Wu, C.-Y., Smola, A. J., Jiang, J., & Wang, C. (2014). Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining - KDD '14 (pp. 193-202).
- Wang, H., Lu, Y., & Zhai, C. (2010). Latent aspect rating analysis on review text data: A rating regression approach. KDD'10, 1-10.
- Wang, H., Lu, Y., & Zhai, C. (2011). Latent aspect rating analysis without aspect keyword supervision. In Proceedings of the 17th ACM SIGKDD International conference on knowledge discovery and data mining -KDD '11: 138 (p. 618).
- Bauman, K., Liu, B., & Tuzhilin, A. (2017). Aspect-based recommendations: Recommending items with the most valuable aspects based on user reviews. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining -KDD '17 (pp. 717-725).
- Xu, H., Liu, B., Shu, L., & Yu, P. S. (2018). Double embeddings and CNN-based sequence labeling for aspect extraction. In Proceedings of the 56th annual meeting of the association for computational linguistics (pp. 592-601).
- Safar, S., Jose, B.R., Santhanakrishnan, T. (2022). An Improved Recommendation System with Aspect-Based Sentiment Analysis. In: Mathew, J., Santhosh Kumar, G., P., D., Jose, J.M. (eds) Responsible Data Science. Lecture Notes in Electrical Engineering, vol 940. Springer, Singapore.
- Yang, C., Yu, X., Liu, Y., Nie, Y., & Wang, Y. (2016). Collaborative filtering with weighted opinion aspects. Neurocomputing, 210, 185- 196.
- Hajba, G.L. (2018). Using Beautiful Soup. In: Website Scraping with Python. Apress, Berkeley, CA.
- ML | Handling Imbalanced Data with SMOTE and Near Miss Algorithm in Python, "https://www.geeksforgeeks.org/ml-handling- imbalanced-data-with-smote-and-near-miss-algorithm-in-python", 2022.
- Mikolov, T., Yih, W., & Zweig, G. (2013). Linguistic regularities in continuous space word representations. In Proceedings of NAACL- HLT (pp. 746-751).
- Jebbara, S., & Cimiano, P. (2016). Aspect-based relational sentiment analysis using a stacked neural network architecture. In On artificial intelligence, 29 August-2 (pp. 1-9).
- McAuley, J., & Leskovec, J. (2013). Hidden factors and hidden topics: understanding rating dimensions with review text. In Proceedings of the 7th ACM conference on recommender systems (pp. 165-172).
- Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42 (8), 30-37.
- Tan, Y., Zhang, M., Liu, Y., & Ma, S. (2016). Rating-boosted latent topics: Understanding users and items with ratings and reviews. In IJCAI international joint conference on artificial intelligence, 2016 - January (pp. 2640-2646).