A Survey of Deep Learning for Sentiment Analysis

  • Abhinandan Shirahatti
  • Krupa Rasane


Deep learning has detonated in the public
responsiveness, primarily as predictive and analytical products
pervade our world, in the form of innumerable humancentered
smart-world systems, including targeted
advertisements, natural language assistants and interpreters,
and mock-up self-driving vehicle systems. In contrast,
researchers across disciplines have been including into their
research to solve various natural language processing issues. In
this paper we seek to provide a thorough exploration of Deep
learning and its applications like sentimental analysis and
natural language processing (NLP). Deep learning has an edge
over the traditional machine learning algorithms, like support
vector machine (SVM) and Naïve Bayes, for sentiment analysis
because of its potential to overcome the challenges faced by
sentiment analysis and handle the diversities involved, without
the expensive demand for manual feature engineering. Deep
learning models promise one thing - given sufficient amount of
data and sufficient amount of training time, they can perform
the task of sentiment classification on any text class with
minimal restrictions and no task-specific or data-specific
manual feature engineering. We hope this survey provides a
valuable reference for new Deep learning practitioners, as well
as those seeking to innovate in the application of deep learning.

Keywords: Deep learning, Support vector machine (SVM), Naïve Bayes, Sentiment analysis, Natural language processing (NLP)


[1] Thumbs up? Sentiment Classification using Machine Learning
Techniques. (EMNLP), Philadelphia, July 2002, pp. 79-86.
Proceedings of the Conference on Empirical Methods in NLP.
[2] Jason D. M. Rennie,Tackling the Poor Assumptions of Naive Bayes
[3] Text Classifiers, Artificial Intelligence Laboratory; Massachusetts
Institute of Technology; Cambridge, MA 02139,2003
[4] Andrea Esuli∗ and Fabrizio Sebastiani, SENTIWORDNET: A
Publicly Available Lexical Resource for Opinion Mining,2005-06.
[5] Yoshua Bengio, A Neural Probabilistic Language Model, Journal of
Machine Learning Research 3 (2003) 1137–1155, 2003.
[6] Tomas Mikolov Google Inc.“Efficient Estimation of Word
Representations in Vector Space, Machine Learning Research Sep
[7] Ronan Collobert, Natural Language Processing (Almost) from
Scratch, Journal of Machine Learning Research 12 (2011) 2493-2537.
[8] Yoon Kim, Convolutional Neural Networks for Sentence
Classification Journal of Machine Learning Research 3 Sep 2014.
[9] Richard Socher, Alex Perelygin, Recursive Deep Models for Semantic
Compositionality Over a Sentiment Treebank, Google scholar,2013.
[10] Felix A. Gers, Learning Precise Timing with LSTM Recurrent
Networks, Journal of Machine Learning Research 3 (2002) 115-143.
[11] Adam L Berger, Vincent J Della Pietra, and Stephen A Della Pietra.
1996. A maximum entropy approach to natural language processing.
Computational linguistics, 22(1):39–71.
[12] Roberto González-Ibáñez, Identifying Sarcasm in Twitter: A Closer
Look, Proceedings of the 49th Annual Meeting of the Association for
Computational Linguistics:shortpapers, pages 581–586, Portland,
Oregon, June 19-24, 2011.
[13] P. Ruangkanokmas, T. Achalakul, and K. Akkarajitsakul, Deep Belief
Networks with Feature Selection for Sentiment Classification,
Uksim.Info, pp. 16, 2016.
[14] C. Baecchi, T. Uricchio, M. Bertini, and A. Del Bimbo, A
multimodalfeature learning approach for sentiment analysis of social
network multimedia,Multimed. Tools Appl., vol. 75, no. 5, pp.
25072525, 2016.
[15] J. Islam and Y. Zhang, Visual Sentiment Analysis for Social
ImagesUsing Transfer Learning Approach, 2016 IEEE Int pp. 124130,
[16] A. Severyn and A. Moschitti, Twitter Sentiment Analysis with Deep
Convolutional Neural Networks, Proc. 38th Int. ACM SIGIR Conf.
Res. Dev. Inf. Retr. - SIGIR 15, pp. 959962, 2015.
[17] Q. You, J. Luo, H. Jin, and J. Yang, Joint Visual-Textual Sentiment
Analysis with Deep Neural Networks, Acm Mm, pp. 10711074, 2015.
[18] X. Ouyang, P. Zhou, C. H. Li, and L. Liu, Sentiment Analysis Using
Convolutional Neural Network, Comput. Inf. Technol. Ubiquitous
Comput. Commun. Dependable, Auton. Secur. Comput. Pervasive
Intell. Comput. (CIT/IUCC/DASC/PICOM), 2015 IEEE Int. Conf.,
pp. 23592364, 2015.
[19] C. Li, B. Xu, G. Wu, S. He, G. Tian, and H. Hao, Recursive deep
learning for sentiment analysis over social data, Proc. - 2014
IEEE/WIC/ACM Int. Jt. Conf. Web Intell. Intell. Agent Technol. -
Work. WI IAT 2014, vol. 2, pp. 13881429, 2014.
[20] R. Socher, A. Perelygin, and J. Wu, Recursive deep models for
semantic compositionality over a sentiment treebank, Proc. , pp.
16311642, 2013.
[21] W. Li and H. Chen, Identifying top sellers in underground economy
using deep learning-based sentiment analysis, Proc. - 2014 IEEE Jt.
Intell. Secur. Informatics Conf. JISIC 2014, pp. 6467, 2014.
[22] A. Hassan, M. R. Amin, A. Kalam, A. Azad, and N.
Mohammed,Bangla Text ( BRBT ) using Deep Recurrent models.
[23] ZHAO JIANQIANG, “Deep Convolution Neural Networks for
Twitter Sentiment Analysis”, VOLUME 6, 2018 2169-3536 2018
IEEE. Translations.
0 Views | 0 Downloads
How to Cite
Shirahatti, A., & Rasane, K. (2019). A Survey of Deep Learning for Sentiment Analysis. Asian Journal For Convergence In Technology (AJCT). Retrieved from http://asianssr.org/index.php/ajct/article/view/758