Mood Detection through Aesthetic Assessment of Videos using Deep Learning
Abstract
role. Monitoring and predicting various
human’s feelings (happy, sad, anger, fear, etc.) is a challenging
task. Human interaction and carrier of feelings amongst
humans are accomplished mainly through five senses: touch,
smell, taste audio, visual. Considering Visual sense, images and
videos are important gradients in day-to-day life. It can
elevate/ depress the mood of a person. Digital contents of
multimedia are image, audio, video, text, and so on. The usage
of internet is tremendously increasing, so Internet bandwidth
and storage space, video data has been generated, published,
and spread robustly, and becoming an important of today’s big
data. This has encouraged the development of advanced
techniques for a wide scope of video understanding
applications including online advertising, Cinematography,
video retrieval, video surveillance, video data on Social sites,
etc. However, it is easy to convey a story to a viewer of video,
since a video is worth of thousands worth. And this story
actually creates a mood. This work is to detect the mood of
aesthetically pleasing videos that reflect on a person’s mood.
References
Huang, Chengjia Cai, Xiangmin Xu, “A multi-scene
deep learning model for image aesthetic evaluation”,
2016, ACM journal Image communication, Vol.47, Issue
C, Pages 511-518.
[2] Magzhan Kairanbay, John See, Lai-Kuan Wong, Yong-
Lian Hii, “Filling the GAPS: Reducing the Complexity of
Networks for Multi-Attribute Image Aesthetic
Prediction.” 2017 IEEE International Conference on
Image Processing.
[3] Simone Bianco, Luigi Celona, Paolo Napoletano, and
Raimondo Schettini, “Predicting Image Aesthetics with
Deep Learning”, 2018 Springer international Journal.
[4] Michal Kucer, Alexander C. Loui, David W. Messinger,
“Leveraging Expert Feature Knowledge for Predicting
Image Aesthetics”, 2018 IEEE Transactions on Image
Processing, Vol. 27, No. 10.
[5] Zhangyang Wang, Ding Liu, Shiyu Chang, Florin Dolcos,
Diane Beck, Thomas Huang, “Image Aesthetics
Assessment using Deep Chatterjee’s Machine” 2017
IEEE International Joint Conference on Neural
Networks(IJCNN).
[6] Xin Lu, Zhe Lin, Hailin Jin, Jianchao Yang, and James. Z.
Wang, “Rating Image Aesthetics Using Deep Learning”,
2015 IEEE Transactions on Multimedia, Vol. 17, No. 11.
[7] Hui-Jin Lee, Ki-Sang Hong, Henry Kang, and Seungyong
Lee, “Photo Aesthetics Analysis via DCNN Feature
19, No. 8.
[8] Luming Zhangy, Yue Gaoy, Chao Zhangz, Hanwang
Zhangy, Qi Tian, Roger Zimmermann, “Perception-
Guided Multimodal Feature Fusion for Photo Aesthetics
Assessment”, 2014, Proceeding of the 22nd ACM
international conference on Multimedia Pages 237-246.
[9] Yuzhen Niu and Feng Liu, “What Makes a Professional
Video? A Computational Aesthetics Approach”, July
2012 IEEE Transactions on Circuits and Systems for
Video Technology, Vol. 22, issue:7
[10] Yanran Wang, Qi Dai, Rui Feng, Yu-Gang Jiang, “Beauty
is Here: Evaluating Aesthetics in Videos Using
Multimodal Features and Free Training Data”, 2013,
Proceeding of the 21st ACM international conference on
Multimedia Pages 369-372.
[11] Chun-Yu Yang, Hsin-Ho Yeh and Chu-Song Chen,
“Video Aesthetic quality assessment by combining
semantically independent and dependent features”, 2011
IEEE International conference on Acoustics, Speech, and
Signal Processing(ICASSP).
[12] Hsin-Ho Yeh, Chun-Yu Yang, Ming-Sui Lee, and Chu-
Song Chen, “Video Aesthetic Quality Assessment by
Temporal Integration of Photo- and Motion-Based
Features”, Dec 2013 IEEE Transactions on Multimedia,
Vol. 15, issue: 8
[13] Subhabrata Bhattacharya, Behnaz Nojavanasghari, Tao
Chen, “Towards a Comprehensive Computational Model
for Aesthetic Assessment of Videos”, 2013, Proceeding of
the 21st ACM international conference on Multimedia
Pages 361-364.
[14] Shasha Moa, Jianwei Niua, Yiming Sua, Sajal K. Das, “A
Novel Feature Set for Video Emotion Recognition”, 2018
Neurocomputing 291, 11-20.
[15] Christos Tzelepis, Eftichia Mavridaki, Vasileios Mezaris,
Ioannis Patras, “Video Aesthetic Quality Assessment
using Kernel Support Vector Machine with Isotropic
Gaussian Sample Uncertainty (KSVM-IGSU)”, 2016
IEEE International Conference on Image Processing
(ICIP).
[16] Loris Nanni, Stefano Ghidoni, Sheryl Brahnam,
“Handcrafted vs Non-Handcrafted Features for computer
vision classification”, 2017 Pattern Recognition 71, 158-
172.
[17] Sanjay K. Kuanar, Rameswar Panda, Ananda S.
Chowdhury, “Video key frame extraction through
dynamic Delaunay clustering with a structural
constraint”, 2013 journal of Visual Communication and
Image Representation, Vol. 24, issue: 7, Pages 1212-
1227.
[18] Ritendra Datta, James Z. Wang, “ACQUINE: Aesthetic
Quality Inference Engine –Real-time Automatic Rating
of Photo Aesthetics”, Proceedings of the ACM
international conference on Multimedia information
retrieval Pages 421-424.
To ensure uniformity of treatment among all contributors, other forms may not be substituted for this form, nor may any wording of the form be changed. This form is intended for original material submitted to AJCT and must accompany any such material in order to be published by AJCT. Please read the form carefully.
The undersigned hereby assigns to the Asian Journal of Convergence in Technology Issues ("AJCT") all rights under copyright that may exist in and to the above Work, any revised or expanded derivative works submitted to AJCT by the undersigned based on the Work, and any associated written, audio and/or visual presentations or other enhancements accompanying the Work. The undersigned hereby warrants that the Work is original and that he/she is the author of the Work; to the extent the Work incorporates text passages, figures, data or other material from the works of others, the undersigned has obtained any necessary permission. See Retained Rights, below.
AUTHOR RESPONSIBILITIES
AJCT distributes its technical publications throughout the world and wants to ensure that the material submitted to its publications is properly available to the readership of those publications. Authors must ensure that The Work is their own and is original. It is the responsibility of the authors, not AJCT, to determine whether disclosure of their material requires the prior consent of other parties and, if so, to obtain it.
RETAINED RIGHTS/TERMS AND CONDITIONS
1. Authors/employers retain all proprietary rights in any process, procedure, or article of manufacture described in the Work.
2. Authors/employers may reproduce or authorize others to reproduce The Work and for the author's personal use or for company or organizational use, provided that the source and any AJCT copyright notice are indicated, the copies are not used in any way that implies AJCT endorsement of a product or service of any employer, and the copies themselves are not offered for sale.
3. Authors/employers may make limited distribution of all or portions of the Work prior to publication if they inform AJCT in advance of the nature and extent of such limited distribution.
4. For all uses not covered by items 2 and 3, authors/employers must request permission from AJCT.
5. Although authors are permitted to re-use all or portions of the Work in other works, this does not include granting third-party requests for reprinting, republishing, or other types of re-use.
INFORMATION FOR AUTHORS
AJCT Copyright Ownership
It is the formal policy of AJCT to own the copyrights to all copyrightable material in its technical publications and to the individual contributions contained therein, in order to protect the interests of AJCT, its authors and their employers, and, at the same time, to facilitate the appropriate re-use of this material by others.
Author/Employer Rights
If you are employed and prepared the Work on a subject within the scope of your employment, the copyright in the Work belongs to your employer as a work-for-hire. In that case, AJCT assumes that when you sign this Form, you are authorized to do so by your employer and that your employer has consented to the transfer of copyright, to the representation and warranty of publication rights, and to all other terms and conditions of this Form. If such authorization and consent has not been given to you, an authorized representative of your employer should sign this Form as the Author.
Reprint/Republication Policy
AJCT requires that the consent of the first-named author and employer be sought as a condition to granting reprint or republication rights to others or for permitting use of a Work for promotion or marketing purposes.
GENERAL TERMS
1. The undersigned represents that he/she has the power and authority to make and execute this assignment.
2. The undersigned agrees to indemnify and hold harmless AJCT from any damage or expense that may arise in the event of a breach of any of the warranties set forth above.
3. In the event the above work is accepted and published by AJCT and consequently withdrawn by the author(s), the foregoing copyright transfer shall become null and void and all materials embodying the Work submitted to AJCT will be destroyed.
4. For jointly authored Works, all joint authors should sign, or one of the authors should sign as authorized agent
for the others.
Licenced by :
Creative Commons Attribution 4.0 International License.
