CONTENT BASED VIDEO RETRIEVAL USING LOW-LEVEL FEATURES
2023, Journal of Theoretical and Applied Information Technology
Abstract
Over the past ten years, researchers have studied the Content Based Video Retrieval System, based on numerous applications, advancements, and technologies. In video retrieval systems, there is still a requirement for the high-level semantic elements as and the processing of low level materials. As a result, it inspires and motivates a lot of academics to learn more about the content Retrieval and to make more useful and effective while creating system applications. Analysis of video for retrieval of key aspects is regarded as earlier work. In this instance, input videos from YouTube are watched for analysis. After that, foreground segmentation is carried out to find a lot of tiny subset objects since each subset must identify the foreground video class. Given for feature extraction is the split region. In this study, four distinct methods for extracting features�chromatic moment, blur, color variety, and reflection features are taken into consideration. The high dimensionality characteristics are removed from the retrieved features using Principal Component Analysis since they may affect classification accuracy. The feature vectors are taken into account while combining all of the parts. The Nave Bayes classifier is used to complete the classification process. Metrics including accuracy, precision, recall, and F-measure are used to gauge how effectively video retrieval is performed. The predicted model outperforms the current strategy when the proposed model and the in-depth learning approach are compared.
References (39)
- Yang, H.; Siebert, M.; Luhne, P.; Sack, H.; Meinel, C. Lecture video indexing and analysis using video ocr technology. In Proceedings of the 2011 Seventh International Conference on Signal Image Technology & Internet-Based Systems, Dijon, France, 28 November-1 December 2011
- Accattoli, S.; Sernani, P.; Falcionelli, N.; Mekuria, D.N.; Dragoni, A.F. Violence detection in videos by combining 3D convolutional neural networks and support vector machines. Appl. Artif. Intell. 2020, 34, 329-344.
- Huang, J.; Rathod, V.; Sun, C.; Zhu, M.; Korattikara, A.; Fathi, A.; Fischer, I.; Wojna, Z.; Song, Y.; Guadarrama, S.; et al. Speed/accuracy trade-offs for modern convolutional object detectors. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21-26 July 2017; pp. 7310-7311.
- Robles, Oscar D, Pablo Toharia, Angel Rodríguez, and Luis Pastor. "Towards a content-based video retrieval system using wavelet-based signatures." In 7th IASTED International Conference on Computer Graphics and Imaging-CGIM, pp. 344-349. 2004.
- Dipika H Patel, "Content-Based Video Retrieval using Enhanced Feature Extraction", International Journal of Computer Applications (0975-8887), (vol119),pp.4-8, 2015.
- Dr.H.B.Kekre, Dr. Dhirendra Mishra, Ms. P. R. Rege, "Survey on Recent Technique in Content Based Video Retrieval", International Journal of Engineering and Technical Research (IJETR), (vol3), pp.69- 73,2015.
- Muhammad Nabeel Asghar, Fiaz Hussain, Rob Manton,"Video Indexing: Survey", International Journal of computer an Information Technology,(vol3),pp.148- 169,2014.
- P.Geetha and Vasumathi Narayanan, "A survey of Content-Based Video Retrieval", Journal of Computer Science, (vol4), pp.474- 486, 2008.
- Avinash N Bhute and B B Meshram, "System Analysis and Design for Multimedia Retrieval Systems", The International Journal of Multimedia and Its Applications (IJMA), (vol5), pp.25-44, 2013.
- Haitao Jiang, Abdelsalam (Sumi) Helal, Ahmed K. Elmagarmid, Anupam Joshi, "Scene change detection techniques for video database systems", ©Springer-Verlag, pp.186-195, 1998.
- Dr. H.B. Kekre, Dr. Sudeep D. Thepade and Saurabh Gupta, "Content Based Video Retrieval in Transformed Domain using Fractional Coefficients", International Journal of Image Processing (IJIP), (vol7), 201.3 [12].
- Chao, Jianshu, Anas Al-Nuaimi, Georg Schroth, and Eckehard Steinbach. "Performance comparison of various feature detector-descriptor combinations for content- based image retrieval with JPEG-encoded query images." In Multimedia Signal Processing (MMSP), 2013 IEEE 15th International Workshop on, pp. 029-034. IEEE, 2013.
- Baris Sumengen, et.al. "Multi-Scale Edge Detection and Image Segmentation", IEEE Signal processing Conference, pp.1-4, 2005 [14].
- N Ikonomakis, K. N. Plataniots and A.N. Venetsanopoulos,"A Region Based Color Image Segmentation Scheme", Proc.SPIE3653, Visual Communications and Image Processing , (vol3653), 1999.
- Yu, Y.; Ko, H.; Choi, J.; Kim, G. End-to- End Concept Word Detection for Video Captioning, Retrieval, and Question Answering. In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 21-26 July 2017; pp. 3261-3269. [Google Scholar] [16].
- Avgoustinakis, P.; Kordopatis-Zilos, G.; Papadopoulos, S.; Symeonidis, A.L.; Kompatsiaris, I. Audio-based Near-Duplicate Video Retrieval with Audio Similarity Learning. In Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy, 10-15 January 2021; pp. 5828-5835.
- Yasira Beevi C P et.al.2009, "An efficient Video Segmentation Algorithm with real time Adaptive Threshold Technique ", International Journal of Signal Processing, Image Processing and Pattern Recognition (vol2), pp.13-27
- Zhong Qu, Lidan Lin, Tengfei Gao and Yongkun Wang, "An Improved Keyframe Extraction Method Based on HSV Colour Space", Journal Of Software, (vol8), pp.1751-1758, 2013
- Tjondronegoro, Dian, Xiaohui Tao, Johannes Sasongko, and Cher Han Lau. "Multi-modal summarization of key events and top players in sports tournament videos." In Applications of Computer Vision (WACV), 2011 IEEE Workshop on, pp. 471- 478. IEEE, 2011.
- Santhosh kumar K and Mallikarjuna Lingam.K, "Content Based Video Retrieval Using Low and High Level Semantic Gap", International Journal for Research in Emerging Science and Technology, (vol2), pp.149-153, 2015.
- Shivanand S Gornale, Ashvini K Babaleshwar, Pravin L Yannawar," Detection and Classification of Signage's from Random Mobile Videos Using Local Binary Patterns", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.10, No.2, pp. 52-59, 2018.
- L. Zelnik-Manor and M. Irani, "Event- based video analysis", IEEE Conference on Computer Vision and Pattern Recognition, CVPR'01, (vol2), pp.123-130, 2001.
- Nikita Sao & Ravi Mishra, "Video Shot Boundary Detection Based On Nodal Analysis of Graph Theoritic Approach", International Journal of Management, Information Technology and Engineering (BEST: IJMITE), (vol2), pp.15-24, 2014. [24].
- Chandra Mani Sharma, Alok Kumar Singh Kushwaha, Rakesh Roshan, Rabins Porwal and Ashish Khare,"Intelligent Video Object Classification Scheme using Offline Feature Extraction and Machine Learning based Approach", IJCSI International Journal of Computer Science Issues, (vol9), pp.247- 256, 2012.
- Hamdy K. Elminir, Mohamed Abu ElSoud, Sahar F. Sabbeh, Aya Gamal "Multi feature content based video retrieval using high level semantic concept IJCSI International Journal of Computer Science Issues, (vol9), pp.254-260, 2012.
- Xingxiao Wu, Dong Xu, LixinDuan, JieboLuo, "Action Recognition Using MultilevelFeatures and Latent Structural SVM", IEEE Transactions on Circuits and Systems for Video Technology, (vol23), pp.1422-1431, 2013.
- Padmakala, S., G. S. AnandhaMala, and M. Shalini. "An effective content based video retrieval utilizing texture, color and optimal key frame features."Image Information Processing (ICIIP), 2011 International Conference on. IEEE, 2011.
- Navdeep Kaur, Mandeep
- Singh,"Content-Based Video Retrieval with Frequency domain Analysis using 2-D Correlation Algorithm", International Journal of Advanced Research in Computer Science and Software engineering ,(Vol4), pp.388- 393,2014.
- D.Asha, Madhavee Lata, V.S.K. Reddy, "Content based video retrieval system using Multiple Features", International Journal of pure and Applied Mathematics, (vol. 118), pp.287-294, 2018.
- A. Paul, B.-W. Chen, K. Bharanitharan, and J.-F. Wang, "Video search and indexing with reinforcement agent for interactive multimedia services," ACM Trans. Embed. Comput. Syst, (vol12) pp. 25:1-25:16, 2013. [31].
- Benjamin Drayer and Thomas Brox, "Object detection, Tracking, and Motion Segmentation for Object-level Video Segmentation", Computer Vision and Pattern Recognition, pp:1-17 2016.
- Santhosh kumar K and Mallikarjuna Lingam.K, "Content Based Video Retrieval Using Low and High Level Semantic Gap", International Journal for Research in Emerging Science and Technology, (vol2), pp.149-153, 2015.
- Van Nguyen N, Ogier J-M, Charneau F. PEDIVHANDI: multimodal indexation and retrieval system for lecture videos. Lect Notes Comput Sci.2013; 7725:382-393.
- Yang H, Siebert M, Luhne P, et al. 2011
- Lecture video indexing and analysis using video OCR technology. Proceedings of IEEE Seventh International Conference on Signal video Technology and Internet-based Systems (SITIS), Dijon, France; 2011. p. 54- 61. [35].
- Li K, Wang J, Wang H, et al. Structuring lecture videos by automatic projection screen localization and analysis. IEEE Trans Pattern Anal Mach Intell. 2015; 37(5):1233-1246.
- Baidya E, Goel S. 2014 Lecturekhoj: automatic tagging and semantic segmentation of online lecture videos. Proceedings of IEEE International Conference on Contemporary Computing (IC3), Noida, India; 2014. P.37- 43. [37].
- W. Wang, J. Shen, and F. Porikli, "Saliency-aware geodesic video object segmentation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2015, pp. 3395-3402.