Academia.eduAcademia.edu

Deep Belief Network

description383 papers
group4 followers
lightbulbAbout this topic
A Deep Belief Network (DBN) is a type of generative graphical model composed of multiple layers of stochastic, latent variables. It utilizes unsupervised learning to pre-train layers of restricted Boltzmann machines, enabling the model to learn hierarchical representations of data, which can then be fine-tuned for specific tasks through supervised learning.
lightbulbAbout this topic
A Deep Belief Network (DBN) is a type of generative graphical model composed of multiple layers of stochastic, latent variables. It utilizes unsupervised learning to pre-train layers of restricted Boltzmann machines, enabling the model to learn hierarchical representations of data, which can then be fine-tuned for specific tasks through supervised learning.

Key research themes

1. How can Deep Belief Networks improve disease diagnosis and classification in medical imaging and biosignal data?

This research theme explores the application of Deep Belief Networks (DBNs) for effective diagnosis and classification in medical contexts, leveraging their ability to model complex data distributions and extract hierarchical features from imaging and biomedical signals. It matters because early and accurate detection of diseases such as breast cancer, Parkinson's, Alzheimer's, and colorectal malignancies can significantly improve patient outcomes, and DBNs offer a promising deep learning method to enhance diagnostic accuracy over traditional machine learning approaches.

Key finding: By employing a DBN as an unsupervised pretraining phase followed by a backpropagation neural network fine-tuning (DBN-NN), the authors achieved a classification accuracy of 99.68% on the Wisconsin Breast Cancer Dataset... Read more
Key finding: Using speech signal features and a DBN consisting of stacked Restricted Boltzmann Machines (RBMs), the system achieved a diagnosis accuracy of 94%, outperforming previous methods such as K-NN and standard SVM approaches. The... Read more
Key finding: By augmenting 1D EEG data using overlapping sliding windows and optimizing feature extraction via an Improved Binary Salp Swarm Algorithm combined with a Modified DBN (MDBN-IBSSA), the authors attained 98.13% accuracy and... Read more
Key finding: Applying DBN for unsupervised feature extraction and classification on colonoscopy images enabled precise detection of colorectal malignancies (polyps) from complex images, addressing difficulties in discriminating intraclass... Read more
Key finding: Integrating DBNs with IoT sensor data enabled efficient monitoring and behavioral analysis of patients remotely, improving diagnosis and timely intervention capabilities. DBNs processed large-scale health data in real-time... Read more

2. How can Deep Belief Networks contribute to feature extraction and classification in complex sensor and image data across applications like remote sensing and audio processing?

This theme investigates the role of DBNs in learning powerful data representations for complex, high-dimensional sensor inputs such as hyperspectral images, audio signals, and aerial imagery. DBNs' capability for unsupervised pretraining followed by supervised refinement is critical in improving classification accuracy and computational efficiency in applications where labeled data may be limited or data come from heterogeneous sources.

Key finding: The authors model the sparsity patterns of signals using RBMs and DBNs as statistical priors in a compressed sensing framework, improving signal reconstruction quality by capturing higher-order statistical dependencies beyond... Read more
Key finding: Combining DBN-learned unsupervised features at multiple depths with classical MFCC features and training a supervised SVM classifier yielded superior speaker recognition performance compared to using either feature set alone.... Read more
Key finding: Utilization of DBNs for processing feature-level fused remote sensing images after dimensionality reduction (PCA) enhanced land cover classification accuracy compared to traditional techniques. The DBN effectively extracted... Read more
Key finding: The study combined YOLOv8 for vehicle detection and DBN for classification using multiple feature sets (SIFT, ORB, KAZE) extracted from aerial images, achieving robust classification accuracy. The DBN effectively learned... Read more
Key finding: Implementation of a DBN with Gaussian-Bernoulli RBMs on an FPGA platform enabled real-time hyperspectral image classification with high accuracy and low power consumption. The hardware-accelerated DBN efficiently processed... Read more

3. What architectural and optimization strategies enhance the performance and training efficiency of Deep Belief Networks in complex classification tasks?

This theme centers on methodological advances in DBN architecture design and parameter optimization, including sparsity incorporation, metaheuristic algorithms, and hybrid learning strategies to improve convergence, avoid local minima, and enhance classification accuracy. These techniques address challenges in DBN training such as overfitting, high-dimensional parameter space, and model interpretability critical for deploying DBNs in diverse real-world tasks.

Key finding: By systematically experimenting with incorporating normal sparsity constraints into generative and discriminative DBN layers, the authors identified an optimal architecture: input-generative (CD)-generative (CD)-normal sparse... Read more
Key finding: The Firefly Algorithm (FFA), a metaheuristic inspired by firefly bioluminescence communication, was successfully applied to optimize DBN parameters including the number of hidden neurons and learning rates. FFA outperformed... Read more
Key finding: The proposed IGSPO-DBN technique integrates sandpiper optimization with DBN for static and dynamic gesture recognition, enabling visually impaired users to interact naturally with assistance devices. The metaheuristic... Read more
Key finding: This survey outlines multiple approaches for optimizing and training deep learning architectures, including DBNs, emphasizing innovations in parameter tuning, architecture search, and hybrid models. The paper situates DBNs... Read more

All papers in Deep Belief Network

Traditional, threshold-based "pass/fail" maintenance philosophies for power transformers are fundamentally reactive, often failing to identify assets on a trajectory toward failure and thereby creating significant operational and... more
While enabling remote management and efficiency improvements, the infrastructure of the smart city becomes able to advance due to the consequences of the internet of things (IoT). The development of IoT in the fields of agriculture,... more
Lung cancer is an early lung cancer. The world's greatest cause of death is lung cancer. Lung cancer typically does not cause signs or symptoms in its early stages. In order to reduce the mortality rate early detection of lung cancer... more
Plasmodium is a type of unicellular eukaryote compulsory for vertebrates or insect parasites. The early diagnosis is required for malaria. In this study, the automatic classification of malaria system is discussed. Initially, the input... more
Malaria is an infectious disease transmitted by mosquitoes that affects humans and other animals. Malaria is responsible for the effects of fever, tiredness, vomiting and headaches. Yellow skin, convulsions, a coma, or death can lead to... more
Detecting motor imagery from electrocardiographic (ECG) signals is complex but crucial in developing advanced neuroprosthetic devices and brain-computer interface (BCI) systems. In most cases, linear models applied using conventional... more
Millions of people depend on coconut palms for their food and livelihoods, making them one of the most essential crops in tropical countries. However, Diseases may significantly reduce the output of coconut trees and possibly result in... more
Detecting buildings from satellite imagery presents challenges related to computational efficiency, model adaptation, and occlusion. This paper introduces a novel method called the Secant Deep Belief Network-Hyperbolic Cosine Whale... more
In this study, attention-based fusions of CNN and RNN indeed reached an interesting performance with identifying the fetal brain MRIs. Various Deep Learning and Transfer learning approaches were proposed for improved accuracy and... more
A precise tool wear monitoring model is essential for manufacturing to ensure reliability and efficiency. This study aims to analyze and monitor the condition of small-sized cutting tools during end-milling operations based on direct and... more
Machine learning is a branch of artificial intelligence. It enables computers to automatically learn and improve from experience without being explicitly programmed [1]. Machine learning algorithms are usually classified into... more
It is of paramount importance to track the cognitive activity or cognitve attenion of the service personnel in a Prognostics and Health Monitoring (PHM) service related training or operation environment. The electroencephalography (EEG)... more
Network representation learning and its applications have received increasing attention. Due to their various application areas, many research groups have developed a diverse range of software tools and techniques to learn representation... more
In recent years, the prevalent online services generate a sheer volume of user activity data. Service providers collect these data in order to perform client behavior analysis, and offer better and more customized services. Majority of... more
People’s attitudes, opinions, feelings and sentiments which are usually expressed in the written languages are studied by using a well known concept called the sentiment analysis. The emotions are expressed at various different levels... more
INTRODUCTION: Diabetic nephropathy is one of the complications of diabetes that causes damage to kidneys. Deep learning techniques are widely used to predict different diseases. OBJECTIVES: The main aim of this work is to develop an... more
by Usha P
In human body, the brain is a complex organ with billions of cells that controls the overall activities of our body. The abnormal and uncontrolled multiplication of these cells leads to Brain tumour which is one of the most dangerous and... more
Related product recommendation (RPR) is pivotal to the success of any e-commerce service. In this paper, we deal with the problem of recommending related products i.e., given a query product, we would like to suggest top-k products that... more
A rapid increase in heart disease has occurred in recent years, which might be the result of unhealthy food, mental stress, genetic issues, and a sedentary lifestyle. There are many advanced automated diagnosis systems for heart disease... more
Motivation. In medical field, particularly the cardiology, the diagnosis systems constitute the essential domain of research. In some applications, the traditional methods of classification present some limitations. The neuronal technique... more
This paper describes a novel approach to modelling a specific orthopaedic condition, Hallux Valgus; it is a complex deformity resulting in more than 140 possible surgical correction procedures, each focusing on different components of the... more
Educational data mininghas contributed to enhancing student academic performance by way of enabling stakeholders in academic institutions to have a pre-knowledge of the risks and dangers ahead and how to mitigate them. Prediction... more
Background: A vital tool for medical diagnosis, magnetic resonance imaging (MRI) produces high-resolution, non-ionizing images of inside body components. Despite its potential, MRI pictures frequently have noise and abnormalities that can... more
Two popular representation learning paradigms are dictionary learning and deep learning. While dictionary learning focuses on learning ''basis'' and ''features'' by matrix factorization, deep learning focuses on extracting features via... more
Two popular representation learning paradigms are dictionary learning and deep learning. While dictionary learning focuses on learning ''basis'' and ''features'' by matrix factorization, deep learning focuses on extracting features via... more
In this work we propose a new deep learning tool called deep dictionary learning. Multi-level dictionaries are learnt in a greedy fashion, one layer at a time. This requires solving a simple (shallow) dictionary learning problem, the... more
The implementation of machine learning in bioinformatics and medical analysis has brought about great improvement in the health care delivery sector of the economy. As the heart remains the pivotal organ of the human body pumping blood to... more
Nowadays, electrical power system is considered as one of the most complicated artificial systems all over the globe, as social and economic development depends on intact, consistent, stable and economic functions. Owing to diverse random... more
This article proposes a deep learning technique for the prevision of the geometric accuracy in single point incremental forming. Moreover, predicting geometric accuracy is one of the most crucial measures of part quality. Accordingly,... more
Deep reinforcement learning (RL) algorithms have recently achieved remarkable successes in various sequential decision making tasks, leveraging advances in methods for training large deep networks. However, these methods usually require... more
The rapid growth of streaming platforms has transformed the landscape of television and video consumption. Traditional television advertising, which relied on fixed schedules and generalized targeting, is increasingly being replaced by... more
Significant advances in the automated glaucoma detection techniques have been made through the employment of the Machine Learning (ML) and Deep Learning (DL) methods, an overview of which will be provided in this paper. What sets the... more
Background: Cloud computing, AI, and IoT technologies are revolutionizing healthcare by enabling predictive analytics and ongoing health monitoring. A hybrid technique that combines the Gray Wolf Optimization (GWO) algorithm with Deep... more
Deep belief network (DBN) is a probabilistic generative model with multiple layers of hidden nodes and a layer of visible nodes, where parameterizations between layers obey harmonium or restricted Boltzmann machines (RBMs). In this paper... more
Network Intrusion Detection (ID) attempts to detect diverse security attacks using a security system to monitor, analyze, detect, and respond to threats. In Software Defined Networking (SDN), ID that typically occurs at the controller is... more
In recent years multilayer perceptrons (MLPs) with many hidden layers Deep Neural Network (DNN) has performed surprisingly well in many speech tasks, i.e. speech recognition, speaker verification, speech synthesis etc. Although in the... more
Many patients' lives are being saved by image-guided interventions, and the image registration issue must be regarded as the most difficult and complex problem to solve. However, the latest enormous advancements in machine learning (ML),... more
The Semi-Parallel Deep Neural Network (SPDNN) idea is explained in this article and it has been shown that the convergence of the mixed network is very close to the best network in the set and the generalization of SPDNN is better than... more
SiCRNN: A Siamese Approach for Sleep Apnea Identification via
Tracheal Microphone Signals
Nowadays, big data is directing the entire advanced world with its function and applications. Moreover, to make better decisions from the ever emerging big data belonging to the respective organizations, deep learning (DL) models are... more
This paper proposes a high-resolution non-volatile memory cell design that addresses the most substantial limitations associated with the effective implementation of analog long-term memory storage solution. Prior research efforts often... more
Nowadays, spam detection has been one of the foremost machine learning-oriented applications in the context of security in computer networks. In this work, we propose to learn intrinsic properties of e-mail messages by means of Restricted... more
In this article, the regularity of the global solutions to atmospheric circulation equations with humidity effect is considered. Firstly, the formula of the global solutions is obtained by using the theory of linear operator semigroups.... more
Energy theft is a significant problem that needs to be addressed for effective energy management in smart cities. Smart meters are highly utilized in smart cities that help in monitoring the energy utilization level and provide... more
Download research papers for free!