Academia.eduAcademia.edu

Sequential Minimal Optimization (SMO)

description119 papers
group2 followers
lightbulbAbout this topic
Sequential Minimal Optimization (SMO) is an algorithm used for training support vector machines (SVMs) by breaking the optimization problem into smaller, more manageable sub-problems. It iteratively optimizes pairs of Lagrange multipliers, ensuring that the constraints of the SVM are satisfied while minimizing the overall objective function.
lightbulbAbout this topic
Sequential Minimal Optimization (SMO) is an algorithm used for training support vector machines (SVMs) by breaking the optimization problem into smaller, more manageable sub-problems. It iteratively optimizes pairs of Lagrange multipliers, ensuring that the constraints of the SVM are satisfied while minimizing the overall objective function.

Key research themes

1. How can Sequential Minimal Optimization (SMO) be adapted and optimized for efficient training of Least Squares SVM (LS-SVM) classifiers?

This research area investigates the applicability and performance enhancement of SMO algorithms specifically for LS-SVM classifiers, focusing on variations in working set selection strategies and kernel choices to improve training efficiency and convergence for these models. The motivation arises because traditional conjugate gradient methods dominate LS-SVM training, but SMO, well-known for standard SVMs, may offer computational advantages if appropriately adapted.

Key finding: This paper demonstrates that SMO algorithms, both First Order and Second Order working set selection variants, can be effectively applied to train LS-SVM classifiers, particularly with the widely-used RBF kernel. It finds... Read more

2. What are effective sequential and batch sequential adaptive design strategies for optimizing complex black-box and high-dimensional functions, potentially improving over classical SMO methods?

This theme includes research exploring sequential adaptive designs for global optimization that allow efficient and parallelizable function evaluations in complex black-box settings. It extends optimization methodologies beyond the classical SMO framework to batch and adaptive contexts, thereby addressing computational challenges posed by expensive and high-dimensional objective functions. These studies contribute alternative stochastic and surrogate-model-based procedures for optimizing parameters in machine learning and applied settings.

Key finding: The paper introduces an accelerated Efficient Global Optimization (EGO) algorithm using a refined sampling/importance resampling (SIR) method to select batches in parallel evaluations, thereby increasing computational... Read more
Key finding: This work presents the Sequential Parameter Optimization (SPO) framework relying on design of experiments and modern statistical models to sequentially tune and analyze performance of optimization algorithms, including... Read more
Key finding: Adaptive Stochastic Descent (ASD) is proposed as a random search algorithm inspired by manual parameter fitting with adaptive step sizes and parameter selection. ASD achieves minimization in moderately high-dimensional... Read more

3. How can machine learning techniques, including SMO, be integrated with landscape and network analyses to enhance algorithm selection and performance prediction in combinatorial optimization problems?

This theme captures research integrating SMO with methods for feature extraction and analysis of problem landscapes—such as Local Optima Networks—to improve automatic algorithm selection for hard combinatorial problems like TSP. By connecting problem instance features to algorithm performance predictions via machine learning, these studies aim to optimize solver choice and parameter tuning, thereby advancing automated and data-driven optimization.

Key finding: The study applies Local Optima Network (LON) analysis combined with machine learning, including Sequential Minimal Optimization (SMO), to classify TSP instances and predict the most effective metaheuristic algorithm on an... Read more

All papers in Sequential Minimal Optimization (SMO)

Penelitian ini akan berfokus dalam membandingkan kinerja tiga algoritma klasifikasi data mining dalam mengklasifikasi pelanggan baru ke dalam klaster berdasarkan perilaku. Algoritma atau metodologi yang digunakan adalah Support Vector... more
Sequential minimal optimization (SMO) algorithm is one of the simplest decomposition methods for learning of support vector machines (SVMs). Keerthi and Gilbert have recently studied the convergence property of SMO algorithm and given a... more
Sequential minimal optimization (SMO) algorithm is one of the simplest decomposition methods for learning of support vector machines (SVMs). Keerthi and Gilbert have recently studied the convergence property of SMO algorithm and given a... more
His research interests include nonlinear circuit theory, neural networks, and optimization theory.
Malignant melanoma represents the most dangerous type of skin cancer. In this study we present an ensemble classification scheme, employing the mutual information, the cross-correlation and the clustering based on proximity of image... more
Malignant melanoma represents the most dangerous type of skin cancer. In this study we present an ensemble classification scheme, employing the mutual information, the cross-correlation and the clustering based on proximity of image... more
As most of human activities are being moved to cyberspace, phishers and other cybercriminals are making the cyberspace unsafe by causing serious risks to users and businesses as well as threatening global security and economy. Nowadays,... more
Cybercriminals exploit malicious URLs as a distribution channel to spread harmful software across the internet. They take advantage of vulnerabilities in browsers to install malicious software with the aim of gaining remote access to the... more
Support Vector Machines are a powerful machine learning technology, but the training process involves a dense quadratic optimization problem and is computationally challenging. A parallel implementation of Support Vector Machine training... more
The k-fold cross-validation is commonly used to evaluate the effectiveness of SVMs with the selected hyper-parameters. It is known that the SVM k-fold cross-validation is expensive, since it requires training k SVMs. However, little work... more
Second order SMO represents the state-of-the-art in SVM training for moderate size problems. In it, the solution is attained by solving a series of subproblems which are optimized w.r.t just a pair of multipliers. In this paper we will... more
In this brief, we give a new proof of the asymptotic convergence of the sequential minimum optimization (SMO) algorithm for both the most violating pair and second order rules to select the pair of coefficients to be updated. The proof is... more
Support vector regression (SVR) is a powerful tool in modeling and prediction tasks with widespread application in many areas. The most representative algorithms to train SVR models are Shevade et al.'s Modification 2 and Lin's WSS1 and... more
In the recent years support vector machines (SVMs) have been successfully applied to solve a large number of classification problems. Training an SVM, usually posed as a quadratic programming (QP) problem, often becomes a challenging task... more
The use of digital banks in Indonesia has rapidly increased in recent years in response to the adoption of new technologies and changes in consumer behavior. User responses to digital banks vary depending on their experience throughout... more
Indonesia, as a predominantly Muslim country, experiences a high demand for halal products due to its Muslim consumer base. This research focuses on understanding the perceptions of Indonesian society towards businesses, particularly in... more
Indonesia, as a predominantly Muslim country, experiences a high demand for halal products due to its Muslim consumer base. This research focuses on understanding the perceptions of Indonesian society towards businesses, particularly in... more
Dunia pada saat ini tengah mengalami perkembangan pada bidang teknologi dan komunikasi secara massif, terlebih pada masa pandemi saat ini yang mengharuskan semua proses pembelajaran bahkan bekerja secara daring. Hal ini yang memicu... more
Santi Dewi Rahayu, Dedy Dwi Prastyo and Setiawan ARTICLES YOU MAY BE INTERESTED IN Generally weighted moving coefficient of variation (GWMCV) control chart using three parametric log-normal transformations
Pemilihan fitur merupakan salah satu bagian penting dan teknik yang sering digunakan dalam praproses penggalian data yang membawa efek langsung untuk mempercepat algoritma penggalian data dan meningkatkan kinerja pertambangan seperti... more
Cancer is currently one of the main health issues in the world. Among different varieties of cancers, skin cancer is the most common cancer in the world and accounts for 75% of the world's cancer. Indeed, skin cancer involves abnormal... more
In the era of globalization, prediction of financial distress is of interest not only to managers but also to external stakeholders of a company. The stakeholders are continuously seeking the optimal solution for performance forecasting,... more
The nearest point problem (NPP), i.e., finding the closest points between two disjoint convex hulls, has two classical solutions, the Gilbert-Schlesinger-Kozinec (GSK) and Mitchell-Dem'yanov-Malozemov (MDM) algorithms. When the convex... more
The nearest point problem (NPP), i.e., finding the closest points between two disjoint convex hulls, has two classical solutions, the Gilbert-Schlesinger-Kozinec (GSK) and Mitchell-Dem'yanov-Malozemov (MDM) algorithms. When the convex... more
Microblogging sites allowing disseminating distasteful content. This has become vigorous and nearly unstoppable now. Spreading online fake news has been identified as one of the major top concern of online abuse. Due to the difficulty in... more
Internet provides the facility to find customers worldwide without limitation use e-commerce market is effective. As a result the number of customers that rely on the Internet in the purchase has increased dramatically. In the field of... more
This paper studies the application of support vector machines (SVMs) to the detection and classification of rolling-element bearing faults. The training of the SVMs is carried out using the sequential minimal optimization (SMO) algorithm.... more
This paper studies the application of support vector machines (SVMs) to the detection and classification of rolling-element bearing faults. The training of the SVMs is carried out using the sequential minimal optimization (SMO) algorithm.... more
As most of human activities are being moved to cyberspace, phishers and other cybercriminals are making the cyberspace unsafe by causing serious risks to users and businesses as well as threatening global security and economy. Nowadays,... more
This paper presents a method for automatic classification of semantic relations between nominals using Sequential Minimal Optimization. We participated in the four categories of SEMEVAL task 4 (A: No Query, No Wordnet; B: Word-Net, No... more
The identification of target proteins for diseased condition yields the development of the disease detection recommender system and drug discovery processes whose reticence can demolish the pathogen. The testing of this drug discovery is... more
Medical industry produces a significant portion of data whereas by adopting various Machine Learning models it can make accurate predictions about public healthcare that can be generalised. Transfer learning improves traditional machine... more
We propose a new generative model, and a new image similarity kernel based on a linked hierarchy of probabilistic segmentations. The model is used to efficiently segment multiple images into a consistent set of image regions. The... more
As most of human activities are being moved to cyberspace, phishers and other cybercriminals are making the cyberspace unsafe by causing serious risks to users and businesses as well as threatening global security and economy. Nowadays,... more
Microblogging sites allowing disseminating distasteful content. This has become vigorous and nearly unstoppable now. Spreading online fake news has been identified as one of the major top concern of online abuse. Due to the difficulty in... more
As most of human activities are being moved to cyberspace, phishers and other cybercriminals are making the cyberspace unsafe by causing serious risks to users and businesses as well as threatening global security and economy. Nowadays,... more
Recent empirical evidence suggests that the Weston-Watkins support vector machine is among the best performing multiclass extensions of the binary SVM. Current state-of-the-art solvers repeatedly solve a particular subproblem... more
Recent empirical evidence suggests that the Weston-Watkins support vector machine is among the best performing multiclass extensions of the binary SVM. Current state-of-the-art solvers repeatedly solve a particular subproblem... more
In this study, an analysis was performed by examining the wind power potential of Kirklareli province which is in the west of Turkey. Statistical data between 2001 and 2007 was used in this study. The data was obtained from Kirklareli... more
As most of human activities are being moved to cyberspace, phishers and other cybercriminals are making the cyberspace unsafe by causing serious risks to users and businesses as well as threatening global security and economy. Nowadays,... more
In this study, an analysis was performed by examining the wind power potential of Kirklareli province which is in the west of Turkey. Statistical data between 2001 and 2007 was used in this study. The data was obtained from Kirklareli... more
Sistem deteksi kantuk dirancang menggunakan Elektrokardiogram (EKG) dengan Jaringan Saraf Tiruan Radial Basis Function dan Particle Swarm Optimization (JST RBF-PSO). Karolinska Sleepiness Scale (KSS) menjadi acuan tingkat kantuk yang... more
Nowadays, phone or smartphone and internet are something that cannot be separated with human. One of negative effects of using internet is cyber crime like a phishing url. Phishing url is usually used to collecting personal information... more
Kernel descriptors [1] provide a unified way to generate rich visual feature sets by turning pixel attributes into patch-level features, and yield impressive results on many object recognition tasks. However, best results with kernel... more
We hypothesize that machine-learning algorithms (MLA) can classify completer and simulated suicide notes as well as mental health professionals (MHP). Five MHPs classified 66 simulated or completer notes; MLAs were used for the same task.... more
Web phishing is a type of cybercrime that occasionally threatens the online activities of website visitors. Web phishing uses a phoney website page that closely mimics the legitimate Website in order to fool its target into providing... more
Corporate credit rating analysis is one of the most important financial problems, which has attracted lots of research interests in the literature. Recent studies have shown that Artificial Intelligence (AI) methods can achieve better... more
We hypothesize that machine-learning algorithms (MLA) can classify completer and simulated suicide notes as well as mental health professionals (MHP). Five MHPs classified 66 simulated or completer notes; MLAs were used for the same task.... more
The linear instability of a solar pond containing porous material in the lower convective zone (LCZ) is investigated. It is found that, in general, for physically realistic values, solar ponds that contain porous material are more stable... more
Download research papers for free!