Primene metaheuristike zasnovane na elektromagnetizmu u rešavanju problema klasifikacije

eLibrary

 
 

Primene metaheuristike zasnovane na elektromagnetizmu u rešavanju problema klasifikacije

Show simple item record

dc.contributor.advisor Filipović, Vladimir
dc.contributor.author Kartelj, Aleksandar
dc.date.accessioned 2016-06-28T07:33:15Z
dc.date.available 2016-06-28T07:33:15Z
dc.date.issued 2014
dc.identifier.uri http://hdl.handle.net/123456789/4234
dc.description.abstract This work investigates the potential of improving the classi cation process through solving three classi cation-related problems: feature selection, feature weighting and parameter selection. All three problems are challenging and currently in the focus of scienti c researches in the eld of machine learning. Each problem is solved by using population-based metaheruistic method called electromagnetismlike method. This method is used for combinatorial and global optimization. It is inspired by laws of attraction and repulsion among charged particles. Each particle is represented by a vector of real values. The solution of the problem of interest is then obtained by mapping these real-valued vectors to the feasible solution domain. Particles representing better solutions achieve higher level of charge, which consequently produces greater impact on other particles. The search process is performed by iterating the particle movement, induced by charges. Through implementing the methods, two key aspects are managed: 1) the classi cation quality obtained after applying the optimization method and 2) the e ciency of the proposed methods from the perspective of time and space resources. All methods are equiped with problem-speci c local search procedures which tend to increase the solution quality. The bene t of applying feature selection for the classi cation process is twofold. Firstly, the elimination of unnecessary features decreases the data set noise, which degrades the quality of the classi cation model. Secondly, the problem dimension is decreased, thus the e ciency is increased. Feature selection problem is very e - ciently solved by the proposed method. The classi cation quality is in the majority of cases (instances) improved relative to the methods from literature. For some of the instances, computational times are up to several hundred times smaller than those of the competing methods. Feature weighting and parameter selection problem share similar underlying solution representation, based on the vectors of real values. Since the representation of charged particles is based on the same underlying domain, the transition from the particle to the solution domain behaves smoothly. The quality of the method for iv feature weighting is demonstrated through nearest neighbors classi cation model. The testing of the method is conducted on di erent collection of instances, and after that, the comparison to several methods from literature is made. In the majority of cases, the proposed method outperformed the comparison methods. The parameter selection, in classi cation, has a great impact on the classi cation quality. The proposed method for parameter selection is applied on the support vector machihe, which has a complex parametric structure when the number of parameters and the size of their domains is in question. By using heuristic initialization procedure, the detection of high quality regions for parameter combinations is accelerated. Exhaustive tests are performed on various instances in terms of their dimension and feature structure: homogenous and heterogeneous. Single kernel learning is adopted for homogenous, and multiple kernel learning for heterogeneous instances. The comparison with methods from literature showed superiority of the proposed method when single and multiple kernel learning based on radial basis function is considered. The method shows to be competitive in other cases. All proposed methods improved the classi cation quality. Because of the way, the problem is being solved, all three methods can be generalized and applied to a wide class of classi cation models and/or classi cation problem. en_US
dc.description.provenance Submitted by Slavisha Milisavljevic (slavisha) on 2016-06-28T07:33:15Z No. of bitstreams: 1 phdAleksandarKartelj.pdf: 2121721 bytes, checksum: fb30a9dba9103fe0fdc2bbd13ada79fa (MD5) en
dc.description.provenance Made available in DSpace on 2016-06-28T07:33:15Z (GMT). No. of bitstreams: 1 phdAleksandarKartelj.pdf: 2121721 bytes, checksum: fb30a9dba9103fe0fdc2bbd13ada79fa (MD5) Previous issue date: 2014 en
dc.language.iso sr en_US
dc.publisher Beograd en_US
dc.title Primene metaheuristike zasnovane na elektromagnetizmu u rešavanju problema klasifikacije en_US
mf.author.birth-date 1986-11-10
mf.author.birth-place Novi Kneževac en_US
mf.author.birth-country Srbija en_US
mf.author.residence-state Srbija en_US
mf.author.citizenship Srpsko en_US
mf.author.nationality Srbin en_US
mf.subject.area Computer science en_US
mf.subject.keywords classi cation, electromagnetism, data mining, metaheuristics, machine learning, optimization en_US
mf.subject.subarea Optimization en_US
mf.contributor.committee Tošić, Dušan
mf.contributor.committee Milutinović, Veljko
mf.contributor.committee Mitić, Nenad
mf.contributor.committee Malkov, Saša
mf.university.faculty Mathematical Faculty en_US
mf.document.references 93 en_US
mf.document.pages 125 en_US
mf.document.location Beograd en_US
mf.document.genealogy-project No en_US
mf.university Belgrade University en_US

Files in this item

Files Size Format View
phdAleksandarKartelj.pdf 2.121Mb PDF View/Open

This item appears in the following Collection(s)

Show simple item record