Academic Journal
OPT-RNN-DBSVM: OPTimal Recurrent Neural Network and Density-Based Support Vector Machine
| Τίτλος: | OPT-RNN-DBSVM: OPTimal Recurrent Neural Network and Density-Based Support Vector Machine |
|---|---|
| Συγγραφείς: | Karim El Moutaouakil, Abdellatif El Ouissari, Adrian Olaru, Vasile Palade, Mihaela Ciorei |
| Πηγή: | Mathematics, Vol 11, Iss 3555, p 3555 (2023) |
| Στοιχεία εκδότη: | MDPI AG |
| Έτος έκδοσης: | 2023 |
| Συλλογή: | Directory of Open Access Journals: DOAJ Articles |
| Θεματικοί όροι: | Recurrent Neural Network (RNN), Density-Based Algorithm, Support Vector Machine (SVM), Kernel-Adatron algorithm (KA), Euler–Cauchy algorithm, Mathematics, QA1-939 |
| Περιγραφή: | When implementing SVMs, two major problems are encountered: (a) the number of local minima of dual-SVM increases exponentially with the number of samples and (b) the computer storage memory required for a regular quadratic programming solver increases exponentially as the problem size expands. The Kernel-Adatron family of algorithms, gaining attention recently, has allowed us to handle very large classification and regression problems. However, these methods treat different types of samples (i.e., noise, border, and core) in the same manner, which makes these algorithms search in unpromising areas and increases the number of iterations as well. This paper introduces a hybrid method to overcome such shortcomings, called the Optimal Recurrent Neural Network and Density-Based Support Vector Machine (Opt-RNN-DBSVM). This method consists of four steps: (a) the characterization of different samples, (b) the elimination of samples with a low probability of being a support vector, (c) the construction of an appropriate recurrent neural network to solve the dual-DBSVM based on an original energy function, and (d) finding the solution to the system of differential equations that govern the dynamics of the RNN, using the Euler–Cauchy method involving an optimal time step. Density-based preprocessing reduces the number of local minima in the dual-SVM. The RNN’s recurring architecture avoids the need to explore recently visited areas. With the optimal time step, the search moves from the current vectors to the best neighboring support vectors. It is demonstrated that RNN-SVM converges to feasible support vectors and Opt-RNN-DBSVM has very low time complexity compared to the RNN-SVM with a constant time step and the Kernel-Adatron algorithm–SVM. Several classification performance measures are used to compare Opt-RNN-DBSVM with different classification methods and the results obtained show the good performance of the proposed method. |
| Τύπος εγγράφου: | article in journal/newspaper |
| Γλώσσα: | English |
| Relation: | https://www.mdpi.com/2227-7390/11/16/3555; https://doaj.org/toc/2227-7390; https://doaj.org/article/5a8b442bb2364faf92667f8b99b3c323 |
| DOI: | 10.3390/math11163555 |
| Διαθεσιμότητα: | https://doi.org/10.3390/math11163555 https://doaj.org/article/5a8b442bb2364faf92667f8b99b3c323 |
| Αριθμός Καταχώρησης: | edsbas.85D1295B |
| Βάση Δεδομένων: | BASE |
| FullText | Text: Availability: 0 CustomLinks: – Url: https://doi.org/10.3390/math11163555# Name: EDS - BASE (ns324271) Category: fullText Text: View record from BASE |
|---|---|
| Header | DbId: edsbas DbLabel: BASE An: edsbas.85D1295B RelevancyScore: 926 AccessLevel: 3 PubType: Academic Journal PubTypeId: academicJournal PreciseRelevancyScore: 926.330688476563 |
| IllustrationInfo | |
| Items | – Name: Title Label: Title Group: Ti Data: OPT-RNN-DBSVM: OPTimal Recurrent Neural Network and Density-Based Support Vector Machine – Name: Author Label: Authors Group: Au Data: <searchLink fieldCode="AR" term="%22Karim+El+Moutaouakil%22">Karim El Moutaouakil</searchLink><br /><searchLink fieldCode="AR" term="%22Abdellatif+El+Ouissari%22">Abdellatif El Ouissari</searchLink><br /><searchLink fieldCode="AR" term="%22Adrian+Olaru%22">Adrian Olaru</searchLink><br /><searchLink fieldCode="AR" term="%22Vasile+Palade%22">Vasile Palade</searchLink><br /><searchLink fieldCode="AR" term="%22Mihaela+Ciorei%22">Mihaela Ciorei</searchLink> – Name: TitleSource Label: Source Group: Src Data: Mathematics, Vol 11, Iss 3555, p 3555 (2023) – Name: Publisher Label: Publisher Information Group: PubInfo Data: MDPI AG – Name: DatePubCY Label: Publication Year Group: Date Data: 2023 – Name: Subset Label: Collection Group: HoldingsInfo Data: Directory of Open Access Journals: DOAJ Articles – Name: Subject Label: Subject Terms Group: Su Data: <searchLink fieldCode="DE" term="%22Recurrent+Neural+Network+%28RNN%29%22">Recurrent Neural Network (RNN)</searchLink><br /><searchLink fieldCode="DE" term="%22Density-Based+Algorithm%22">Density-Based Algorithm</searchLink><br /><searchLink fieldCode="DE" term="%22Support+Vector+Machine+%28SVM%29%22">Support Vector Machine (SVM)</searchLink><br /><searchLink fieldCode="DE" term="%22Kernel-Adatron+algorithm+%28KA%29%22">Kernel-Adatron algorithm (KA)</searchLink><br /><searchLink fieldCode="DE" term="%22Euler–Cauchy+algorithm%22">Euler–Cauchy algorithm</searchLink><br /><searchLink fieldCode="DE" term="%22Mathematics%22">Mathematics</searchLink><br /><searchLink fieldCode="DE" term="%22QA1-939%22">QA1-939</searchLink> – Name: Abstract Label: Description Group: Ab Data: When implementing SVMs, two major problems are encountered: (a) the number of local minima of dual-SVM increases exponentially with the number of samples and (b) the computer storage memory required for a regular quadratic programming solver increases exponentially as the problem size expands. The Kernel-Adatron family of algorithms, gaining attention recently, has allowed us to handle very large classification and regression problems. However, these methods treat different types of samples (i.e., noise, border, and core) in the same manner, which makes these algorithms search in unpromising areas and increases the number of iterations as well. This paper introduces a hybrid method to overcome such shortcomings, called the Optimal Recurrent Neural Network and Density-Based Support Vector Machine (Opt-RNN-DBSVM). This method consists of four steps: (a) the characterization of different samples, (b) the elimination of samples with a low probability of being a support vector, (c) the construction of an appropriate recurrent neural network to solve the dual-DBSVM based on an original energy function, and (d) finding the solution to the system of differential equations that govern the dynamics of the RNN, using the Euler–Cauchy method involving an optimal time step. Density-based preprocessing reduces the number of local minima in the dual-SVM. The RNN’s recurring architecture avoids the need to explore recently visited areas. With the optimal time step, the search moves from the current vectors to the best neighboring support vectors. It is demonstrated that RNN-SVM converges to feasible support vectors and Opt-RNN-DBSVM has very low time complexity compared to the RNN-SVM with a constant time step and the Kernel-Adatron algorithm–SVM. Several classification performance measures are used to compare Opt-RNN-DBSVM with different classification methods and the results obtained show the good performance of the proposed method. – Name: TypeDocument Label: Document Type Group: TypDoc Data: article in journal/newspaper – Name: Language Label: Language Group: Lang Data: English – Name: NoteTitleSource Label: Relation Group: SrcInfo Data: https://www.mdpi.com/2227-7390/11/16/3555; https://doaj.org/toc/2227-7390; https://doaj.org/article/5a8b442bb2364faf92667f8b99b3c323 – Name: DOI Label: DOI Group: ID Data: 10.3390/math11163555 – Name: URL Label: Availability Group: URL Data: https://doi.org/10.3390/math11163555<br />https://doaj.org/article/5a8b442bb2364faf92667f8b99b3c323 – Name: AN Label: Accession Number Group: ID Data: edsbas.85D1295B |
| PLink | https://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.85D1295B |
| RecordInfo | BibRecord: BibEntity: Identifiers: – Type: doi Value: 10.3390/math11163555 Languages: – Text: English Subjects: – SubjectFull: Recurrent Neural Network (RNN) Type: general – SubjectFull: Density-Based Algorithm Type: general – SubjectFull: Support Vector Machine (SVM) Type: general – SubjectFull: Kernel-Adatron algorithm (KA) Type: general – SubjectFull: Euler–Cauchy algorithm Type: general – SubjectFull: Mathematics Type: general – SubjectFull: QA1-939 Type: general Titles: – TitleFull: OPT-RNN-DBSVM: OPTimal Recurrent Neural Network and Density-Based Support Vector Machine Type: main BibRelationships: HasContributorRelationships: – PersonEntity: Name: NameFull: Karim El Moutaouakil – PersonEntity: Name: NameFull: Abdellatif El Ouissari – PersonEntity: Name: NameFull: Adrian Olaru – PersonEntity: Name: NameFull: Vasile Palade – PersonEntity: Name: NameFull: Mihaela Ciorei IsPartOfRelationships: – BibEntity: Dates: – D: 01 M: 01 Type: published Y: 2023 Identifiers: – Type: issn-locals Value: edsbas – Type: issn-locals Value: edsbas.oa Titles: – TitleFull: Mathematics, Vol 11, Iss 3555, p 3555 (2023 Type: main |
| ResultId | 1 |