Academic Journal
Dilated multi-Layer perceptron mixer for faster neural networks.
| Τίτλος: | Dilated multi-Layer perceptron mixer for faster neural networks. |
|---|---|
| Συγγραφείς: | Hoang VD; Faculty of Information Technology, Ho Chi Minh City University of Technology and Engineering, Ho Chi Minh City, Vietnam. Electronic address: dunghv@hcmute.edu.vn., Vo XT; Department of Electrical Electronic and Computer Engineering, University of Ulsan, Ulsan, South Korea., Jo KH; Department of Electrical Electronic and Computer Engineering, University of Ulsan, Ulsan, South Korea. |
| Πηγή: | Neural networks : the official journal of the International Neural Network Society [Neural Netw] 2026 Sep; Vol. 201, pp. 108939. Date of Electronic Publication: 2026 Apr 03. |
| Τύπος έκδοσης: | Journal Article |
| Γλώσσα: | English |
| Στοιχεία περιοδικού: | Publisher: Pergamon Press Country of Publication: United States NLM ID: 8805018 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1879-2782 (Electronic) Linking ISSN: 08936080 NLM ISO Abbreviation: Neural Netw Subsets: MEDLINE |
| Imprint Name(s): | Original Publication: New York : Pergamon Press, [c1988- |
| Ιατρικοί όροι (MeSH): | Image Processing, Computer-Assisted*/methods , Multilayer Perceptrons* , Neural Networks, Computer*, Algorithms |
| Περίληψη: | Multi-Layer Perceptron Mixer (MLP-Mixer) has replaced self-attention layers with simple spatial MLP and achieved promising performances across visual tasks. However, existing MLP-Mixer methods have quadratic complexity with image resolutions and only process the input with a fixed size. When transferring pre-trained MLP-Mixer to downstream tasks, the model creates high computational costs and requires further operations to interpolate the MLP weights. This paper addresses these issues by proposing Dilated MLP-Mixers (DMLP) method, faster backbones for image classification and downstream tasks. DMLP backbone performs spatial mixing on non-overlapped and dilated windows to achieve better efficiency while exchanging information across windows. Unlike the MLP-based traditional approaches such as the Spatial MLP-Mixer architecture, the proposed method creates sparse and cross-connections between windows in the window MLP-Mixer block, known as the dilated windows. This approach allows for reducing the number of windows while it does not increase the number of connections within windows compared to previous approaches. This design has flexibility to architecture at different input sizes and results in linear complexity with image resolutions. The proposed method has been validated in the domain of automobile insurance and car damage recognition. Extensive experiments were conducted on benchmark datasets to evaluate its performance. Results indicate that the proposed DMLP backbone achieves performance comparable to MLP and Transformer models while demonstrating superior processing speed. Comparative evaluations reveal that the proposed method outperforms recent approaches in terms of both accuracy and computational efficiency. Furthermore, this method shows potential for application in systems with limited computational resources. (Copyright © 2026 Elsevier Ltd. All rights reserved.) |
| Competing Interests: | Declaration of competing interest The authors declare that we have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. |
| Contributed Indexing: | Keywords: Deep learning; Image classification; Instance segmentation; MLP-Mixer; Object detection |
| Entry Date(s): | Date Created: 20260408 Date Completed: 20260612 Latest Revision: 20260622 |
| Update Code: | 20260622 |
| DOI: | 10.1016/j.neunet.2026.108939 |
| PMID: | 41950876 |
| Βάση Δεδομένων: | MEDLINE |
καταχωρήστε σχόλιο πρώτοι!