Document detail
ID
oai:arXiv.org:2410.05500
Topic
Computer Science - Computer Vision... Computer Science - Artificial Inte... Computer Science - Machine Learnin... I.2.10 I.4.10 I.4.3 I.4.9Author
Yu, Ray Congrui Wu, Sherry Gui, JiangCategory
Computer Science
Year
2024
listing date
3/12/2025
Keywords
network layers science computerAbstract
Despite their immense success, deep neural networks (CNNs) are costly to train, while modern architectures can retain hundreds of convolutional layers in network depth.
Standard convolutional operations are fundamentally limited by their linear nature along with fixed activations, where multiple layers are needed to learn complex patterns, making this approach computationally inefficient and prone to optimization difficulties.
As a result, we introduce RKAN (Residual Kolmogorov-Arnold Network), which could be easily implemented into stages of traditional networks, such as ResNet.
The module also integrates polynomial feature transformation that provides the expressive power of many convolutional layers through learnable, non-linear feature refinement.
Our proposed RKAN module offers consistent improvements over the base models on various well-known benchmark datasets, such as CIFAR-100, Food-101, and ImageNet.
;Comment: Code is available at https://github.com/withray/residualKAN.git
Yu, Ray Congrui,Wu, Sherry,Gui, Jiang, 2024, Residual Kolmogorov-Arnold Network for Enhanced Deep Learning
Critical Prognostic Factors in Cerebral Venous Sinus Thrombosis: An Observational Study
thrombosis 001 p<0 involvement sinus prognostic study factors outcome poor associated
