Bibliographic Details
| Title: |
Real-Time Block-Based Embedded CNN for Gesture Classification on an FPGA. |
| Authors: |
Wang, Ching-Chen, Ding, Yu-Chun, Chiu, Ching-Te, Huang, Chao-Tsung, Cheng, Yen-Yu, Sun, Shih-Yi, Cheng, Chih-Han, Kuo, Hsueh-Kai |
| Source: |
IEEE Transactions on Circuits & Systems. Part I: Regular Papers; Oct2021, Vol. 68 Issue 10, p4182-4193, 12p |
| Subject Terms: |
Gesture, Convolutional neural networks, Kinect (Motion sensor), Gate array circuits, Field programmable gate arrays |
| Geographic Terms: |
Americas |
| Abstract: |
This paper presents a block-based embedded convolutional neural network (CNN) for gesture classification on field-programmable gate array (FPGA) in real time. Gesture recognition is an important tool to spontaneous interact with human machine interface. Many CNN architectures using RGB images have been proposed for gesture classification. RGB based gesture classification may cause incorrect results under insufficient light or similar gestures. In addition, most of the CNN architectures cannot run in real time on edge devices due to their large number of parameters and DRAM data access. In this paper, a block-based CNN using RGB-D data is proposed for gesture classification. Adding depth images to RGB images boots the classification accuracy. A CNN architecture with block-based feature maps is built for embedded FPGA implementations. The total number of parameters of the proposed RGB-D embedded CNN (eCNN) model is only 0.17M and it achieves 99.96% and 99.88% accuracy with 32-bit floating point and 8-bit fixed point implementation for America Sign Language (ASL) data set. The RTL simulation of the proposed eCNN model has the average inference speed of 0.171 milliseconds at frequency of 250MHz for a single pair RGB-D image. Implemented on a FPGA integrated with Microsoft Kinect v2 achieve an inference time in 19.42 ms which achieves high accuracy and real-time performance. [ABSTRACT FROM AUTHOR] |
|
Copyright of IEEE Transactions on Circuits & Systems. Part I: Regular Papers is the property of IEEE and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Database: |
Complementary Index |