Λεπτομέρειες βιβλιογραφικής εγγραφής
| Τίτλος: |
Multimodal Fusion Image Stabilization Algorithm for Bio-Inspired Flapping-Wing Aircraft. |
| Συγγραφείς: |
Wang, Zhikai, Wang, Sen, Hu, Yiwen, Zhou, Yangfan, Li, Na, Zhang, Xiaofeng |
| Πηγή: |
Biomimetics (2313-7673); Jul2025, Vol. 10 Issue 7, p448, 25p |
| Θεματικοί όροι: |
Image stabilization, Multisensor data fusion, Inertial navigation systems, Long short-term memory, Ornithopters, Camera movement |
| Περίληψη: |
This paper presents FWStab, a specialized video stabilization dataset tailored for flapping-wing platforms. The dataset encompasses five typical flight scenarios, featuring 48 video clips with intense dynamic jitter. The corresponding Inertial Measurement Unit (IMU) sensor data are synchronously collected, which jointly provide reliable support for multimodal modeling. Based on this, to address the issue of poor image acquisition quality due to severe vibrations in aerial vehicles, this paper proposes a multi-modal signal fusion video stabilization framework. This framework effectively integrates image features and inertial sensor features to predict smooth and stable camera poses. During the video stabilization process, the true camera motion originally estimated based on sensors is warped to the smooth trajectory predicted by the network, thereby optimizing the inter-frame stability. This approach maintains the global rigidity of scene motion, avoids visual artifacts caused by traditional dense optical flow-based spatiotemporal warping, and rectifies rolling shutter-induced distortions. Furthermore, the network is trained in an unsupervised manner by leveraging a joint loss function that integrates camera pose smoothness and optical flow residuals. When coupled with a multi-stage training strategy, this framework demonstrates remarkable stabilization adaptability across a wide range of scenarios. The entire framework employs Long Short-Term Memory (LSTM) to model the temporal characteristics of camera trajectories, enabling high-precision prediction of smooth trajectories. [ABSTRACT FROM AUTHOR] |
|
Copyright of Biomimetics (2313-7673) is the property of MDPI and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| Βάση Δεδομένων: |
Complementary Index |