FPGA-based infrared image deblurring using angular position of IR detector


Doner T., GÖKCEN D.

VISUAL COMPUTER, vol.37, no.7, pp.2039-2050, 2021 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 37 Issue: 7
  • Publication Date: 2021
  • Doi Number: 10.1007/s00371-020-01961-y
  • Journal Name: VISUAL COMPUTER
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Applied Science & Technology Source, Computer & Applied Sciences, INSPEC, zbMATH
  • Page Numbers: pp.2039-2050
  • Keywords: Infrared imaging, Blur, FPGA, Point spread function, IMU
  • Middle East Technical University Affiliated: No

Abstract

The motion of the object or the infrared (IR) imaging system during the integration time causes blurring of the IR image. This study covers real-time field programmable gate array (FPGA)-based deblurring for IR detectors, and an inertial measurement unit (IMU) was used to quantify the blur caused by the IR detector movement. Point spread function for each pixel was calculated using the angular position data of the IR detector obtained from IMU. Both spatially invariant and spatially variant blur cases can be modeled for the IR detector motion. After the quantification, the spatially invariant-type blur was eliminated using a Wiener filter-based deblurring algorithm. Deblurring algorithm was implemented in the Xilinx system generator environment directly using FPGA IP cores. The simulation results in the Xilinx system generator environment indicate that the proposed image deblurring method is real-time applicable, and it reduces the processing time of a single frame to 4 ms. For the implementation of 2D-fast Fourier transform design in FPGA using the corner turn matrix method, memory management is the most critical factor influencing the speed. The real-time deblurring solution given herein has the potential to be used in IR cameras on the moving platforms to increase the performance and robustness in systems such as object tracking and visual navigation.