DeepDuoHDR: A Low Complexity Two Exposure Algorithm for HDR Deghosting on Mobile Devices


ALPAY K. C., AKYÜZ A. O., Brandonisio N., Meehan J., Chalmers A.

IEEE Transactions on Image Processing, vol.33, pp.6592-6606, 2024 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 33
  • Publication Date: 2024
  • Doi Number: 10.1109/tip.2024.3497838
  • Journal Name: IEEE Transactions on Image Processing
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Aerospace Database, Applied Science & Technology Source, Business Source Elite, Business Source Premier, Communication Abstracts, Compendex, Computer & Applied Sciences, EMBASE, INSPEC, MEDLINE, Metadex, zbMATH, Civil Engineering Abstracts
  • Page Numbers: pp.6592-6606
  • Keywords: deep networks, deghosting, HDR imaging, mobile devices
  • Middle East Technical University Affiliated: Yes

Abstract

The increased interest in consumer-grade high dynamic range (HDR) images and videos in recent years has caused a proliferation of HDR deghosting algorithms. Despite numerous proposals, a fast, memory-efficient, and robust algorithm has been difficult to achieve. This paper addresses this problem by leveraging the power of attention and U-Net-based neural representations and using a conservative deghosting strategy. Given two bracketed exposures of a scene, we produce an HDR image that maximally resembles the high exposure where it is well-exposed and fuses aligned information from both exposures otherwise. We evaluate the performance of our algorithm under several different challenging scenarios, using both visual and quantitative results, and show that it matches the state-of-the-art algorithms despite using only two exposures and having significantly lower computational complexity. Furthermore, the parameters of our algorithm greatly simplify deploying its different versions for devices with a variety of computational constraints, including mobile devices.