Demonstrator to show a significant quality enhancement of video captured on mobile devices


Alpay K. C.

Diğer Ülkelerden Üniversiteler Tarafından Desteklenmiş Proje, 2023 - 2025

  • Proje Türü: Diğer Ülkelerden Üniversiteler Tarafından Desteklenmiş Proje
  • Başlama Tarihi: Nisan 2023
  • Bitiş Tarihi: Ocak 2025

Proje Özeti

Of the 6.84 billion smart phones users in the world [How23], 40% regularly use their device for capturing video and of these, 40% want better quality from smartphone video recordings [Kni21]. Previous EPSRC research by Chalmers at WMG [EP1, EP2, EP3] has shown how High Dynamic Range (HDR) video can provide higher quality video because HDR imaging is able to capture the full range of lighting in the scene; there are no more under- or over-exposed regions. HDR video can be taken on modern mobile devices by capturing two or more different exposures consecutively and merging these into a single HDR video frame [DM97, BAD*17]. However, ghosting artefact can occur as it takes time to capture the multiple exposures for a single HDR frame and objects in the scene may move [KDC20].

Event cameras are bio-inspired vision sensors [LPD08]. Instead of recording the absolute scene intensity information, as in standard cameras, event cameras record the time, spatial position, and the polarity of the events that occur within the field-of-view of the camera. This has the potential for determining exactly what the movement is in a scene.

This short multidisciplinary EPSRC IAA proposal will maximise impact from previous WMG research by:

1.      Developing a demonstrator of an HDR+Event video system

2.      Showcasing the demonstrator:

a.      At the large mobile phone exhibition, ITC, 7-11 June 2023

b.     To key mobile phone stakeholders and other interested parties, including BT and Vodaphone (for which contacts already exist), at a workshop to be held at the University of Warwick

3.      Working closely with Warwick Innovations to develop an Exploitation Plan for commercialisation of the system

 

References

[BAD*17] Banterle F., Artusi A., Debattista K., Chalmers A.G. Advanced High Dynamic Range Imaging, 2nd edition, CRC Press, ISBN: 978-1-4987-0694-0, June 2017.

[DM97] Debevec, P. E. and Malik, J. “Recovering high dynamic range radiance maps from photographs” SIGGRAPH '97, ACM Press1997.

[EP1] EP/K014056/1, Chalmers (PI) with Jaguar Land Rover, “Theme 7: Visualisation and Virtual Experience”

[EP2] EP/I006192/1, Chalmers (PI), “An Embedded System for High Dynamic Range Enabled Television”

[EP2] EP/I004521/1, Chalmers (PI), “High Dynamic Range: A Step Change in Cinematography”

[How23] Howart J., “How Many People Own Smartphones (2023-2028)”, Exploding Topics, January 2023.

[KDC20] Karr B., Debattista K., Chalmers A.G. “Optical effects on HDR calibration via a multiple exposure noise-based workflow”, The Visual Computer, April 2020.

[Kni21] Knight K. “Study: 40% Using Phones For Video Capture”, Bizreport, December 2021.