A COGNITIVE CAMERA SYSTEM FOR INCREASING FACE RECOGNITION PERFORMANCE IN BACKLIT CONDITIONS


Creative Commons License

Gültekin G. K., Ergül M., Hakyemez A. D., Saranlı A., Alatan A. A., Üstün İ. E.

Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies VI 2022, Berlin, Almanya, 5 - 06 Eylül 2022, cilt.12275 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 12275
  • Doi Numarası: 10.1117/12.2638909
  • Basıldığı Şehir: Berlin
  • Basıldığı Ülke: Almanya
  • Anahtar Kelimeler: Auto-Exposure (AE), Backlit, Cognitive Camera, Face Recognition, Smart Imaging
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

One of the most difficult challenges in counter-terrorism, crime fighting and surveillance mission is to accurately identify people from an image/video footage to catch shortlisted terrorists and criminals. For this purpose, imaging devices used in video surveillance systems are being improved in many aspects such as spatial resolution, frame rate, dynamic range, spectral characteristics in order to achieve better imaging performance for both monitoring and automatic detection/recognition tasks. These development efforts aim to improve the basic imaging characteristics of the device, such as the average amount of brightness/darkness of the video footage, irrespective of high-level semantic elements/knowledge such as presence and locations of monitored objects/individuals in the scene monitored by the camera. Nevertheless, strong local/global illumination variations in harsh environments result in high dynamic range in the scene and thus over-/underexposed regions in video frames. In this study, a cognitive imaging system prototype that will allow higher face recognition performance by taking into account the locations of automatically detected human faces in the scene and the local illumination conditions/dynamic range values is proposed with a developed/produced smart camera. This is achieved by developing a smart Auto-Exposure (AE) algorithm which use only the region of interest (ROI) to compute/measure the brightness of the video frame. The current ROI is selected by intelligently and sequentially traversing among the detected faces to effectively handle whole faces in the scene. The experimental results show that the proposed”cognitive” camera can achieve a dramatic increase in accuracy performance over the normal camera in the face recognition task.