Bi-directional 2-D mesh representation for video object rendering, editing and superresolution in the presence of occlusion

EREN P. E., Tekalp A.

SIGNAL PROCESSING-IMAGE COMMUNICATION, cilt.18, sa.5, ss.321-336, 2003 (SCI-Expanded) identifier identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 18 Sayı: 5
  • Basım Tarihi: 2003
  • Doi Numarası: 10.1016/s0923-5965(02)00129-7
  • Dergi Adı: SIGNAL PROCESSING-IMAGE COMMUNICATION
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.321-336
  • Anahtar Kelimeler: video processing, video editing, superresolution, 2-D mesh, occlusion, TRACKING, MOTION, RECONSTRUCTION, SEQUENCES
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

In this paper, we propose a new bi-directional 2-D mesh representation of video objects, which utilizes forward and backward reference frames (keyframes). This framework extends the previous uni-directional mesh representation to enable efficient rendering, editing, and superresolution of video objects in the presence of occlusion by allowing bidirectional texture mapping as in MPEG B-frames. The video object of interest is tracked between two successive keyframes (which can be automatically or interactively selected) both in forward and backward directions. Keyframes provide the texture of the video object, whereas its motion is modeled by forward and backward 2-D meshes. In addition, we employ "validity maps", associated with each 2-D mesh, which allow selective texture mapping from the keyframes. Experimental results for efficient video object editing and object-based video resolution enhancement in the presence of self-occlusion are presented to demonstrate the effectiveness of the proposed representation. (C) 2002 Elsevier Science B.V. All rights reserved.