From Noon to Sunset: Interactive Rendering, Relighting, and Recolouring of Landscape Photographs by Modifying Solar Position

Ture M., Ciklabakkal M. E., Erdem A., Erdem E., SATILMIŞ P., AKYÜZ A. O.

COMPUTER GRAPHICS FORUM, cilt.40, sa.6, ss.500-515, 2021 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 40 Sayı: 6
  • Basım Tarihi: 2021
  • Doi Numarası: 10.1111/cgf.14392
  • Dergi Adı: COMPUTER GRAPHICS FORUM
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, ABI/INFORM, Aerospace Database, Applied Science & Technology Source, Art Source, Business Source Elite, Business Source Premier, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, Metadex, zbMATH, DIALNET, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.500-515
  • Anahtar Kelimeler: image, video editing, image and video processing, atmospheric effects, rendering, CLOUD DETECTION METHOD, COLOR, IMAGES
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Image editing is a commonly studied problem in computer graphics. Despite the presence of many advanced editing tools, there is no satisfactory solution to controllably update the position of the sun using a single image. This problem is made complicated by the presence of clouds, complex landscapes, and the atmospheric effects that must be accounted for. In this paper, we tackle this problem starting with only a single photograph. With the user clicking on the initial position of the sun, our algorithm performs several estimation and segmentation processes for finding the horizon, scene depth, clouds, and the sky line. After this initial process, the user can make both fine- and large-scale changes on the position of the sun: it can be set beneath the mountains or moved behind the clouds practically turning a midday photograph into a sunset (or vice versa). We leverage a precomputed atmospheric scattering algorithm to make all of these changes not only realistic but also in real-time. We demonstrate our results using both clear and cloudy skies, showing how to add, remove, and relight clouds, all the while allowing for advanced effects such as scattering, shadows, light shafts, and lens flares.