Review and evaluation of player detection methods in field sports: Comparing conventional and deep learning based methods


Şah M., Direkoğlu C.

Multimedia Tools and Applications, 2021 (Journal Indexed in SCI) identifier identifier

  • Publication Type: Article / Article
  • Volume:
  • Publication Date: 2021
  • Doi Number: 10.1007/s11042-021-11071-z
  • Title of Journal : Multimedia Tools and Applications
  • Keywords: Convolutional neural networks, Deep learning, Player detection methods, Polar transformed shape information image, Shape information image, Faster R-CNN, Single shot detector, Yolo, TRACKING

Abstract

© 2021, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.In order to analyse field sport videos, accurate player detection is essential. If players’ positions are identified correctly in video frames, the higher level analysis such as event detection, activity and performance analysis will be more accurate. For player detection, many methods have been presented until now with varying performances and under different evaluation settings. Convolutional Neural Networks (CNN) became very popular for object recognition and detection. Generally, CNN approaches use Gray or RGB image representations for detection. However, other image representations such as shape information image (SIM) and polar transformed shape information image (PSIM) can also be utilized for player detection. Furthermore, recent deep neural networks such as Faster R-CNN, Single Shot Detector (SSD) and Yolo can be applied for player detection using transfer learning. The aim of this study is to investigate and compare the performances of conventional methods, CNNs with different image representations and complex deep learning methods under the same evaluation settings, and on two field hockey datasets. We compare performances for different overlap ratios and for different occlusion cases. This is the first time an extensive evaluation, review and comparison have been conducted for player detection in field sports.