SegIns: A simple extension to instance discrimination task for better localization learning


Baydar M., AKBAŞ E.

Journal of Visual Communication and Image Representation, vol.100, 2024 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 100
  • Publication Date: 2024
  • Doi Number: 10.1016/j.jvcir.2024.104122
  • Journal Name: Journal of Visual Communication and Image Representation
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, PASCAL, Applied Science & Technology Source, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC
  • Keywords: Contrastive learning, Instance discrimination task, Non-contrastive learning, Object detection, Self-supervised learning, Semantic segmentation
  • Middle East Technical University Affiliated: Yes

Abstract

Recent self-supervised learning methods, where instance discrimination task is a fundamental way of pretraining convolutional neural networks (CNN), excel in transfer learning performance. Even though instance discrimination task is a well suited pretraining method for classification with its image-level learning, lack of dense representation learning makes it sub-optimal for localization tasks such as object detection. In this paper, we aim to mitigate this shortcoming of instance discrimination task by extending it to jointly learn dense representations alongside image-level representations. We add a segmentation branch parallel to the image-level learning to predict class-agnostic masks, enhancing location-awareness of the representations. We show the effectiveness of our pretraining approach on localization tasks by transferring the learned representations to object detection and segmentation tasks, providing relative improvements by up to 1.7% AP on PASCAL VOC and 0.8% AP on COCO object detection, 0.8% AP on COCO instance segmentation and 3.6% mIoU on PASCAL VOC semantic segmentation respectively.