Generalization in transfer learning: robust control of robot locomotion


Ada S. E., UĞUR E., Akin H. L.

ROBOTICA, cilt.40, sa.11, ss.3811-3836, 2022 (SCI-Expanded, Scopus)

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 40 Sayı: 11
  • Basım Tarihi: 2022
  • Doi Numarası: 10.1017/s0263574722000625
  • Dergi Adı: ROBOTICA
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Applied Science & Technology Source, Communication Abstracts, Compendex, Computer & Applied Sciences, INSPEC, Metadex, DIALNET, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.3811-3836
  • Açık Arşiv Koleksiyonu: AVESİS Açık Erişim Koleksiyonu
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

In this paper, we propose a set of robust training methods for deep reinforcement learning to transfer learning acquired in one control task to a set of previously unseen control tasks. We improve generalization in commonly used transfer learning benchmarks by a novel sample elimination technique, early stopping, and maximum entropy adversarial reinforcement learning. To generate robust policies, we use sample elimination during training via a method we call strict clipping. We apply early stopping, a method previously used in supervised learning, to deep reinforcement learning. Subsequently, we introduce maximum entropy adversarial reinforcement learning to increase the domain randomization during training for a better target task performance. Finally, we evaluate the robustness of these methods compared to previous work on simulated robots in target environments where the gravity, the morphology of the robot, and the tangential friction coefficient of the environment are altered.