Reinforcement Learning for Minimizing Age of Information over Wireless Links


Ceran Arslan E. T., Gündüz D., Gyorgy A.

in: Age of Information: Foundations and Applications, Nikolaos Pappas,Mohamed A. Abd-Elmagid,Bo Zhou,Walid Saad,Harpreet S. Dhillon, Editor, Cambridge University Press, Cambridge (MA), USA , Cambridge, pp.327-362, 2022

  • Publication Type: Book Chapter / Chapter Research Book
  • Publication Date: 2022
  • Publisher: Cambridge University Press, Cambridge (MA), USA 
  • City: Cambridge
  • Page Numbers: pp.327-362
  • Editors: Nikolaos Pappas,Mohamed A. Abd-Elmagid,Bo Zhou,Walid Saad,Harpreet S. Dhillon, Editor
  • Middle East Technical University Affiliated: Yes

Abstract

In this chapter, we study the age of information (AoI) when status updates of an underlying process of interest, sampled and recorded by a source node, must be transmitted to one or more destination nodes over error-prone wireless channels. We consider the practical setting, in which the statistics of the system are not known a priori, and must be learned in an online fashion. This requires designing (RL) algorithms that can adapt their policy dynamically through interactions with the environment. Accordingly, the aim of this chapter is to design and analyze RL algorithms to minimize the average AoI at the destination nodes, taking into account retransmissions due to channel errors.