in: Age of Information: Foundations and Applications, Nikolaos Pappas,Mohamed A. Abd-Elmagid,Bo Zhou,Walid Saad,Harpreet S. Dhillon, Editor, Cambridge University Press, Cambridge (MA), USA , Cambridge, pp.327-362, 2022
In this chapter, we study the age of information (AoI) when status updates of an underlying process of interest, sampled and recorded by a source node, must be transmitted
to one or more destination nodes over error-prone wireless channels. We consider the
practical setting, in which the statistics of the system are not known a priori, and must
be learned in an online fashion. This requires designing (RL) algorithms that can adapt
their policy dynamically through interactions with the environment. Accordingly, the
aim of this chapter is to design and analyze RL algorithms to minimize the average AoI at the destination nodes, taking into account retransmissions due to channel
errors.