Inferring effort-safety trade off in perturbed squat-to-stand task by reward parameter estimation


Arditi E., Kunavar T., Amirshirzad N., UĞUR E., Babic J., Oztop E.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, cilt.142, 2025 (SCI-Expanded, Scopus)

Özet

In this study, an inverse reinforcement learning (IRL) method is developed to estimate the parameters of a reward function that is assumed to guide the movement of a biological or artificial agent. The workings of the method is shown on the problem of estimating the effort-safety trade-off of humans during perturbed squat-to-stand motions based on their Center of Mass (COM) trajectories. The proposed method involves data generation by reinforcement learning (RL) and a novel data augmentation mechanism followed by neural network training. After the training, the neural network acts as the reward parameter estimator given the Center of Mass (COM) trajectories as input. The performance of the developed method is assessed through systematic simulation experiments, where it is shown that the parameter estimation made by our method is significantly more accurate than the baseline of an optimized template-based IRL approach. In addition, as a proof of concept, a set of human movement data is analyzed with the developed method. The results revealed that most participants acquired a strategy that ensures low effort expenditure with a safety margin, producing COM trajectories slightly away from the effort-optimal.