In this work a large space dimension reinforcement learning (RL) approximation is developed for a Discrete Impedance Position/Force control of robot manipulators that interacts with an unknown environment model. The $Q$-value function is designed in the sense of optimal control theory. The approximator is based on normalized radial basis functions (NRBFs), and are built using the $K$-means clustering algorithm which generates a family of approximators for the $Q$-value function. The RL algorithms learn on-line the optimal impedance model which is equivalent to the desired force without any prior knowledge of the environment dynamics; this feeds a force controller and its output feeds the position controller. Real time experiments are shown using a 2 degree of freedom (DOF) pan and tilt robot and a 6-DOF force/torque (F/T) sensor.
Paper
Full text
Large space dimension Reinforcement Learning for Robot Position/Force Discrete Control
Semantic Scholar · Engineering · 2019
Abstract
In this work a large space dimension reinforcement learning (RL) approximation is developed for a Discrete Impedance Position/Force control of robot manipulators that interacts with an unknown environment model. The $Q$-value function is designed in the sense of optimal control theory. The approximator is based on normalized radial basis functions (NRBFs), and are built using the $K$-means clustering algorithm which generates a family of approximators for the $Q$-value function. The RL algorithms learn on-line the optimal impedance model which is equivalent to the desired force without any prior knowledge of the environment dynamics; this feeds a force controller and its output feeds the position controller. Real time experiments are shown using a 2 degree of freedom (DOF) pan and tilt robot and a 6-DOF force/torque (F/T) sensor.