TD3
Twin Delayed Deep Deterministic
**TD3** builds on the [DDPG](https://paperswithcode.com/method/ddpg) algorithm for reinforcement learning, with a couple of modifications aimed at tackling overestimation bias with the value function. In particular, it utilises [clipped double Q-learning](https://paperswithcode.com/method/clipped-double-q-learning), delayed update of target and policy networks, and [target policy smoothing](https://paperswithcode.com/method/target-policy-smoothing) (which is similar to a [SARSA](https://paperswithcode.com/method/sarsa) based update; a safer update, as they provide higher value to actions resistant to perturbations).
Addressing Function Approximation Error in Actor-Critic Methods
https://paperswithcode.com/paper/addressing-function-approximation-error-in
Addressing Function Approximation Error in Actor-Critic Methods