ACER
ACER
**ACER**, or **Actor Critic with Experience Replay**, is an actor-critic deep reinforcement learning agent with [experience replay](https://paperswithcode.com/method/experience-replay). It can be seen as an off-policy extension of [A3C](https://paperswithcode.com/method/a3c), where the off-policy estimator is made feasible by:

- Using [Retrace](https://paperswithcode.com/method/retrace) Q-value estimation.
- Using truncated importance sampling with bias correction.
- Using a trust region policy optimization method.
- Using a [stochastic dueling network](https://paperswithcode.com/method/stochastic-dueling-network) architecture.
Sample Efficient Actor-Critic with Experience Replay
https://paperswithcode.com/paper/sample-efficient-actor-critic-with-experience
Sample Efficient Actor-Critic with Experience Replay