Papers explaining the limitations of Q-learning and the deep Q-network

Web: https://www.reddit.com/r/reinforcementlearning/comments/un6jiz/papers_explaining_the_limitations_of_qlearning/

Hi!

I am currently working on my master thesis that includes custom-made environments for Q-learning and a deep Q-network from Mnih et al. (2015). One of the limitations of my custom-made environment is that the state and action space increases rapidly. For the Q-learning solution, the size of the Q-table becomes enormous with millions to billions of possible states, while the deep Q-network suffers from catastrophic forgetting. Furthermore, the size of the replay memory (1 million experiences) is not enough …

deep learning network q-learning reinforcementlearning