सभी किताबें

पेशेवर

ऐप्स परिचय Coach लॉग इन पढ़ना शुरू करें

Quantitative Finance · शब्दावली

Deep Q-network, experience replay, target network क्या है?

अन्य नाम: deep Q-network · experience replay · target network

Definition 18.2 Machine Learning for Markets · अध्याय 18 — Reinforcement Learning for Execution and Market Making

A deep Q-network (DQN) is Q-learning (chapter 17) with the action-value function represented by a neural network, trained by stochastic gradient steps on the temporal-difference error (Mnih and co-authors, 2015). Two stabilisers make it work: experience replay stores past transitions and trains on random batches of them, breaking the correlation of consecutive steps; a target network is a copy of the network, updated only every few hundred steps, used to compute the learning targets so that they do not move with every update.

अध्याय में पढ़ें →