Open in app

Sign In

Write

Sign In

Ahmed El-Khouly
Ahmed El-Khouly

8 Followers

Home

About

Nov 23, 2020

Reinforcement Learning Digest Part 4: Deep Q-Network(DQN) and Double Deep Q-Networks(DDQN)

In last article, we have discussed Q-learning and we have seen its desirable convergence attributes. Never the less, Q-learning has one fundamental limitation preventing it from being applicable to more complex RL tasks. During learning, Q-learning keeps the Q-value for every state-action pair. In FrozenLake with 4x4 grid, there are…

Reinforcement Learning

3 min read

Reinforcement Learning Digest Part 4: Deep Q-Network(DQN) and Double Deep Q-Networks(DDQN)
Reinforcement Learning Digest Part 4: Deep Q-Network(DQN) and Double Deep Q-Networks(DDQN)
Reinforcement Learning

3 min read


Nov 22, 2020

Reinforcement Learning Digest Part 3: SARSA & Q-learning

In the last article I have explained generalized policy iteration process and described our first reinforcement learning algorithm: Mote Carlo. In this article we will discuss the drawbacks of Monte Carlo and explore two other algorithms that can help the agent overcome shortcomings of Monte Carlo. Monte Carlo algorithm learns…

Reinforcement Learning

3 min read

Reinforcement Learning Digest Part 3: SARSA & Q-learning
Reinforcement Learning Digest Part 3: SARSA & Q-learning
Reinforcement Learning

3 min read


Nov 22, 2020

Reinforcement Learning Digest Part 2: Bellman Equations, Generalized Policy Iteration and Monte Carlo

In the last article, I have introduced Reinforcement learning Markov Decision Process (MDP) framework, discounted expected rewards and value and policy functions definitions. In this article, we will continue the definition of the MDP framework explaining Bellman and Bellman optimality equations. Additionally we will have describe our first reinforcement learning…

Reinforcement Learning

5 min read

Reinforcement Learning: Bellman Equations, GPI and Monte Carlo — Part 2
Reinforcement Learning: Bellman Equations, GPI and Monte Carlo — Part 2
Reinforcement Learning

5 min read


Nov 21, 2020

Reinforcement Learning Digest Part 1: Introduction & Finite Markov Decision Process framework

Introduction Reinforcement learning is an important type of machine learning used in vast range of applications and fields including robotics, genetics, financial applications and recommendation systems to mention a few. In this series of articles, I aim at taking the reader into a journey to learn enough about this topic. The…

Reinforcement Learning

6 min read

Journey in Reinforcement Learning (Part1)
Journey in Reinforcement Learning (Part1)
Reinforcement Learning

6 min read

Ahmed El-Khouly

Ahmed El-Khouly

8 Followers

Technical lead of IBM Cognos recommenders system

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech