Modern Reinforcement Learning: Actor Critic Methods from Paper to Code

Academy
Modern Reinforcement Learning: Actor Critic Methods from Paper to Code

Premium course

Advanced

Video

Actor Critic Methods

74 Lessons

0% Not started

Ready?

Modern Reinforcement Learning: Actor Critic Methods from Paper to Code

Introduction

3 Lessons

What You Will Learn in This Course

Required Background, Software, and Hardware

How to Succeed in This Course

Fundamentals of Reinforcement Learning

6 Lessons

Premium course

Review of Fundamental Concepts

Premium course

Teaching an AI about Black Jack with Monte Carlo Prediction

Premium course

Teaching an AI How to Play Black Jack with Monte Carlo Control

Premium course

Review of Temporal Difference Learning Methods

Premium course

Teaching an AI about Balance with TD(0) Prediction

Premium course

Teaching an AI to Balance the Cart Pole with Q Learning

Landing on the Moon with Policy Gradients & Actor Critic Methods

11 Lessons

Premium course

What's so Great About Policy Gradient Methods?

Premium course

Combining Neural Networks with Monte Carlo: REINFORCE Policy Gradient Algorithm

Premium course

Introducing the Lunar Lander Environment

Premium course

Coding the Agent's Brain: The Policy Gradient Network

Premium course

Coding the Policy Gradient Agent's Basic Functionality

Premium course

Coding the Agent's Learn Function

Premium course

Coding the Policy Gradient Main Loop and Watching our Agent Land on the Moon

Premium course

Actor Critic Learning: Combining Policy Gradients & Temporal Difference Learning

Premium course

Coding the Actor Critic Networks

Premium course

Coding the Actor Critic Agent

Premium course

Coding the Actor Critic Main Loop and Watching Our Agent Land on the Moon

Deep Deterministic Policy Gradients (DDPG)

16 Lessons

Premium course

Getting up to Speed With Deep Q Learning

Premium course

How to Read and Understand Cutting Edge Research Papers

Premium course

Analyzing the DDPG Paper Abstract and Introduction

Premium course

Analyzing the Background Material

Premium course

What Algorithm Are We Going to Implement?

Premium course

What Results Should We Expect?

Premium course

What Other Solutions are Out There?

Premium course

What Model Architecture and Hyperparameters Do We Need?

Premium course

Handling the Explore-Exploit Dilemma: Coding the OU Action Noise Class

Premium course

Giving our Agent a Memory: Coding the Replay Memory Buffer Class

Premium course

Deep Q Learning for Actor Critic Methods: Coding the Critic Network Class

Premium course

Coding the Actor Network Class

Premium course

Giving our DDPG Agent Simple Autonomy: Coding the Basic Functions of Our Agent

Premium course

Giving our DDPG Agent a Brain: Coding the Agent's Learn Function

Premium course

Coding the Network Parameter Update Functionality

Premium course

Coding the Main Loop and Watching Our DDPG Agent Land on the Moon

Twin Delayed Deep Deterministic Policy Gradients (TD3)

12 Lessons

Premium course

Some Tips on Reading this Paper

Premium course

Analyzing the TD3 Paper Abstract and Introduction

Premium course

What Other Solutions Have People Tried?

Premium course

Reviewing the Fundamental Concepts

Premium course

Is Overestimation Bias Even a Problem in Actor-Critic Methods?

Premium course

Why is Variance a Problem for Actor-Critic Methods?

Premium course

What Results Can We Expect?

Premium course

Coding the Brains of the TD3 Agent - The Actor and Critic Network Classes

Premium course

Giving our TD3 Agent Simple Autonomy - Coding the Basic Agent Functionality

Premium course

Giving our TD3 Agent a Brain - Coding the Learn Function

Premium course

Coding the Network Parameter Update Functionality

Premium course

Coding the Main Loop And Watching our Agent Learn to Walk

Soft Actor Critic (SAC)

10 Lessons

Premium course

A Quick Word on the Paper

Premium course

Getting Acquainted With a New Framework for Learning

Premium course

Checking Out What Has Been Done Before

Premium course

Inspecting the Foundation of this New Framework

Premium course

Digging Into the Mathematics of Soft Actor Critic

Premium course

Seeing How the New Algorithm Measures Up

Premium course

Coding the Neural Networks

Premium course

Coding the Soft Actor Critic Basic Functionality

Premium course

Coding the Soft Actor Critic Algorithm

Premium course

Coding the Main Loop and Evaluating Our Agent

Tensorflow 2 Implementations

14 Lessons

Premium course

Coding the Policy Gradient Network in Tensorflow 2

Premium course

Coding the REINFORCE Agent in Tensorflow 2

Premium course

Coding the REINFORCE Main Loop and Evaluating Our Agent

Premium course

Coding the Actor Critic Network in Tensorflow 2

Premium course

Coding the Actor Critic Agent in Tensorflow 2

Premium course

Coding the Actor Critic Main Program and Evaluating our Agent

Premium course

Coding the DDPG Networks in Tensorflow 2

Premium course

Coding the DDPG Agent in Tensorflow 2

Premium course

Coding the DDPG Main Function and Evaluating our Agent

Premium course

Coding the TD3 Agent in Tensorflow 2

Premium course

Coding the TD3 Main Program and Evaluating Our Agent

Premium course

Coding the SAC Networks in Tensorflow 2

Premium course

Coding the SAC Agent in Tensorflow 2

Premium course

Coding the SAC Main Function and Evaluating our Agent

Appendix

2 Lessons

Premium course

Making our Virtual Environment

Premium course

Making our Agent Compliant with the New Gym Interface

Follow

About the teacher

phil

In 2012 I received my PhD in experimental condensed matter physics from West Virginia University. Following that I was a dry etch process engineer for Intel Corporation, where I leveraged big data to make essential process improvements for mission critical products. After leaving Intel in 2015, I have worked as a contract and freelance deep learning and artificial intelligence engineer.

Leave a Reply Cancel reply