In 2012 I received my PhD in experimental condensed matter physics from West Virginia University. Following that I was a dry etch process engineer for Intel Corporation, where I leveraged big data to make essential process improvements for mission critical products. After leaving Intel in 2015, I have worked as a contract and freelance deep learning and artificial intelligence engineer.

Advanced Replay Memory Strategies

Ready?

Advanced Replay Memory Strategies

Hindsight Experience Replay

Overview of the Paper

Paper Abstract and Introduction

Background Material

The Hindsight Experience Replay Algorithm

Coding the BitFlip Environment

Coding the Hindsight Experience Replay Class

Testing the BitFlip Environment with Deep Q Learning

Getting Famliar with the Robotic Environments

Checking Out Their Experimental Results

Hindsight Sampling Strategies

Related Works and Conclusions

Experimental Details and Hyperparameterse

Coding the Normalizer Class

Implementing the DDPG Agent

Adding Multithreading and Evaluating our Agent

Prioritized Experience Replay

Overview of Prioritized Experience Replay

Paper Abstract and Introduction

Prioritized Experience Replay

Coding the Max Heap Data Structure

Results in the Atari Library

Discussion, Extensions, and Conclusions

Coding the Basic Max Heap Functionality

Coding the Rank Based Prioritized Experience Replay

Testing our Rank Based Prioritized Experience Replay

Coding the Sum Tree Data Structure

Testing the Sum Tree in the Cartpole Environment

Testing the Sum Tree in Space Invaders

About the teacher

phil