🧾 Reading List for Topics in learning-based long-horizon goal reaching

By Minghao Zhang. Since I only focus on few directions, so it just covers small number of papers in deep learning areas recently (specifically, those papers are related to RL for robot manipulation). If there is anything wrong and missed, just let me know!

Table of Contents

• Core Areas
  • Hierarchical approach
  • Combine planning and RL
  • Hindsight approach
  • End-to-end approach

Core Areas

Hierarchical approach

Long-Horizon Visual Planning with Goal-Conditioned Hierarchical Predictors, NeurIPS 2020

Time-Agnostic Prediction: Predicting Predictable Video Frames, ICLR 2019

Hierarchical Foresight: Self-Supervised Learning of Long-Horizon Tasks via Visual Subgoal Generation, ICLR 2020

Planning with Goal-Conditioned Policies, NeurIPS 2019

Data-Efficient Hierarchical Reinforcement Learning, NeurIPS 2018

Near-Optimal Representation Learning for Hierarchical Reinforcement Learning, ICLR 2019

Hierarchical Reinforcement Learning with Hindsight, ICLR 2019

Solving Compositional Reinforcement Learning Problems via Task Reduction, preprint

Combine planning and RL

Mapping State Space using Landmarks for Universal Goal Reaching, NeurIPS 2019

Search on the Replay Buffer: Bridging Planning and Reinforcement Learning, NeurIPS 2019

Hindsight approach

Learning to Reach Goals via Iterated Supervised Learning, NeurIPS 2020

C-Learning: Learning to Achieve Goals via Recursive Classification, preprint

Rewriting History with Inverse RL: Hindsight Inference for Policy Improvement, NeurIPS 2020

DHER: Hindsight Experience Replay for Dynamic Goals, ICLR 2019

Exploration via Hindsight Goal Generation, NeurIPS 2019

Hindsight Experience Replay, NeurIPS 2017

Competitive Experience Replay, ICLR 2019

End-to-end approach

Universal Planning Networks, ICML 2018

Learning Latent Plans from Play, CoRL 2019