Robot Planning

SkillWrapper: Autonomously Learning Interpretable Skill Abstractions with Foundation Models

Seeing is Believing: Belief-Space Planning with Foundation Models as Uncertainty Estimators

We integrate perception and task planning under belief-space planning to enable strategic information gathering in open-world environments, where vision-language foundation models are used to estimate the state and its uncertainty.

Learning to Navigate in Mazes with Novel Layouts Using Abstract Top-down Maps

This work learns to navigate end-to-end with map input, aiming to generalize to novel map layouts in zero-shot.

Practice Makes Perfect: Planning to Learn Skill Parameter Policies

We enable a robot to rapidly and autonomously specialize parameterized skills by planning to practice them. The robot decides what skills to practice and how to practice them. The robot is left alone for hours, repeatedly practicing and improving.

Integrating Symmetry into Differentiable Planning with Steerable Convolutions

We formulate how differentiable planning algorithms can exploit inherent symmetry in path planning problems, named SymPlan, and propose practical algorithms.