Hello

I am Linfeng Zhao (赵林风), a Postdoctoral Scholar at Stanford University, working with Prof. Mykel Kochenderfer, Prof. Jeannette Bohg, SISL, IPRL, and the Stanford Robotics Center.

I finished Ph.D. (2025) at Khoury College of Computer Sciences of Northeastern University, advised by Prof. Lawson L.S. Wong, where I closely collaborated with MIT LIS group and Prof. Leslie Kaelbling, and Prof. Robin Walters. I interned at Meta, Boston Dynamics AI Institute, Amazon, and Microsoft Research Asia. Before, I worked with Prof. Hao Su at UC San Diego (2018-19).

My research focuses on building human-level general-purpose agents that can act in the physical world—robots that navigate homes, manipulate objects, and accomplish long-horizon tasks in open-world scenarios with unseen environments and goals. I develop abstractions for decision-making that decompose complex behaviors into compositional building blocks. I develop learning and planning approaches to enable agents to reason about the world and plan their actions at decision time for scalable, generalizable, and efficient decision-making systems.

PhD Thesis (2025)

Learning and Planning with Structured Abstraction for Embodied Decision-Making

PDF

Research highlight

Retriever

We develop a programming model for closed-loop robot agents that perceive, reason, and act in parallel.

Updates

2026/10

Gave a series of talks on building composable robot systems for long-horizon manipulation. I highlighted Retriever, our programming model for closed-loop robot agents, alongside my work on robot planning and manipulation. Hosts included Carnegie Mellon University (Changliu Liu's group, AirLab, and Andrea Bajcsy's Intent Lab), Stanford (Shuran Song's group), and Nanyang Technological University (Yoonchang Sung's group).

2026/09

Presented Retriever: Closing the Perception-Reasoning-Action Loop for Long-Horizon Robot Manipulation at the Saturday Robotics World Models Reading Club (recording) and Sundae Robotics.

2026/07

Open-sourced Retriever, a programming model and runtime for composing asynchronous robot programs (paper, code, docs).

TL;DR

Agentic behavior takes more than a model call. Retriever gives perception, memory, planning, and action a shared programming model without forcing them onto one clock. In the drawer search, the robot remembers where it found the pepper and goes straight there the next time. See the demo.

2026/05

Our GEM paper, Equivariant Open-vocabulary Pick and Place via Language Kernels and Patch-level Semantic Maps, was selected as a RA-L 2025 Best Paper Award Honorable Mention.

2025/10

Relocate to California for Postdoc research at Stanford University.

Robot Demos

Research Focus

Abstraction and Representation

Learning structured representations (symmetry, compositionality) for efficient generalization.

Planning and World Modeling

Developing world models and planning algorithms for long-horizon reasoning.

Test-time Scaling

Scaling decision quality with more compute and interaction.

Mobile Manipulation

Enabling diverse manipulation skills on mobile robot platforms.

Selected Talks →

Selected Publications

MessyMem: Learning-from-Doing Memory for Mobile Manipulation

Anuva Banwasi, William Muckelroy III, Priya Sundaresan, Linfeng Zhao, Jeannette Bohg, Cherie Ho
CoRL 2026
TL;DR
MessyMem lets mobile manipulators reuse knowledge across tasks through persistent 3D scene graphs enriched with interaction outcomes and visual memories.

Action Map Policy: Learning 3D Closed-loop Manipulation via Pixel Classification

Haojie Huang*, Zhang Ye, Linfeng Zhao, Boce Hu, Mingxi Jia, Yu Qi, Ahmed Agha, Dian Wang, Robert Platt†, Robin Walters†
arXiv 2026, In submission
TL;DR
Action Map Policy casts closed-loop 3D manipulation as dense pixel classification, preserving multimodal action distributions while predicting a full action chunk in one forward pass.

Pix2Act: Image-Space Manipulation Policies with Equivariant Augmentation

Haojie Huang*, Linfeng Zhao, Haotian Liu, Zhang Ye, Si-Yuan Huang, Mingxi Jia, Boce Hu, Fangzhou Lin, Yu Qi, Dian Wang, Robin Walters†, Robert Platt†
arXiv 2026, In submission
TL;DR
Pix2Act represents manipulation as continuous image-space keypoint trajectories, enabling equivariant augmentation and robust reconstruction of closed-loop 3D actions.

Retriever: Composing the Perception-Reasoning-Action Loop for Long-Horizon Manipulation

Linfeng Zhao, Haojie Huang, Jiayuan Mao, Weiyu Liu, Lawson L. S. Wong†, Mykel J. Kochenderfer†
arXiv 2026, In submission
TL;DR
Retriever gives closed-loop robot agents a programming model for parallel, asynchronous computation. Perception, memory, reasoning, and control run concurrently in one program. Its graph specifies what each module remembers, when it runs, and which observations or actions guide its next step.

Learning and Planning with Structured Abstraction for Embodied Decision-Making

Linfeng Zhao
PhD Thesis (2025)
TL;DR
This thesis studies how structured abstractions, including symmetry, compositionality, and belief-state representations, can make learning and planning more efficient for embodied decision-making.

Seeing is Believing: Planning to Perceive with Foundation Models and Act Under Unknowns

Linfeng Zhao, Willie McClinton*, Aidan Curtis*, Nishanth Kumar, Tom Silver, Leslie Kaelbling, Lawson L.S. Wong
arXiv 2025, In preparation
TL;DR
We use vision-language foundation models as uncertainty estimators inside a symbolic belief-space planner, enabling robots to plan to perceive and act under partial observability.

Practice Makes Perfect: Planning to Learn Skill Parameter Policies

Nishanth Kumar*, Tom Silver*, Willie McClinton, Linfeng Zhao, Stephen Proul, Tomás Lozano-Pérez, Leslie Kaelbling, Jennifer Barry
RSS 2024
TL;DR
We enable a robot to rapidly and autonomously specialize parameterized skills by planning to practice them. The robot decides what skills to practice and how to practice them. The robot is left alone for hours, repeatedly practicing and improving.

Equivariant Open-vocabulary Pick and Place via Language Kernels and Patch-level Semantic Maps

Mingxi Jia*, Haojie Huang*, Zhewen Zhang, Chenghao Wang, Linfeng Zhao, Dian Wang, Jason Xinyu Liu, Robin Walters, Robert Platt, Stefanie Tellex
IEEE RA-L 2025 (Best Paper Award Honorable Mention, top 5 / 1,700+ papers)
TL;DR
GEM combines patch-level semantic maps, language-conditioned visual relevancy, and equivariant policy learning for sample-efficient open-vocabulary pick-and-place manipulation.

E(2)-Equivariant Graph Planning for Navigation

Linfeng Zhao*, Hongyu Li*, Taskin Padir, Huaizu Jiang†, Lawson L.S. Wong†
IEEE RA-L 2024
IROS 2024 (Oral)
TL;DR
We study E(2) Euclidean equivariance in navigation on geometric graphs and develop message passing network to solve it.

Integrating Symmetry into Differentiable Planning with Steerable Convolutions

Linfeng Zhao, Xupeng Zhu*, Lingzhi Kong*, Robin Walters, Lawson L.S. Wong
ICLR 2023
RLDM 2022
TL;DR
We formulate how differentiable planning algorithms can exploit inherent symmetry in path planning problems, named SymPlan, and propose practical algorithms.

Scaling up and Stabilizing Differentiable Planning with Implicit Differentiation

Linfeng Zhao, Huazhe Xu, Lawson L.S. Wong
ICLR 2023
TL;DR
We differentiate through the Bellman fixed point to decouple forward planning from backward computation, enabling a flexible forward budget and constant backward cost in planning horizon.

Toward Compositional Generalization in Object‑Oriented World Modeling

Linfeng Zhao, Lingzhi Kong, Robin Walters, Lawson L.S. Wong
ICML 2022 (Long Presentation, top 2%)
RLDM 2022
TL;DR
We formulate compositional generalization in object-oriented world modeling, and propose a soft and efficient mechanism for practice.

Deep Imitation Learning for Bimanual Robotic Manipulation

Fan Xie*, Alexander Chowdhury*, M. Clara De Paolis Kaluza, Linfeng Zhao, Lawson L.S. Wong, Rose Yu
NeurIPS 2020
TL;DR
We present a deep imitation learning framework for robotic bimanual manipulation in a continuous state-action space.