Thomas Lew
I am a research scientist at the Toyota Research Institute, where I develop decision-making algorithms for autonomous systems. My research leverages tools from optimal and stochastic control, optimization, differential geometry, and machine learning, revealing insights for designing fast and reliable methods with optimality, accuracy, and adaptation guarantees. It was deployed on cars, drones, spacecraft and Mars rover testbeds, rockets, and mobile robotic manipulators.
Previously, I received my PhD from Stanford University advised by Marco Pavone and Riccardo Bonalli, completed research internships at Google Brain and NASA JPL, and studied at ETH Zurich and EPFL.
My Research
Some problems I have been working on:
- Optimization and control under uncertainty: How can we compute optimal trajectories for nonlinear systems that explicitly reason over uncertainty? Can we find low-dimensional structure in solutions and leverage GPU acceleration to efficiently solve these problems?
- Forward reachability analysis: How can we propagate uncertainty through complex systems (potentially with neural networks in the loop) in milliseconds and use it for planning and control? What accuracy can we expect? What problem structure can we exploit?
- Reliable and efficient learning-based control: How can a system (meta-)learn its dynamics, while handling the exploration-exploitation tradeoff and always satisfying constraints? How can we learn as fast as possible to enable reliable control of unstable systems?
- Resilient navigation: How can a drone autonomously fly even if all its exteroceptive sensors have failed?
- Vision-based control: How can a robot achieve precise control from high-dimensional visual inputs while ensuring safe and zero-shot deployment?
Preprints

Project Page / Paper - We derive new optimality conditions and an indirect method for stochastic optimal control.

Project Page / Paper - Unstable systems are difficult to simultaneously learn and control.

Project Page / Paper / Code - We study the structure of convex hulls of reachable sets of nonlinear systems (dx/dt=f(x)+g(x)w).
Publications

Project Page / Paper - A risk-averse controller that can reason over uncertainty.

Project Page / Paper - A multimodal diffusion-based vehicle model for MPC.

Project Page / Paper / Code - We study the problem of estimating the convex hull of the image of a compact set with smooth boundary.

Project Page / Paper / Code - We revisit the sample average approximation (SAA) approach for general non-convex stochastic programming and apply the method to stochastic optimal control problems.

Project Page / Paper / Presentation / Code - We give a finite-dimensional characterization of the convex hulls of reachable sets of nonlinear systems (dx/dt=f(x)+w).

Project Page / Paper / Code - A sample-based approach to risk-averse trajectory optimization.

Project Page / Paper / Blog Post / Video - We propose an effective strategy for table wiping combining the strengths of reinforcement learning and whole-body trajectory optimization.

Project Page / Paper / Code - We propose a sequential convex programming framework for non-linear finite-dimensional stochastic optimal control.

Project Page / Paper / Code - A comprehensive tutorial on convex trajectory optimization.

Project Page / Paper / Code - A robust sampling-based motion planning algorithm.

Project Page / Paper / Code / Video - We analyze a sampling-based reachability analysis algorithm.

Project Page / Paper / Code - We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems.

Project Page / Paper / Code - We analyze general SCP procedures for continuous-time optimal control.

Project Page / Paper / Video / More Hardware Results - How can robots safely learn their dynamics?

Project Page / Paper / CoSTAR-NeBula website - We present the algorithms, hardware, and software architecture deployed by the team CoSTAR in the DARPA SubT Challenge.

Project Page / Paper - We propose a CBF formulation that accounts for delays.

Project Page / Paper / Video / Code - New efficient sampling-based reachability analysis algorithms.

Project Page / Paper / Code - We propose an algorithm for chance-constrained trajectory optimization.

Project Page / Paper / Code - A learning-based strategy to warm-start trajectory optimization tools.

Project Page / Paper / Video - How can a drone fly blindly, when all its exteroceptive sensors have failed?

Project Page / Paper / Launch Video / ARIS website - We propose a control algorithm for a rocket to accurately reach a target apogee.

Project Page / Paper - We identify limitations of wheel-soil interaction models and present a new method.

Project Page / Paper / Code - A new SCP trajectory optimization algorithm on manifolds.