Bolei Zhou

Assistant Professor
Computer Science Department, University of California, Los Angeles
Office: 295D, Engineering VI, UCLA

My research is at the intersection of computer vision and machine autonomy, with a focus on developing interpretable and generalizable embodied AI that aligns with humans. I am also interested in understanding various human-centric properties of current AI models beyond their accuracy, such as explainability, interpretability, steerability, generalization, and safety. Some of the earlier works I co-authored are Class Activation Mapping (CAM), Places, ADE20K, Network Dissection.

See MetaDriverse for recent work on machine autonomy and GenForce for recent work on generative modeling.


Jun 12, 2024 CVPR’2024: give invited talks at Workshop on Autonomous Driving (WAD) on 06/17 AM and Workshop on Robot Visual Perception in Human Crowded Environments on 06/18 PM, and co-organize Workshop on Populating Empty Cities on 06/17 PM.
Feb 13, 2024 Thank NSF for supporting our research via NSF CAREER Award.
Sep 12, 2023 Thank Intel for supporting our research via Intel’s 2023 Rising Star Faculty Award.
Apr 26, 2023 Invited talks at workshops on coPerception: collaborative perception and learning at ICRA’23, end-to-end autonomous driving at CVPR’23, and secure and safe autonomous driving at CVPR’23, and BIRS workshop on 3D generative models.
Mar 24, 2023 Grateful to receive NSF award for supporting our research of developing our MetaDrive driving simulator into MetaDriverse, an open-source infrastructure for AI research on autonomous driving.
Jan 9, 2023 I summarize our effort of going from Network Dissection to Policy Dissection in the talk Discovering Interpretable Concepts in Deep Representations at IPAM Workshop on Explainable AI for the Sciences: Towards Novel Insights.

Selected Publications

  1. Nature
    Experiment-free Exoskeleton Assistance via Learning in Simulation
    Shuzhen Luo, Menghan Jiang, Sainan Zhang, Junxi Zhu, Shuangyue Yu, Israel Dominguez Silva, Tian Wang, Elliott Rouse, Bolei Zhou, Hyunwoo Yuk, Xianlian Zhou, and Hao Su
    Nature , 2024
  2. CVPR
    FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition
    Sicheng Mo, Fangzhou Mu, Kuan Heng Lin, Yanli Liu, Bochen Guan, Yin Li, and Bolei Zhou
    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
  3. CVPR
    Scenewiz3d: Towards text-guided 3d scene composition
    Qihang Zhang, Chaoyang Wang, Aliaksandr Siarohin, Peiye Zhuang, Yinghao Xu, Ceyuan Yang, Dahua Lin, Bolei Zhou, Sergey Tulyakov, and Hsin-Ying Lee
    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
  4. CVPR
    Berfscene: Bev-conditioned equivariant radiance fields for infinite 3d scene generation
    Qihang Zhang, Yinghao Xu, Yujun Shen, Bo Dai, Bolei Zhou, and Ceyuan Yang
    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
  5. RAL
    Street-View Image Generation from a Bird’s-Eye View Layout
    Alexander Swerdlow, Runsheng Xu, and Bolei Zhou
    IEEE Robotics and Automation Letters (RAL) , 2024
  6. NeurIPS Spotlight
    Learning from Active Human Involvement through Proxy Value Propagation
    Zhenghao Peng, Wenjie Mo, Chenda Duan, Quanyi Li, and Bolei Zhou
    In Neural Information Processing Systems (NeurIPS Spotlight) , 2023
  7. NeurIPS
    ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modeling
    Quanyi Li, Zhenghao Peng, Lan Feng, Zhizheng Liu, Chenda Duan, Wenjie Mo, and Bolei Zhou
    Neural Information Processing Systems, Datasets and Benchmarks (NeurIPS) , 2023
  8. CoRL
    CAT: Closed-loop Adversarial Training for Safe End-to-End Driving
    Linrui Zhang, Zhenghao Peng, Quanyi Li, and Bolei Zhou
    In 7th Annual Conference on Robot Learning (CoRL) , 2023
  9. ICCV
    One-shot generative domain adaptation
    Ceyuan Yang, Yujun Shen, Zhiyi Zhang, Yinghao Xu, Jiapeng Zhu, Zhirong Wu, and Bolei Zhou
    International Conference on Computer Vision (ICCV) , 2023
  10. CVPR Highlight
    DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis
    Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, Hsin-Ying Lee, Bolei Zhou, and Sergey Tulyakov
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Highlight) , 2023
  11. ICLR Spotlight
    Guarded Policy Optimization with Imperfect Online Demonstrations
    Zhenghai Xue, Zhenghao Peng, Quanyi Li, Zhihan Liu, and Bolei Zhou
    International Conference on Learning Representations (ICLR Spotlight) , 2023
  12. ICRA
    TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios
    Lan Feng, Quanyi Li, Zhenghao Peng, Shuhan Tan, and Bolei Zhou
    IEEE International Conference on Robotics and Automation (ICRA) , 2023
  13. NeurIPS
    Human-AI Shared Control via Policy Dissection
    Quanyi Li, Zhenghao Peng, Haibin Wu, Lan Feng, and Bolei Zhou
    Neural Information Processing Systems (NeurIPS) , 2022