Bolei Zhou

Assistant Professor
Computer Science Department, University of California, Los Angeles
Office: 295D, Engineering VI, UCLA.
PTE request or Prospective Student please read this

My research is at the intersection of computer vision and machine autonomy, with a focus on developing efficient, interpretable, and generalizable embodied AI that aligns with humans. I am also interested in understanding various human-centric properties of current AI models beyond their accuracy, such as explainability, interpretability, steerability, generalization, and safety. Some of the earlier works I co-authored are Class Activation Mapping (CAM), Places, ADE20K, Network Dissection.

See MetaDriverse for recent work on machine autonomy and GenForce for recent work on generative modeling and GenAI.

News

Nov 11, 2024 Call for Tutorial Proposals at CVPR’25 and Call for Papers at IEEE Robotics & Automation Magazine’s Special Issue on Embodied AI.
Oct 23, 2024 Thank ONR for supporting our research via ONR Young Investigator Award.
Jul 31, 2024 Check out our urban environment simulator MetaUrban for embodied AI in micromobility.
Jul 31, 2024 My talk record at CVPR’24 Workshop on Autonomous Driving summarizes our effort of building the open-source simulation platform MetaDriverse for AI research and mobility. Slide is available.
Jun 12, 2024 CVPR’2024: give invited talks at Workshop on Autonomous Driving (WAD) on 06/17 AM and Workshop on Robot Visual Perception in Human Crowded Environments on 06/18 PM, and co-organize Workshop on Populating Empty Cities on 06/17 PM.
Feb 13, 2024 Thank NSF for supporting our research via NSF CAREER Award.
Sep 12, 2023 Thank Intel for supporting our research via Intel’s 2023 Rising Star Faculty Award.
Apr 26, 2023 Invited talks at workshops on coPerception: collaborative perception and learning at ICRA’23, end-to-end autonomous driving at CVPR’23, and secure and safe autonomous driving at CVPR’23, and BIRS workshop on 3D generative models.
Mar 24, 2023 Grateful to receive NSF award for supporting our research of developing our MetaDrive driving simulator into MetaDriverse, an open-source infrastructure for AI research on autonomous driving.

Selected Publications

  1. NeurIPS
    SimGen: Simulator-conditioned Driving Scene Generation
    Yunsong Zhou, Michael Simon, Zhenghao Peng, Sicheng Mo, Hongzi Zhu, Minyi Guo, and Bolei Zhou
    Advances in Neural Information Processing Systems (NeurIPS) , 2024
    PDF Website
  2. NeurIPS
    Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance
    Kuan Heng Lin, Sicheng Mo, Ben Klingher, Fangzhou Mu, and Bolei Zhou
    Advances in Neural Information Processing Systems (NeurIPS) , 2024
    PDF Website
  3. NeurIPS
    Shared Autonomy with IDA: Interventional Diffusion Assistance
    Brandon J McMahan, Zhenghao Peng, Bolei Zhou, and Jonathan C Kao
    Advances in Neural Information Processing Systems (NeurIPS) , 2024
    PDF
  4. Nature
    Experiment-free Exoskeleton Assistance via Learning in Simulation
    Shuzhen Luo, Menghan Jiang, Sainan Zhang, Junxi Zhu, Shuangyue Yu, Israel Dominguez Silva, Tian Wang, Elliott Rouse, Bolei Zhou, Hyunwoo Yuk, Xianlian Zhou, and Hao Su
    Nature , 2024
    PDF Video Website
  5. CVPR
    FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition
    Sicheng Mo, Fangzhou Mu, Kuan Heng Lin, Yanli Liu, Bochen Guan, Yin Li, and Bolei Zhou
    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
    PDF Website
  6. CVPR
    Scenewiz3d: Towards text-guided 3d scene composition
    Qihang Zhang, Chaoyang Wang, Aliaksandr Siarohin, Peiye Zhuang, Yinghao Xu, Ceyuan Yang, Dahua Lin, Bolei Zhou, Sergey Tulyakov, and Hsin-Ying Lee
    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
    PDF Website
  7. CVPR
    Berfscene: Bev-conditioned equivariant radiance fields for infinite 3d scene generation
    Qihang Zhang, Yinghao Xu, Yujun Shen, Bo Dai, Bolei Zhou, and Ceyuan Yang
    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024
    PDF Website
  8. RAL
    Street-View Image Generation from a Bird’s-Eye View Layout
    Alexander Swerdlow, Runsheng Xu, and Bolei Zhou
    IEEE Robotics and Automation Letters (RAL) , 2024
    PDF Website
  9. NeurIPS Spotlight
    Learning from Active Human Involvement through Proxy Value Propagation
    Zhenghao Peng, Wenjie Mo, Chenda Duan, Quanyi Li, and Bolei Zhou
    In Neural Information Processing Systems (NeurIPS Spotlight) , 2023
    PDF Website
  10. NeurIPS
    ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modeling
    Quanyi Li, Zhenghao Peng, Lan Feng, Zhizheng Liu, Chenda Duan, Wenjie Mo, and Bolei Zhou
    Neural Information Processing Systems, Datasets and Benchmarks (NeurIPS) , 2023
    PDF Code Website
  11. CoRL
    CAT: Closed-loop Adversarial Training for Safe End-to-End Driving
    Linrui Zhang, Zhenghao Peng, Quanyi Li, and Bolei Zhou
    In 7th Annual Conference on Robot Learning (CoRL) , 2023
    PDF Website
  12. ICCV
    One-shot generative domain adaptation
    Ceyuan Yang, Yujun Shen, Zhiyi Zhang, Yinghao Xu, Jiapeng Zhu, Zhirong Wu, and Bolei Zhou
    International Conference on Computer Vision (ICCV) , 2023
    PDF Website
  13. CVPR Highlight
    DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis
    Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, Hsin-Ying Lee, Bolei Zhou, and Sergey Tulyakov
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Highlight) , 2023
    PDF Website
  14. ICLR Spotlight
    Guarded Policy Optimization with Imperfect Online Demonstrations
    Zhenghai Xue, Zhenghao Peng, Quanyi Li, Zhihan Liu, and Bolei Zhou
    International Conference on Learning Representations (ICLR Spotlight) , 2023
    PDF
  15. ICRA
    TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios
    Lan Feng, Quanyi Li, Zhenghao Peng, Shuhan Tan, and Bolei Zhou
    IEEE International Conference on Robotics and Automation (ICRA) , 2023
    PDF Website
  16. NeurIPS
    Human-AI Shared Control via Policy Dissection
    Quanyi Li, Zhenghao Peng, Haibin Wu, Lan Feng, and Bolei Zhou
    Neural Information Processing Systems (NeurIPS) , 2022
    PDF Website