Publications

Please see Google Scholar for more recent works and arXiv papers.

2025

1. NeurIPS Spotlight

   Predictive Preference Learning from Human Interventions

   Haoyuan Cai, Zhenghao Peng, and Bolei Zhou

   Advances in Neural Information Processing Systems (NeurIPS Spotlight) , 2025

   PDF Website
2. NeurIPS

   Adv-BMT: Bidirectional Motion Transformer for Safety-Critical Traffic Scenario Generation

   Yuxin Liu, Zhenghao Peng, Xuanhao Cui, and Bolei Zhou

   Advances in Neural Information Processing Systems (NeurIPS) , 2025

   PDF Website
3. NeurIPS

   AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning

   Zewei Zhou, Tianhui Cai, Seth Z Zhao, Yun Zhang, Zhiyu Huang, Bolei Zhou, and Jiaqi Ma

   Advances in Neural Information Processing Systems (NeurIPS) , 2025

   PDF Website
4. ICCV

   X-fusion: Introducing new modality to frozen large language models

   Sicheng Mo, Thao Nguyen, Xun Huang, Siddharth Srinivasan Iyer, Yijun Li, Yuchen Liu, Abhishek Tandon, Eli Shechtman, Krishna Kumar Singh, Yong Jae Lee, and others

   International Conference on Computer Vision (ICCV) , 2025

   PDF Code
5. ICCV

   Occupancy Learning with Spatiotemporal Memory

   Ziyang Leng, Jiawei Yang, Wenlong Yi, and Bolei Zhou

   International Conference on Computer Vision (ICCV) , 2025

   PDF Website
6. ICCV

   TurboTrain: Towards Efficient and Balanced Multi-Task Learning for Multi-Agent Perception and Prediction

   Zewei Zhou, Seth Z. Zhao, Tianhui Cai, Zhiyu Huang, Bolei Zhou, and Jiaqi Ma

   International Conference on Computer Vision (ICCV) , 2025

   PDF Website
7. ICCV

   V2XPnP: Vehicle-to-Everything Spatio-Temporal Fusion for Multi-Agent Perception and Prediction

   Zewei Zhou, Hao Xiang, Zhaoliang Zheng, Seth Z. Zhao, Mingyue Lei, Yun Zhang, Tianhui Cai, Johnson Liu Xinyi Liu, Maheswari Bajji, Xin Xia, Zhiyu Huang, Bolei Zhou, and Jiaqi Ma

   International Conference on Computer Vision (ICCV) , 2025

   PDF Website
8. ICCV

   Verbalized Representation Learning for Interpretable Few-Shot Generalization

   Cheng-Fu Yang, Da Yin, Wenbo Hu, Heng Ji, Nanyun Peng, Bolei Zhou, and Kai-Wei Chang

   International Conference on Computer Vision (ICCV) , 2025

   PDF Code
9. IROS

   CooPre: Cooperative Pretraining for V2X Cooperative Perception

   Zhihao Zhao, Hao Xiang, Chenfeng Xu, Xin Xia, Bolei Zhou, and Jiaqi Ma

   IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2025

   PDF Code
10. ICML

    Robot-Gated Shared Autonomy with Adaptive Intervention Mechanism

    Haoyuan Cai, Zhenghao Peng, and Bolei Zhou

    International Conference on Machine Learning (ICML) , 2025

    PDF Code
11. ICML

    WOMD-Reasoning: A Large-Scale Language Dataset for Interaction and Driving Intentions Reasoning

    Yiheng Li, Cunxin Fan, Chongjian GE, Seth Z. Zhao, Chenran Li, Chenfeng Xu, Huaxiu Yao, Masayoshi Tomizuka, Bolei Zhou, Chen Tang, Mingyu Ding, and Wei Zhan

    International Conference on Machine Learning (ICML) , 2025

    PDF
12. ICML

    Hyper: Hyperparameter Robust Efficient Exploration in Reinforcement Learning

    Yiran Wang, Chenshu Liu, Yunfan Li, Sanae Amani, Bolei Zhou, and Lin F Yang

    International Conference on Machine Learning (ICML) , 2025

    PDF
13. CVPR Highlight

    Towards Autonomous Micromobility through Scalable Urban Simulation

    Wayne Wu*, Honglin He*, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, and Bolei Zhou

    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR Highlight) , 2025

    PDF Website
14. CVPR

    Vid2Sim: Realistic and Interactive Simulation from Video for Urban Navigation

    Ziyang Xie, Zhizheng Liu, Zhenghao Peng, Wayne Wu, and Bolei Zhou

    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2025

    PDF Website
15. CVPR

    Embodied Scene Understanding for Vision Language Models via MetaVQA

    Weizhen Wang, Chenda Duan, Zhenghao Peng, Yuxin Liu, and Bolei Zhou

    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2025

    PDF Website
16. ICRA

    Data-Efficient Learning from Human Interventions for Mobile Robots

    Zhenghao Peng, Zhizheng Liu, and Bolei Zhou

    IEEE International Conference on Robotics and Automation (ICRA) , 2025

    PDF Website
17. ICLR Spotlight

    MetaUrban: An Embodied AI Simulation Platform for Urban Micromobility

    Wayne Wu, Honglin He, Jack He, Yiran Wang, Chenda Duan, Zhizheng Liu, Quanyi Li, and Bolei Zhou

    International Conference on Learning Representations (ICLR Spotlight) , 2025

    PDF Website
18. ICLR

    Learning to Generate Diverse Pedestrian Movements from Web Videos with Noisy Labels

    Zhizheng Liu, Joe Lin, Wayne Wu, and Bolei Zhou

    International Conference on Learning Representations (ICLR) , 2025

    PDF Website
19. ICLR

    3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting

    Qihang Zhang, Yinghao Xu, Chaoyang Wang, Hsin-Ying Lee, Gordon Wetzstein, Bolei Zhou, and Ceyuan Yang

    International Conference on Learning Representations (ICLR) , 2025

    PDF Website
20. RAL

    BEVCon: Advancing Bird’s Eye View Perception With Contrastive Learning

    Ziyang Leng, Jiawei Yang, Zhicheng Ren, and Bolei Zhou

    IEEE Robotics and Automation Letters (RAL) , 2025

    PDF Code

2024

1. NeurIPS

   SimGen: Simulator-conditioned Driving Scene Generation

   Yunsong Zhou, Michael Simon, Zhenghao Peng, Sicheng Mo, Hongzi Zhu, Minyi Guo, and Bolei Zhou

   Advances in Neural Information Processing Systems (NeurIPS) , 2024

   PDF Website
2. NeurIPS

   Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance

   Kuan Heng Lin, Sicheng Mo, Ben Klingher, Fangzhou Mu, and Bolei Zhou

   Advances in Neural Information Processing Systems (NeurIPS) , 2024

   PDF Website
3. NeurIPS

   Shared Autonomy with IDA: Interventional Diffusion Assistance

   Brandon J McMahan, Zhenghao Peng, Bolei Zhou, and Jonathan C Kao

   Advances in Neural Information Processing Systems (NeurIPS) , 2024

   PDF
4. 

   Localization and recognition of human action in 3D using transformers

   Jiankai Sun, Linjiang Huang, Hongsong Wang, Chuanyang Zheng, Jianing Qiu, Md Tauhidul Islam, Enze Xie, Bolei Zhou, Lei Xing, Arjun Chandrasekaran, and others

   Communications Engineering , 2024
5. Nature

   Experiment-free Exoskeleton Assistance via Learning in Simulation

   Shuzhen Luo, Menghan Jiang, Sainan Zhang, Junxi Zhu, Shuangyue Yu, Israel Dominguez Silva, Tian Wang, Elliott Rouse, Bolei Zhou, Hyunwoo Yuk, Xianlian Zhou, and Hao Su

   Nature , 2024

   PDF Video Website
6. Nature BME

   Accurate prediction of disease-risk factors from volumetric medical scans by a deep vision model pre-trained with 2D scans

   Oren Avram, Berkin Durmus, Nadav Rakocz, Giulia Corradetti, Ulzee An, Muneeswar G Nittala, Prerit Terway, Akos Rudas, Zeyuan Johnson Chen, Yu Wakatsuki, and others

   Nature Biomedical Engineering (Nature BME) , 2024

   PDF Website
7. TPAMI

   Spatial Steerability of GANs via Self-Supervision from Discriminator

   Jianyuan Wang, Lalit Bhagat, Ceyuan Yang, Yinghao Xu, Yujun Shen, Hongdong Li, and Bolei Zhou

   IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2024

   PDF
8. CVPR

   FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition

   Sicheng Mo, Fangzhou Mu, Kuan Heng Lin, Yanli Liu, Bochen Guan, Yin Li, and Bolei Zhou

   IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024

   PDF Website
9. CVPR

   Scenewiz3d: Towards text-guided 3d scene composition

   Qihang Zhang, Chaoyang Wang, Aliaksandr Siarohin, Peiye Zhuang, Yinghao Xu, Ceyuan Yang, Dahua Lin, Bolei Zhou, Sergey Tulyakov, and Hsin-Ying Lee

   IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024

   PDF Website
10. CVPR

    Berfscene: Bev-conditioned equivariant radiance fields for infinite 3d scene generation

    Qihang Zhang, Yinghao Xu, Yujun Shen, Bo Dai, Bolei Zhou, and Ceyuan Yang

    IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) , 2024

    PDF Website
11. 

    Unsupervised Discovery of Steerable Factors When Graph Deep Generative Models Are Entangled

    Shengchao Liu, Chengpeng Wang, Jiarui Lu, Weili Nie, Hanchen Wang, Zhuoxinran Li, Bolei Zhou, and Jian Tang

    Transactions on Machine Learning Research , 2024

    PDF
12. RAL

    Street-View Image Generation from a Bird’s-Eye View Layout

    Alexander Swerdlow, Runsheng Xu, and Bolei Zhou

    IEEE Robotics and Automation Letters (RAL) , 2024

    PDF Website
13. TPAMI

    In-Domain GAN Inversion for Faithful Reconstruction and Editability

    Jiapeng Zhu, Yujun Shen, Yinghao Xu, Deli Zhao, Qifeng Chen, and Bolei Zhou

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2024

    PDF
14. 3DV spotlight

    Efficient 3d articulated human generation with layered surface volumes

    Yinghao Xu, Wang Yifan, Alexander W Bergman, Menglei Chai, Bolei Zhou, and Gordon Wetzstein

    The 11th International Conference on 3D Vision (3DV spotlight) , 2024

    PDF Website

2023

1. NeurIPS Spotlight

   Learning from Active Human Involvement through Proxy Value Propagation

   Zhenghao Peng, Wenjie Mo, Chenda Duan, Quanyi Li, and Bolei Zhou

   In Neural Information Processing Systems (NeurIPS Spotlight) , 2023

   PDF Website
2. NeurIPS

   ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modeling

   Quanyi Li, Zhenghao Peng, Lan Feng, Zhizheng Liu, Chenda Duan, Wenjie Mo, and Bolei Zhou

   Neural Information Processing Systems, Datasets and Benchmarks (NeurIPS) , 2023

   PDF Code Website
3. CoRL

   CAT: Closed-loop Adversarial Training for Safe End-to-End Driving

   Linrui Zhang, Zhenghao Peng, Quanyi Li, and Bolei Zhou

   In 7th Annual Conference on Robot Learning (CoRL) , 2023

   PDF Website
4. ICCV

   One-shot generative domain adaptation

   Ceyuan Yang, Yujun Shen, Zhiyi Zhang, Yinghao Xu, Jiapeng Zhu, Zhirong Wu, and Bolei Zhou

   International Conference on Computer Vision (ICCV) , 2023

   PDF Website
5. TMLR

   ChemSpacE: Interpretable and Interactive Chemical Space Exploration

   Yuanqi Du, Xian Liu, Nilay Shah, Shengchao Liu, Jieyu Zhang, and Bolei Zhou

   Transactions on Machine Learning Research (TMLR) , 2023

   PDF Code
6. CVPR Highlight

   DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis

   Yinghao Xu, Menglei Chai, Zifan Shi, Sida Peng, Ivan Skorokhodov, Aliaksandr Siarohin, Ceyuan Yang, Yujun Shen, Hsin-Ying Lee, Bolei Zhou, and Sergey Tulyakov

   IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Highlight) , 2023

   PDF Website
7. CVPR Highlight

   V2V4Real: A large-scale real-world dataset for Vehicle-to-Vehicle Cooperative Perception

   Runsheng Xu, Xin Xia, Jinlong Li, Hanzhao Li, Shuo Zhang, Zhengzhong Tu, Zonglin Meng, Hao Xiang, Xiaoyu Dong, Rui Song, Hongkai Yu, Bolei Zhou, and Jiaqi Ma

   IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Highlight) , 2023

   PDF Website
8. ICLR Spotlight

   Guarded Policy Optimization with Imperfect Online Demonstrations

   Zhenghai Xue, Zhenghao Peng, Quanyi Li, Zhihan Liu, and Bolei Zhou

   International Conference on Learning Representations (ICLR Spotlight) , 2023

   PDF
9. ICLR

   Towards Smooth Video Composition

   Qihang Zhang, Ceyuan Yang, Yujun Shen, Yinghao Xu, and Bolei Zhou

   International Conference on Learning Representations (ICLR) , 2023

   PDF Website
10. ICRA

    TrafficGen: Learning to Generate Diverse and Realistic Traffic Scenarios

    Lan Feng, Quanyi Li, Zhenghao Peng, Shuhan Tan, and Bolei Zhou

    IEEE International Conference on Robotics and Automation (ICRA) , 2023

    PDF Website
11. ICRA

    V2XP-ASG: Generating Adversarial Scenes for Vehicle-to-Everything Perception

    Hao Xiang, Runsheng Xu, Xin Xia, Zhaoliang Zheng, Bolei Zhou, and Jiaqi Ma

    IEEE International Conference on Robotics and Automation (ICRA) , 2023

    PDF
12. TPAMI

    GH-Feat: Learning Versatile Generative Hierarchical Features From GANs

    Yinghao Xu, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, and Bolei Zhou

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2023

    PDF

2022

1. NeurIPS

   Human-AI Shared Control via Policy Dissection

   Quanyi Li, Zhenghao Peng, Haibin Wu, Lan Feng, and Bolei Zhou

   Neural Information Processing Systems (NeurIPS) , 2022

   PDF Website
2. NeurIPS

   Optimistic Curiosity Exploration and Conservative Exploitation with Linear Reward Shaping

   Hao Sun, Lei Han, Rui Yang, Xiaoteng Ma, Jian Guo, and Bolei Zhou

   Neural Information Processing Systems (NeurIPS) , 2022

   PDF
3. NeurIPS

   Improving GANs with A Dynamic Discriminator

   Ceyuan Yang, Yujun Shen, Yinghao Xu, Deli Zhao, Bo Dai, and Bolei Zhou

   Neural Information Processing Systems (NeurIPS) , 2022

   PDF Website
4. CoRL

   CoBEVT: Cooperative Bird’s Eye View Semantic Segmentation with Sparse Transformers

   Runsheng Xu, Zhengzhong Tu, Hao Xiang, Wei Shao, Bolei Zhou, and Jiaqi Ma

   Conference on Robot Learning (CoRL) , 2022

   PDF
5. ECCV

   Learning to Drive by Watching YouTube Videos: Action-Conditioned Contrastive Policy Pretraining

   Qihang Zhang, Zhenghao Peng, and Bolei Zhou

   European Conference on Computer Vision (ECCV) , 2022

   PDF Website
6. ECCV Oral

   Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation

   Xian Liu, Yinghao Xu, Qianyi Wu, Hang Zhou, Wayne Wu, and Bolei Zhou

   European Conference on Computer Vision (ECCV Oral) , 2022

   PDF Website
7. TPAMI

   MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning

   Quanyi Li*, Zhenghao Peng*, Lan Feng, Qihang Zhang, Zhenghai Xue, and Bolei Zhou

   IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2022

   PDF Code Website
8. CVPR

   Improving GAN Equilibrium by Raising Spatial Awareness

   Jianyuan Wang, Ceyuan Yang, Yinghao Xu, Yujun Shen, Hongdong Li, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2022

   PDF Code Website
9. CVPR

   3D-aware Image Synthesis via Learning Structural and Textural Representations

   Yinghao Xu, Sida Peng, Ceyuan Yang, Yujun Shen, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2022

   PDF Code Website
10. CVPR

    Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation

    Xian Liu, Qianyi Wu, Hang Zhou, Yinghao Xu, Rui Qian, Xinyi Lin, Xiaowei Zhou, Wayne Wu, Bo Dai, and Bolei Zhou

    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2022

    PDF
11. CVPR Oral

    Cross-Model Pseudo-Labeling for Semi-Supervised Action Recognition

    Yinghao Xu, Fangyun Wei, Xiao Sun, Ceyuan Yang, Yujun Shen, Bo Dai, Bolei Zhou, and Stephen Lin

    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2022

    PDF
12. ICLR

    Efficient Learning of Safe Driving Policy via Human-AI Copilot Optimization

    Quanyi Li, Zhenghao Peng, and Bolei Zhou

    International Conference on Learning Representations (ICLR) , 2022

    PDF Code Website
13. ICRA+RAL

    PlaTe: Visually-Grounded Planning with Transformers in Procedural Tasks

    Jiankai Sun, De-An Huang, Bo Lu, Yunhui Liu, Bolei Zhou, and Animesh Garg

    IEEE Robotics and Automation Letters (ICRA+RAL) , 2022

    PDF Website
14. AAAI

    Visual Sound Localization in the Wild by Cross-Modal Interference Erasing

    Xian Liu, Rui Qian, Hang Zhou, Di Hu, Weiyao Lin, Ziwei Liu, Bolei Zhou, and Xiaowei Zhou

    AAAI Conference on Artificial Intelligence (AAAI) , 2022

    PDF
15. AAAI

    SimIPU: Simple 2D Image and 3D Point Cloud Unsupervised Pre-Training for Spatial-Aware Visual Representations

    Zhenyu Li, Zehui Chen, Ang Li, Liangji Fang, Qinhong Jiang, Xianming Liu, Junjun Jiang, Bolei Zhou, and Hang Zhao

    AAAI Conference on Artificial Intelligence (AAAI) , 2022

    PDF
16. Book Chapter

    Interpreting Generative Adversarial Networks for Interactive Image Generation

    Bolei Zhou

    xxAI - Beyond explainable Artificial Intelligence (Book Chapter) , 2022

    PDF Video Slides
17. IJCV

    Disentangled inference for gans with latently invertible autoencoder

    Jiapeng Zhu, Deli Zhao, Bo Zhang, and Bolei Zhou

    International Journal on Computer Vision (IJCV) , 2022

    PDF
18. TPAMI

    Gan inversion: A survey

    Weihao Xia, Yulun Zhang, Yujiu Yang, Jing-Hao Xue, Bolei Zhou, and Ming-Hsuan Yang

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2022

    PDF

2021

1. NeurIPS

   Learning to Simulate Self-Driven Particles System with Coordinated Policy Optimization

   Zhenghao Peng, Quanyi Li, Chunxiao Liu, and Bolei Zhou

   Neural Information Processing Systems (NeurIPS) , 2021

   PDF Code Website
2. NeurIPS

   Data-Efficient Instance Generation from Instance Discrimination

   Ceyuan Yang, Yujun Shen, Yinghao Xu, and Bolei Zhou

   Neural Information Processing Systems (NeurIPS) , 2021

   PDF Code Website
3. CoRL

   Safe Driving via Expert Guided Policy Optimization

   Zhenghao Peng*, Quanyi Li*, Chunxiao Liu, and Bolei Zhou

   Conference on Robot Learning (CoRL) , 2021

   PDF Code Website
4. CVPR Oral

   Closed-form factorization of latent semantics in GANs

   Yujun Shen, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2021

   PDF Website
5. CVPR Oral

   Generative hierarchical features from synthesizing images

   Yinghao Xu, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2021

   PDF Website
6. CVPR

   Instance localization for self-supervised detection pretraining

   Ceyuan Yang, Zhirong Wu, Bolei Zhou, and Stephen Lin

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021

   PDF
7. CVPR

   Multimodal Motion Prediction with Stacked Transformers

   Yicheng Liu, Jinghuai Zhang, Liangji Fang, Qinhong Jiang, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021

   PDF Website
8. CVPR

   Positional encoding as spatial inductive bias in gans

   Rui Xu, Xintao Wang, Kai Chen, Bolei Zhou, and Chen Change Loy

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021

   PDF
9. ICCV

   TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization

   Wei Gao, Fang Wan, Xingjia Pan, Zhiliang Peng, Qi Tian, Zhenjun Han, Bolei Zhou, and Qixiang Ye

   International Conference on Computer Vision (ICCV) , 2021

   PDF Code
10. HDSR

    Deepminer: Discovering interpretable representations for mammogram classification and explanation

    Jimmy Wu, Bolei Zhou, Diondra Peck, Scott Hsieh, Vandana Dialani, Lester Mackey, and Genevieve Patterson

    Harvard Data Science Review (HDSR) , 2021

    PDF
11. IJCV

    Semantic hierarchy emerges in deep generative representations for scene synthesis

    Ceyuan Yang, Yujun Shen, and Bolei Zhou

    International Journal of Computer Vision (IJCV) , 2021

    PDF Code Website
12. TIP

    Texture Memory-Augmented Deep Patch-Based Image Inpainting

    Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, and Chen Change Loy

    IEEE Transactions on Image Processing (TIP) , 2021

    PDF
13. 

    Deep Learning for Scene Classification: A Survey

    Delu Zeng, Minyu Liao, Mohammad Tavakolian, Yulan Guo, Bolei Zhou, Dewen Hu, Matti Pietikäinen, and Li Liu

    arXiv preprint arXiv:2101.10531 , 2021
14. IROS+RAL

    Adversarial Inverse Reinforcement Learning With Self-Attention Dynamics Model

    Jiankai Sun, Lantao Yu, Pinqian Dong, Bo Lu, and Bolei Zhou

    IEEE Robotics and Automation Letters (IROS+RAL) , 2021

    PDF Code
15. 

    Unsupervised Image Transformation Learning via Generative Adversarial Networks

    Kaiwen Zha, Yujun Shen, and Bolei Zhou

    arXiv preprint arXiv:2103.07751 , 2021
16. AAAI

    HiABP: Hierarchical Initialized ABP for Unsupervised Representation Learning

    Jiankai Sun, Rui Liu, and Bolei Zhou

    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) , 2021

    PDF
17. 

    Safe Exploration by Solving Early Terminated MDP

    Hao Sun, Ziping Xu, Meng Fang, Zhenghao Peng, Jiadong Guo, Bo Dai, and Bolei Zhou

    arXiv preprint arXiv:2107.04200 , 2021

    PDF

2020

1. IROS+RAL

   Cross-view semantic segmentation for sensing surroundings

   Bowen Pan, Jiankai Sun, Ho Yin Tiga Leung, Alex Andonian, and Bolei Zhou

   IEEE Robotics and Automation Letters (IROS+RAL) , 2020

   PDF Website
2. 

   Semantic photo manipulation with a generative image prior

   David Bau, Hendrik Strobelt, William Peebles, Jonas Wulff, Bolei Zhou, Jun-Yan Zhu, and Antonio Torralba

   SIGGRAPH , 2020

   PDF News Website
3. CVPR

   Interpreting the latent space of gans for semantic face editing

   Yujun Shen, Jinjin Gu, Xiaoou Tang, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020

   PDF Website
4. CoRL

   Learning Driving Decisions by Imitating Drivers’ Control Behaviors

   Junning Huang, Sirui Xie, Jiankai Sun, Qiurui Ma, Chunxiao Liu, Jianping Shi, Dahua Lin, and Bolei Zhou

   Conference on Robot Learning (CoRL) , 2020

   PDF
5. AAAI

   Every frame counts: joint learning of video segmentation and optical flow

   Mingyu Ding, Zhe Wang, Bolei Zhou, Jianping Shi, Zhiwu Lu, and Ping Luo

   In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) , 2020

   PDF
6. CVPR

   Image Processing Using Multi-Code GAN Prior

   Jinjin Gu, Yujun Shen, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020

   PDF Website
7. CVPR

   Transmomo: Invariance-driven unsupervised video motion retargeting

   Zhuoqian Yang, Wentao Zhu, Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, and Chen Change Loy

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020

   PDF Website
8. ECCV

   In-domain gan inversion for real image editing

   Jiapeng Zhu, Yujun Shen, Deli Zhao, and Bolei Zhou

   In European Conference on Computer Vision (ECCV) , 2020

   PDF Website
9. CVPR

   A local-to-global approach to multi-modal movie scene segmentation

   Anyi Rao, Linning Xu, Yu Xiong, Guodong Xu, Qingqiu Huang, Bolei Zhou, and Dahua Lin

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020

   PDF Website
10. CVPR

    Temporal pyramid network for action recognition

    Ceyuan Yang, Yinghao Xu, Jianping Shi, Bo Dai, and Bolei Zhou

    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020

    PDF Code
11. CVPR

    Tpnet: Trajectory proposal network for motion prediction

    Liangji Fang, Qinhong Jiang, Jianping Shi, and Bolei Zhou

    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020

    PDF Website
12. 

    Evolutionary Stochastic Policy Distillation

    Hao Sun, Xinyu Pan, Bo Dai, Dahua Lin, and Bolei Zhou

    arXiv preprint arXiv:2004.12909 , 2020

    PDF
13. 

    Novel Policy Seeking with Constrained Optimization

    Hao Sun, Zhenghao Peng, Bo Dai, Jian Guo, Dahua Lin, and Bolei Zhou

    arXiv preprint arXiv:2005.10696 , 2020

    PDF
14. TPAMI

    InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs

    Yujun Shen, Ceyuan Yang, Xiaoou Tang, and Bolei Zhou

    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2020

    PDF Website
15. ECCV

    A unified framework for shot type classification based on subject centric lens

    Anyi Rao, Jiaze Wang, Linning Xu, Xuekun Jiang, Qingqiu Huang, Bolei Zhou, and Dahua Lin

    In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XI 16 (ECCV) , 2020
16. PNAS

    Understanding the role of individual units in a deep neural network

    David Bau, Jun-Yan Zhu, Hendrik Strobelt, Agata Lapedriza, Bolei Zhou, and Antonio Torralba

    Proceedings of the National Academy of Sciences (PNAS) , 2020

    PDF Website
17. 

    Improving the Fairness of Deep Generative Models without Retraining

    Shuhan Tan, Yujun Shen, and Bolei Zhou

    arXiv preprint arXiv:2012.04842 , 2020

    PDF
18. 

    Neuro-symbolic program search for autonomous driving decision module design

    Jiankai Sun1 Hao Sun1 Tian Han, and Bolei Zhou

    Conference on Robot Learning , 2020

    PDF
19. 

    Improving the Generalization of End-to-End Driving through Procedural Generation

    Quanyi Li, Zhenghao Peng, Qihang Zhang, Chunxiao Liu, and Bolei Zhou

    arXiv preprint arXiv:2012.13681 , 2020

    PDF Code

2019

1. TPAMI

   Moments in time dataset: one million videos for event understanding

   Mathew Monfort, Alex Andonian, Bolei Zhou, Kandan Ramakrishnan, Sarah Adel Bargal, Tom Yan, Lisa Brown, Quanfu Fan, Dan Gutfreund, Carl Vondrick, and others

   IEEE transactions on pattern analysis and machine intelligence (TPAMI) , 2019

   PDF Code Website
2. ICLR

   Gan dissection: Visualizing and understanding generative adversarial networks

   David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B Tenenbaum, William T Freeman, and Antonio Torralba

   International Conference on Learning Representations (ICLR) , 2019

   PDF Website
3. 

   Discovering place-informative scenes and objects using social media photos

   Fan Zhang, Bolei Zhou, Carlo Ratti, and Yu Liu

   Royal Society open science , 2019
4. CVPR

   Deep flow-guided video inpainting

   Rui Xu, Xiaoxiao Li, Bolei Zhou, and Chen Change Loy

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2019

   PDF Code Website
5. CVPR

   Drivingstereo: A large-scale dataset for stereo matching in autonomous driving scenarios

   Guorun Yang, Xiao Song, Chaoqin Huang, Zhidong Deng, Jianping Shi, and Bolei Zhou

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2019

   PDF Website
6. 

   Comparing the interpretability of deep networks via network dissection

   Bolei Zhou, David Bau, Aude Oliva, and Antonio Torralba

   In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning , 2019
7. CVPR

   Reasoning about human-object interactions through dual attention networks

   Tete Xiao, Quanfu Fan, Dan Gutfreund, Mathew Monfort, Aude Oliva, and Bolei Zhou

   In Proceedings of the IEEE/CVF International Conference on Computer Vision (CVPR) , 2019

   PDF Website
8. NeurIPS Spotlight

   Policy Continuation with Hindsight Inverse Dynamics

   Hao Sun, Zhizhong Li, Xiaotong Liu, Dahua Lin, and Bolei Zhou

   In Advances in Neural Information Processing Systems (NeurIPS Spotlight) , 2019

   PDF
9. CVPR Oral

   A graph-based framework to bridge movies and synopses

   Yu Xiong, Qingqiu Huang, Lingfeng Guo, Hang Zhou, Bolei Zhou, and Dahua Lin

   In Proceedings of the IEEE/CVF International Conference on Computer Vision (CVPR Oral) , 2019

   PDF
10. ICCV Oral

    Seeing what a gan cannot generate

    David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, and Antonio Torralba

    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV Oral) , 2019

    PDF Website

2018

1. IJCV

   Semantic understanding of scenes through the ADE20K dataset

   Bolei Zhou, Hang Zhao, Xavier Puig, Tete Xiao, Sanja Fidler, Adela Barriuso, and Antonio Torralba

   International Journal on Computer Vision (IJCV) , 2018

   PDF Code Website
2. CVPR

   Visual question generation as dual task of visual question answering

   Yikang Li, Nan Duan, Bolei Zhou, Xiao Chu, Wanli Ouyang, Xiaogang Wang, and Ming Zhou

   In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2018

   PDF Code
3. TPAMI

   Interpreting Deep Visual Representations via Network Dissection

   Bolei Zhou, David Bau, Aude Oliva, and Antonio Torralba

   IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2018

   PDF Code Website
4. ECCV

   Temporal relational reasoning in videos

   Bolei Zhou, Alex Andonian, Aude Oliva, and Antonio Torralba

   In European Conference on Computer Vision (ECCV) , 2018

   PDF News Code Website
5. 

   Expert identification of visual primitives used by CNNs during mammogram classification

   Jimmy Wu, Diondra Peck, Scott Hsieh, Vandana Dialani, Constance D Lehman, Bolei Zhou, Vasilis Syrgkanis, Lester Mackey, and Genevieve Patterson

   In Medical Imaging 2018: Computer-Aided Diagnosis , 2018

   PDF
6. CVPR

   Recurrent residual module for fast inference in videos

   Bowen Pan, Wuwei Lin, Xiaolin Fang, Chaoqin Huang, Bolei Zhou, and Cewu Lu

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2018

   PDF
7. 

   Revisiting the importance of individual units in cnns via ablation

   Bolei Zhou, Yiyou Sun, David Bau, and Antonio Torralba

   arXiv preprint arXiv:1806.02891 , 2018

   PDF
8. ECCV

   Factorizable net: an efficient subgraph-based framework for scene graph generation

   Yikang Li, Wanli Ouyang, Bolei Zhou, Jianping Shi, Chao Zhang, and Xiaogang Wang

   In Proceedings of the European Conference on Computer Vision (ECCV) , 2018

   PDF
9. ECCV

   Unified perceptual parsing for scene understanding

   Tete Xiao, Yingcheng Liu, Bolei Zhou, Yuning Jiang, and Jian Sun

   In European Conference on Computer Vision (ECCV) , 2018

   PDF Code
10. IROS

    Real-time object pose estimation with pose interpreter networks

    Jimmy Wu, Bolei Zhou, Rebecca Russell, Vincent Kee, Syler Wagner, Mitchell Hebert, Antonio Torralba, and David MS Johnson

    In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IROS) , 2018

    PDF Code
11. ECCV

    Single image intrinsic decomposition without a single intrinsic image

    Wei-Chiu Ma, Hang Chu, Bolei Zhou, Raquel Urtasun, and Antonio Torralba

    In Proceedings of the European Conference on Computer Vision (ECCV) , 2018

    PDF
12. ECCV

    Interpretable basis decomposition for visual explanation

    Bolei Zhou, Yiyou Sun, David Bau, and Antonio Torralba

    In Proceedings of the European Conference on Computer Vision (ECCV) , 2018

    PDF Code
13. 

    Measuring human perceptions of a large-scale urban region using machine learning

    Fan Zhang, Bolei Zhou, Liu Liu, Yu Liu, Helene H Fung, Hui Lin, and Carlo Ratti

    Landscape and Urban Planning , 2018
14. 

    Interpretable representation learning for visual intelligence

    Bolei Zhou

    PhD Thesis , 2018

    Video
15. 

    Facefeat-gan: a two-stage approach for identity-preserving face synthesis

    Yujun Shen, Bolei Zhou, Ping Luo, and Xiaoou Tang

    arXiv preprint arXiv:1812.01288 , 2018

2017

1. CVPR

   Person search with natural language description

   Shuang Li, Tong Xiao, Hongsheng Li, Bolei Zhou, Dayu Yue, and Xiaogang Wang

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017

   PDF
2. IROS Oral

   Segicp: Integrated deep semantic segmentation and pose estimation

   Jay M Wong, Vincent Kee, Tiffany Le, Syler Wagner, Gian-Luca Mariottini, Abraham Schneider, Lei Hamilton, Rahul Chipalkatty, Mitchell Hebert, David MS Johnson, and others

   In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IROS Oral) , 2017

   PDF
3. ICCV

   Open vocabulary scene parsing

   Hang Zhao, Xavier Puig, Bolei Zhou, Sanja Fidler, and Antonio Torralba

   In Proceedings of the IEEE International Conference on Computer Vision (ICCV) , 2017

   PDF Website
4. CVPR

   Scene parsing through ade20k dataset

   Bolei Zhou, Hang Zhao, Xavier Puig, Sanja Fidler, Adela Barriuso, and Antonio Torralba

   In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2017

   PDF Code Website
5. CVPR Oral

   Network dissection: Quantifying interpretability of deep visual representations

   David Bau, Bolei Zhou, Aditya Khosla, Aude Oliva, and Antonio Torralba

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2017

   PDF Website
6. TPAMI

   Places: A 10 million image database for scene recognition

   Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba

   IEEE transactions on pattern analysis and machine intelligence (TPAMI) , 2017

   PDF Code Website
7. ICCV

   Scene graph generation from objects, phrases and region captions

   Yikang Li, Wanli Ouyang, Bolei Zhou, Kun Wang, and Xiaogang Wang

   In Proceedings of the IEEE international conference on computer vision (ICCV) , 2017

   PDF Code

2016

1. CVPR

   Learning deep features for discriminative localization

   Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba

   In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2016

   PDF Video Website
2. AISTATS Oral

   Optimization as estimation with Gaussian processes in bandit settings

   Zi Wang, Bolei Zhou, and Stefanie Jegelka

   In Artificial Intelligence and Statistics (AISTATS Oral) , 2016

   PDF
3. 

   C-IMAGE: city cognitive mapping through geo-tagged photos

   Liu Liu, Bolei Zhou, Jinhua Zhao, and Brent D Ryan

   GeoJournal , 2016

2015

1. CVPR

   Conceptlearner: Discovering visual concepts from weakly labeled image collections

   Bolei Zhou, Vignesh Jagadeesh, and Robinson Piramuthu

   In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2015

   PDF
2. ICLR Oral

   Object detectors emerge in deep scene cnns

   Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba

   In International Conference on Learning Representations (ICLR Oral) , 2015

   PDF
3. 

   Simple baseline for visual question answering

   Bolei Zhou, Yuandong Tian, Sainbayar Sukhbaatar, Arthur Szlam, and Rob Fergus

   arXiv preprint arXiv:1512.02167 , 2015

   PDF

2014

1. TPAMI

   Measuring Crowd Collectiveness

   Bolei Zhou, Xiaoou Tang, Hepeng Zhang, and Xiaogang Wang

   IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2014

   PDF Website
2. IJCV

   Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents

   Bolei Zhou, Xiaoou Tang, and Xiaogang Wang

   International Journal of Computer Vision (IJCV) , 2014

   PDF Website
3. ECCV

   Recognizing city identity via attribute analysis of geo-tagged images

   Bolei Zhou, Liu Liu, Aude Oliva, and Antonio Torralba

   In European conference on computer vision (ECCV) , 2014

   PDF
4. NeurIPS Spotlight

   Learning Deep Features for Scene Recognition using Places Database

   Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, and Aude Oliva

   In NIPS (NeurIPS Spotlight) , 2014

   PDF Website

2013

1. CVPR Oral

   Measuring Crowd Collectiveness

   Bolei Zhou, Xiaoou Tang, and Xiaogang Wang

   IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2013

   PDF Website

2012

1. CVPR Oral

   Understanding collective crowd behaviors: Learning a mixture model of dynamic pedestrian-agents

   Bolei Zhou, Xiaogang Wang, and Xiaoou Tang

   In IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2012

   PDF HTML
2. ECCV

   Coherent filtering: Detecting coherent motions from crowd clutters

   Bolei Zhou, Xiaoou Tang, and Xiaogang Wang

   In European Conference on Computer Vision (ECCV) , 2012

   PDF Website

2011

1. CVPR

   Random field topic model for semantic region analysis in crowded scenes from tracklets

   Bolei Zhou, Xiaogang Wang, and Xiaoou Tang

   In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2011

   PDF Website