Publications

2021

  1. NeurIPS
    Learning to Simulate Self-driven Particles System with Coordinated Policy Optimization
    Zhenghao Peng*, Quanyi Li*, Chunxiao Liu, and Bolei Zhou
    Neural Information Processing Systems (NeurIPS) , 2021
  2. NeurIPS
    Data-Efficient Instance Generation from Instance Discrimination
    Ceyuan Yang, Yujun Shen, Yinghao Xu, and Bolei Zhou
    Neural Information Processing Systems (NeurIPS) , 2021
  3. CoRL
    Safe Driving via Expert Guided Policy Optimization
    Zhenghao Peng*, Quanyi Li*, Chunxiao Liu, and Bolei Zhou
    Conference on Robot Learning (CoRL) , 2021
  4. MetaDrive: Composing Diverse Driving Scenarios for Generalizable Reinforcement Learning
    Quanyi Li*, Zhenghao Peng*, Zhenghai Xue, Qihang Zhang, and Bolei Zhou
    arXiv:2109.12674 , 2021
  5. CVPR Tutorial
    Interpreting Generative Adversarial Networks for Interactive Image Generation
    Bolei Zhou
    arXiv preprint arXiv:2108.04896 (CVPR Tutorial) , 2021
  6. CVPR Oral
    Closed-form factorization of latent semantics in GANs
    Yujun Shen, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2021
  7. CVPR Oral
    Generative hierarchical features from synthesizing images
    Yinghao Xu, Yujun Shen, Jiapeng Zhu, Ceyuan Yang, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2021
  8. CVPR
    Instance localization for self-supervised detection pretraining
    Ceyuan Yang, Zhirong Wu, Bolei Zhou, and Stephen Lin
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021
  9. CVPR
    Multimodal Motion Prediction with Stacked Transformers
    Yicheng Liu, Jinghuai Zhang, Liangji Fang, Qinhong Jiang, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021
  10. CVPR
    Positional encoding as spatial inductive bias in gans
    Rui Xu, Xintao Wang, Kai Chen, Bolei Zhou, and Chen Change Loy
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2021
  11. ICCV
    TS-CAM: Token Semantic Coupled Attention Map for Weakly Supervised Object Localization
    Wei Gao, Fang Wan, Xingjia Pan, Zhiliang Peng, Qi Tian, Zhenjun Han, Bolei Zhou, and Qixiang Ye
    International Conference on Computer Vision (ICCV) , 2021
  12. HDSR
    Deepminer: Discovering interpretable representations for mammogram classification and explanation
    Jimmy Wu, Bolei Zhou, Diondra Peck, Scott Hsieh, Vandana Dialani, Lester Mackey, and Genevieve Patterson
    Harvard Data Science Review (HDSR) , 2021
  13. IJCV
    Semantic hierarchy emerges in deep generative representations for scene synthesis
    Ceyuan Yang, Yujun Shen, and Bolei Zhou
    International Journal of Computer Vision (IJCV) , 2021
  14. TIP
    Texture Memory-Augmented Deep Patch-Based Image Inpainting
    Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, and Chen Change Loy
    IEEE Transactions on Image Processing (TIP) , 2021
  15. Gan inversion: A survey
    Weihao Xia, Yulun Zhang, Yujiu Yang, Jing-Hao Xue, Bolei Zhou, and Ming-Hsuan Yang
    arXiv preprint arXiv:2101.05278 , 2021
  16. Deep Learning for Scene Classification: A Survey
    Delu Zeng, Minyu Liao, Mohammad Tavakolian, Yulan Guo, Bolei Zhou, Dewen Hu, Matti Pietikäinen, and Li Liu
    arXiv preprint arXiv:2101.10531 , 2021
  17. IROS+RAL
    Adversarial Inverse Reinforcement Learning With Self-Attention Dynamics Model
    Jiankai Sun, Lantao Yu, Pinqian Dong, Bo Lu, and Bolei Zhou
    IEEE Robotics and Automation Letters (IROS+RAL) , 2021
  18. Unsupervised Image Transformation Learning via Generative Adversarial Networks
    Kaiwen Zha, Yujun Shen, and Bolei Zhou
    arXiv preprint arXiv:2103.07751 , 2021
  19. AAAI
    HiABP: Hierarchical Initialized ABP for Unsupervised Representation Learning
    Jiankai Sun, Rui Liu, and Bolei Zhou
    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) , 2021
  20. Safe Exploration by Solving Early Terminated MDP
    Hao Sun, Ziping Xu, Meng Fang, Zhenghao Peng, Jiadong Guo, Bo Dai, and Bolei Zhou
    arXiv preprint arXiv:2107.04200 , 2021

2020

  1. IROS+RAL
    Cross-view semantic segmentation for sensing surroundings
    Bowen Pan, Jiankai Sun, Ho Yin Tiga Leung, Alex Andonian, and Bolei Zhou
    IEEE Robotics and Automation Letters (IROS+RAL) , 2020
  2. Semantic photo manipulation with a generative image prior
    David Bau, Hendrik Strobelt, William Peebles, Jonas Wulff, Bolei Zhou, Jun-Yan Zhu, and Antonio Torralba
    SIGGRAPH , 2020
  3. CVPR
    Interpreting the latent space of gans for semantic face editing
    Yujun Shen, Jinjin Gu, Xiaoou Tang, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
  4. CoRL
    Learning Driving Decisions by Imitating Drivers’ Control Behaviors
    Junning Huang, Sirui Xie, Jiankai Sun, Qiurui Ma, Chunxiao Liu, Jianping Shi, Dahua Lin, and Bolei Zhou
    Conference on Robot Learning (CoRL) , 2020
  5. AAAI
    Every frame counts: joint learning of video segmentation and optical flow
    Mingyu Ding, Zhe Wang, Bolei Zhou, Jianping Shi, Zhiwu Lu, and Ping Luo
    In Proceedings of the AAAI Conference on Artificial Intelligence (AAAI) , 2020
  6. CVPR
    Image Processing Using Multi-Code GAN Prior
    Jinjin Gu, Yujun Shen, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
  7. CVPR
    Transmomo: Invariance-driven unsupervised video motion retargeting
    Zhuoqian Yang, Wentao Zhu, Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, and Chen Change Loy
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
  8. ECCV
    In-domain gan inversion for real image editing
    Jiapeng Zhu, Yujun Shen, Deli Zhao, and Bolei Zhou
    In European Conference on Computer Vision (ECCV) , 2020
  9. CVPR
    A local-to-global approach to multi-modal movie scene segmentation
    Anyi Rao, Linning Xu, Yu Xiong, Guodong Xu, Qingqiu Huang, Bolei Zhou, and Dahua Lin
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
  10. CVPR
    Temporal pyramid network for action recognition
    Ceyuan Yang, Yinghao Xu, Jianping Shi, Bo Dai, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
  11. CVPR
    Tpnet: Trajectory proposal network for motion prediction
    Liangji Fang, Qinhong Jiang, Jianping Shi, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2020
  12. Evolutionary Stochastic Policy Distillation
    Hao Sun, Xinyu Pan, Bo Dai, Dahua Lin, and Bolei Zhou
    arXiv preprint arXiv:2004.12909 , 2020
  13. Novel Policy Seeking with Constrained Optimization
    Hao Sun, Zhenghao Peng, Bo Dai, Jian Guo, Dahua Lin, and Bolei Zhou
    arXiv preprint arXiv:2005.10696 , 2020
  14. TPAMI
    InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs
    Yujun Shen, Ceyuan Yang, Xiaoou Tang, and Bolei Zhou
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2020
  15. ECCV
    A unified framework for shot type classification based on subject centric lens
    Anyi Rao, Jiaze Wang, Linning Xu, Xuekun Jiang, Qingqiu Huang, Bolei Zhou, and Dahua Lin
    In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XI 16 (ECCV) , 2020
  16. PNAS
    Understanding the role of individual units in a deep neural network
    David Bau, Jun-Yan Zhu, Hendrik Strobelt, Agata Lapedriza, Bolei Zhou, and Antonio Torralba
    Proceedings of the National Academy of Sciences (PNAS) , 2020
  17. Improving the Fairness of Deep Generative Models without Retraining
    Shuhan Tan, Yujun Shen, and Bolei Zhou
    arXiv preprint arXiv:2012.04842 , 2020
  18. Neuro-symbolic program search for autonomous driving decision module design
    Jiankai Sun1 Hao Sun1 Tian Han, and Bolei Zhou
    Conference on Robot Learning , 2020
  19. Improving the Generalization of End-to-End Driving through Procedural Generation
    Quanyi Li, Zhenghao Peng, Qihang Zhang, Chunxiao Liu, and Bolei Zhou
    arXiv preprint arXiv:2012.13681 , 2020

2019

  1. TPAMI
    Moments in time dataset: one million videos for event understanding
    Mathew Monfort, Alex Andonian, Bolei Zhou, Kandan Ramakrishnan, Sarah Adel Bargal, Tom Yan, Lisa Brown, Quanfu Fan, Dan Gutfreund, Carl Vondrick, and others
    IEEE transactions on pattern analysis and machine intelligence (TPAMI) , 2019
  2. ICLR
    Gan dissection: Visualizing and understanding generative adversarial networks
    David Bau, Jun-Yan Zhu, Hendrik Strobelt, Bolei Zhou, Joshua B Tenenbaum, William T Freeman, and Antonio Torralba
    International Conference on Learning Representations (ICLR) , 2019
  3. Discovering place-informative scenes and objects using social media photos
    Fan Zhang, Bolei Zhou, Carlo Ratti, and Yu Liu
    Royal Society open science , 2019
  4. CVPR
    Deep flow-guided video inpainting
    Rui Xu, Xiaoxiao Li, Bolei Zhou, and Chen Change Loy
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2019
  5. CVPR
    Drivingstereo: A large-scale dataset for stereo matching in autonomous driving scenarios
    Guorun Yang, Xiao Song, Chaoqin Huang, Zhidong Deng, Jianping Shi, and Bolei Zhou
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2019
  6. Comparing the interpretability of deep networks via network dissection
    Bolei Zhou, David Bau, Aude Oliva, and Antonio Torralba
    , 2019
  7. CVPR
    Reasoning about human-object interactions through dual attention networks
    Tete Xiao, Quanfu Fan, Dan Gutfreund, Mathew Monfort, Aude Oliva, and Bolei Zhou
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (CVPR) , 2019
  8. NeurIPS Spotlight
    Policy Continuation with Hindsight Inverse Dynamics
    Hao Sun, Zhizhong Li, Xiaotong Liu, Dahua Lin, and Bolei Zhou
    In Advances in Neural Information Processing Systems (NeurIPS Spotlight) , 2019
  9. CVPR Oral
    A graph-based framework to bridge movies and synopses
    Yu Xiong, Qingqiu Huang, Lingfeng Guo, Hang Zhou, Bolei Zhou, and Dahua Lin
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (CVPR Oral) , 2019
  10. ICCV Oral
    Seeing what a gan cannot generate
    David Bau, Jun-Yan Zhu, Jonas Wulff, William Peebles, Hendrik Strobelt, Bolei Zhou, and Antonio Torralba
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV Oral) , 2019
  11. Disentangled inference for gans with latently invertible autoencoder
    Jiapeng Zhu, Deli Zhao, Bo Zhang, and Bolei Zhou
    arXiv preprint arXiv:1906.08090 , 2019

2018

  1. IJCV
    Semantic understanding of scenes through the ADE20K dataset
    Bolei Zhou, Hang Zhao, Xavier Puig, Tete Xiao, Sanja Fidler, Adela Barriuso, and Antonio Torralba
    International Journal on Computer Vision (IJCV) , 2018
  2. CVPR
    Visual question generation as dual task of visual question answering
    Yikang Li, Nan Duan, Bolei Zhou, Xiao Chu, Wanli Ouyang, Xiaogang Wang, and Ming Zhou
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2018
  3. TPAMI
    Interpreting Deep Visual Representations via Network Dissection
    Bolei Zhou, David Bau, Aude Oliva, and Antonio Torralba
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2018
  4. ECCV
    Temporal relational reasoning in videos
    Bolei Zhou, Alex Andonian, Aude Oliva, and Antonio Torralba
    In European Conference on Computer Vision (ECCV) , 2018
  5. Expert identification of visual primitives used by CNNs during mammogram classification
    Jimmy Wu, Diondra Peck, Scott Hsieh, Vandana Dialani, Constance D Lehman, Bolei Zhou, Vasilis Syrgkanis, Lester Mackey, and Genevieve Patterson
    In Medical Imaging 2018: Computer-Aided Diagnosis , 2018
  6. CVPR
    Recurrent residual module for fast inference in videos
    Bowen Pan, Wuwei Lin, Xiaolin Fang, Chaoqin Huang, Bolei Zhou, and Cewu Lu
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2018
  7. Revisiting the importance of individual units in cnns via ablation
    Bolei Zhou, Yiyou Sun, David Bau, and Antonio Torralba
    arXiv preprint arXiv:1806.02891 , 2018
  8. ECCV
    Factorizable net: an efficient subgraph-based framework for scene graph generation
    Yikang Li, Wanli Ouyang, Bolei Zhou, Jianping Shi, Chao Zhang, and Xiaogang Wang
    In Proceedings of the European Conference on Computer Vision (ECCV) , 2018
  9. ECCV
    Unified perceptual parsing for scene understanding
    Tete Xiao, Yingcheng Liu, Bolei Zhou, Yuning Jiang, and Jian Sun
    In European Conference on Computer Vision (ECCV) , 2018
  10. IROS
    Real-time object pose estimation with pose interpreter networks
    Jimmy Wu, Bolei Zhou, Rebecca Russell, Vincent Kee, Syler Wagner, Mitchell Hebert, Antonio Torralba, and David MS Johnson
    In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IROS) , 2018
  11. ECCV
    Single image intrinsic decomposition without a single intrinsic image
    Wei-Chiu Ma, Hang Chu, Bolei Zhou, Raquel Urtasun, and Antonio Torralba
    In Proceedings of the European Conference on Computer Vision (ECCV) , 2018
  12. ECCV
    Interpretable basis decomposition for visual explanation
    Bolei Zhou, Yiyou Sun, David Bau, and Antonio Torralba
    In Proceedings of the European Conference on Computer Vision (ECCV) , 2018
  13. Measuring human perceptions of a large-scale urban region using machine learning
    Fan Zhang, Bolei Zhou, Liu Liu, Yu Liu, Helene H Fung, Hui Lin, and Carlo Ratti
    Landscape and Urban Planning , 2018
  14. Interpretable representation learning for visual intelligence
    Bolei Zhou
    PhD Thesis , 2018
  15. Facefeat-gan: a two-stage approach for identity-preserving face synthesis
    Yujun Shen, Bolei Zhou, Ping Luo, and Xiaoou Tang
    arXiv preprint arXiv:1812.01288 , 2018

2017

  1. CVPR
    Person search with natural language description
    Shuang Li, Tong Xiao, Hongsheng Li, Bolei Zhou, Dayu Yue, and Xiaogang Wang
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017
  2. IROS Oral
    Segicp: Integrated deep semantic segmentation and pose estimation
    Jay M Wong, Vincent Kee, Tiffany Le, Syler Wagner, Gian-Luca Mariottini, Abraham Schneider, Lei Hamilton, Rahul Chipalkatty, Mitchell Hebert, David MS Johnson, and others
    In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IROS Oral) , 2017
  3. ICCV
    Open vocabulary scene parsing
    Hang Zhao, Xavier Puig, Bolei Zhou, Sanja Fidler, and Antonio Torralba
    In Proceedings of the IEEE International Conference on Computer Vision (ICCV) , 2017
  4. CVPR
    Scene parsing through ade20k dataset
    Bolei Zhou, Hang Zhao, Xavier Puig, Sanja Fidler, Adela Barriuso, and Antonio Torralba
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2017
  5. CVPR Oral
    Network dissection: Quantifying interpretability of deep visual representations
    David Bau, Bolei Zhou, Aditya Khosla, Aude Oliva, and Antonio Torralba
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2017
  6. TPAMI
    Places: A 10 million image database for scene recognition
    Bolei Zhou, Agata Lapedriza, Aditya Khosla, Aude Oliva, and Antonio Torralba
    IEEE transactions on pattern analysis and machine intelligence (TPAMI) , 2017
  7. ICCV
    Scene graph generation from objects, phrases and region captions
    Yikang Li, Wanli Ouyang, Bolei Zhou, Kun Wang, and Xiaogang Wang
    In Proceedings of the IEEE international conference on computer vision (ICCV) , 2017

2016

  1. CVPR
    Learning deep features for discriminative localization
    Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2016
  2. AISTATS Oral
    Optimization as estimation with Gaussian processes in bandit settings
    Zi Wang, Bolei Zhou, and Stefanie Jegelka
    In Artificial Intelligence and Statistics (AISTATS Oral) , 2016
  3. C-IMAGE: city cognitive mapping through geo-tagged photos
    Liu Liu, Bolei Zhou, Jinhua Zhao, and Brent D Ryan
    GeoJournal , 2016

2015

  1. CVPR
    Conceptlearner: Discovering visual concepts from weakly labeled image collections
    Bolei Zhou, Vignesh Jagadeesh, and Robinson Piramuthu
    In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR) , 2015
  2. ICLR Oral
    Object detectors emerge in deep scene cnns
    Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba
    In International Conference on Learning Representations (ICLR Oral) , 2015
  3. Simple baseline for visual question answering
    Bolei Zhou, Yuandong Tian, Sainbayar Sukhbaatar, Arthur Szlam, and Rob Fergus
    arXiv preprint arXiv:1512.02167 , 2015

2014

  1. TPAMI
    Measuring Crowd Collectiveness
    Bolei Zhou, Xiaoou Tang, Hepeng Zhang, and Xiaogang Wang
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) , 2014
  2. IJCV
    Learning Collective Crowd Behaviors with Dynamic Pedestrian-Agents
    Bolei Zhou, Xiaoou Tang, and Xiaogang Wang
    International Journal of Computer Vision (IJCV) , 2014
  3. ECCV
    Recognizing city identity via attribute analysis of geo-tagged images
    Bolei Zhou, Liu Liu, Aude Oliva, and Antonio Torralba
    In European conference on computer vision (ECCV) , 2014
  4. NeurIPS Spotlight
    Learning Deep Features for Scene Recognition using Places Database
    Bolei Zhou, Agata Lapedriza, Jianxiong Xiao, Antonio Torralba, and Aude Oliva
    In NIPS (NeurIPS Spotlight) , 2014

2013

  1. CVPR Oral
    Measuring Crowd Collectiveness
    Bolei Zhou, Xiaoou Tang, and Xiaogang Wang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2013

2012

  1. CVPR Oral
    Understanding collective crowd behaviors: Learning a mixture model of dynamic pedestrian-agents
    Bolei Zhou, Xiaogang Wang, and Xiaoou Tang
    In IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2012
  2. ECCV
    Coherent filtering: Detecting coherent motions from crowd clutters
    Bolei Zhou, Xiaoou Tang, and Xiaogang Wang
    In European Conference on Computer Vision (ECCV) , 2012

2011

  1. CVPR
    Random field topic model for semantic region analysis in crowded scenes from tracklets
    Bolei Zhou, Xiaogang Wang, and Xiaoou Tang
    In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2011