Jimei Yang

Research Scientist, Adobe Research
Mailing Address: 345 Park Ave, San Jose, CA 95110
Email: jimyang -at- adobe.com


I received my Ph.D. degree from UC Merced in 2015 under supervision of Prof. Ming-Hsuan Yang. I was a visiting Ph.D. student in Prof. Honglak Lee's group at University of Michigan, Ann Arbor in 2015. Previously, I received my Master's degree from University of Science and Technology of China under supervision of Prof. Stan Z. Li and Prof. Zengfu Wang. (CV)

Research Interests

My research interests mainly lie in the areas of computer vision, deep learning and AI. In particular, I have been working on structured deep learning for human motion synthesis, video prediction, image generation, 3D reconstruction and object segmentation. Please see my Berkeley talk slides Augmented Imagery for a high-level summary of my recent research.

Publications

(My Google scholar page)

    2018

    BodyNet: Volumetric Inference of 3D Human Body Shapes
    Gül Varol, Duygu Ceylan, Bryan Russell, Jimei Yang, Ersin Yumer, Ivan Laptev, and Cordelia Schmid
    European Conference on Computer Vision (ECCV), Munich, Germany, 2018. [paper] [code]

    Flow-Grounded Spatial-Temporal Video Prediction from Still Images
    Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, and Ming-Hsuan Yang
    European Conference on Computer Vision (ECCV), Munich, Germany, 2018. [paper] [code]

    Brush Stroke Synthesis with a Generative Adversarial Network Driven by Physically Based Simulation
    Rundong Wu, Zhili Chen, Zhaowen Wang, Jimei Yang, and Steve Marschner
    Proceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering (Expressive), Victoria, BC, Canada, 2018. [paper]

    Neural Kinematic Networks for Unsupervised Motion Retargeting
    Ruben Villegas, Jimei Yang, Duygu Ceylan, Honglak Lee
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. (oral) [paper] [project] [code]

    PlaneNet: Piece-wise Planar Reconstruction from a Single RGB Image
    Chen Liu, Jimei Yang, Duygu Ceylan, Ersin Yumer, Yasutaka Furukawa
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. (spotlight) [paper] [project]

    Generative Image Inpainting with Contextual Attention
    Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, Thomas Huang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. [paper] [project]

    MatNet: Modular Attention Network for Referring Expression Comprehension
    Licheng Yu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Mohit Bansal, Tamara Berg
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, 2018. [paper] [project]

    2017

    Universal Style Transfer via Feature Transforms
    Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, Ming-Hsuan Yang
    Advances in Neural Information Processing Systems (NIPS), Long Beach, CA, 2017 [paper] [Torch code]

    Predicting Scene Parsing and Motion Dynamics in the Future
    Xiaojie Jin, Huaxin Xiao, Xiaohui Shen, Jimei Yang, Zhe Lin, Yunpeng Chen, Zequn Jie, Jiashi Feng, Shuicheng Yan
    Advances in Neural Information Processing Systems (NIPS), Long Beach, CA, 2017 [paper]

    Material Editing Using a Physically Based Rendering Network
    Guilin Liu, Duygu Ceylan, Ersin Yumer, Jimei Yang, Jyh-Ming Lien
    International Conference on Computer Vision (ICCV), Venice, Italy, 2017. (spotlight) [paper]

    Recurrent Multimodal Interaction for Referring Image Segmentation
    Chenxi Liu, Zhe Lin, Xiaohui Shen, Jimei Yang, Xin Lu, Alan Yuille
    International Conference on Computer Vision (ICCV), Venice, Italy, 2017. [paper]

    3D-PRNN: Generating Shape Primitives With Recurrent Neural Networks
    Chuhang Zou, Ersin Yumer, Jimei Yang, Duygu Ceylan, Derek Hoiem
    International Conference on Computer Vision (ICCV), Venice, Italy, 2017. [paper]

    Video Scene Parsing With Predictive Feature Learning
    Xiaojie Jin, Xin Li, Huaxin Xiao, Xiaohui Shen, Zhe Lin, Jimei Yang, Yunpeng Chen, Jian Dong, Luoqi Liu, Zequn Jie, Jiashi Feng, Shuicheng Yan
    International Conference on Computer Vision (ICCV), Venice, Italy, 2017. [paper coming soon]

    FoveaNet: Perspective-Aware Urban Scene Parsing
    Xin Li, Zequn Jie, Wei Wang, Changsong Liu, Jimei Yang, Xiaohui Shen, Zhe Lin, Qiang Chen, Shuicheng Yan, Jiashi Feng
    International Conference on Computer Vision (ICCV), Venice, Italy, 2017. (oral) [paper coming soon]

    Learning to Generate Long-term Future via Hierarchical Prediction
    Ruben Villegas, Jimei Yang, Yuliang Zou, Sungryull Sohn, Xunyu Lin, Honglak Lee
    International Conference on Machine Learning (ICML), Sydney, Australia, 2017. [paper] [project] [code]

    Transformation-Grounded Image Generation Network for Novel 3D View Synthesis
    Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alex Berg
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. [paper] [project] [arXiv]

    Forecasting Human Dynamics from Static Images
    Yu-Wei Chao, Jimei Yang, Brian Price, Scott Cohen, Jia Deng
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. [paper] [project] [arXiv]

    Generative Face Completion
    Yijun Li, Sifei Liu, Jimei Yang, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. [paper] [project]

    Diversified Texture Synthesis with Feed-forward Networks
    Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. (spotlight) [paper] [project]

    Decomposing Motion and Content for Natural Video Sequence Prediction
    Ruben Villegas, Jimei Yang, Seunghoon Hong, Xunyu Lin, Honglak Lee
    International Conference on Learning Representations (ICLR), Toulon, France, 2017 [paper] [project] [code coming soon]

    Top-Down Visual Saliency via Joint CRF and Dictionary Learning
    Jimei Yang, Ming-Hsuan Yang
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 39, No. 3, March 2017 [paper]

    2016

    Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision
    Xinchen Yan, Jimei Yang, Ersin Yumer, Honglak Lee
    Advances in Neural Information Processing Systems (NIPS), Barcelona, Spain, 2016 [paper] [supp] [Torch code] [TensorFlow code]

    Attribute2Image: Conditional Image Generation from Visual Attributes
    Xinchen Yan, Jimei Yang, Kihyuk Sohn, Honglak Lee
    European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands, 2016 [paper] [arXiv] [project] [code] [demo]

    Object Contour Detection with a Fully Convolutional Encoder-Decoder Network
    Jimei Yang, Brian Price, Scott Cohen, Honglak Lee, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016. (spotlight) [paper] [arXiv] [project]

    Deep Interactive Object Selection
    Ning Xu, Brian Price, Scott Cohen, Jimei Yang, Thomas Huang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016. [paper]

    Object Tracking via Dual Linear Structured SVM and Explicit Feature Map
    Jifeng Ning, Jimei Yang, Shaojie Jiang, Lei Zhang, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016. [paper] [code] [project]

    2015

    Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis
    Jimei Yang, Scott Reed, Ming-Hsuan Yang, Honglak Lee
    Advances in Neural Information Processing Systems (NIPS), Montreal, Canada, 2015. [paper] [arXiv] [slides] [demo] [talk video] [GitHub]

    PatchCut: Data-Driven Object Segmentation via Local Shape Transfer
    Jimei Yang, Brian Price, Scott Cohen, Zhe Lin, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015. [paper] [results]

    Multi-Objective Convolutional Learning for Face Labeling
    Sifei Liu, Jimei Yang, Chang Huang, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015. [paper]

    Extracting Image Regions by Structured Edge Detection
    Yi-Ting Chen, Jimei Yang, Ming-Hsuan Yang
    IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Beach, HI, 2015. [paper] [code]

    2014

    Max-Margin Boltzmann Machines for Object Segmentation
    Jimei Yang, Simon Safar, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, 2014. [paper] [supp] [code] [Caltech-UCSD Birds 200 masks]

    Context Driven Scene Parsing with Attention to Rare Classes
    Jimei Yang, Brian Price, Scott Cohen, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, 2014. (oral) [paper] [slides] [code] [Results on SIFTflow] [Results on LMSun]

    2013

    Exemplar Cut
    Jimei Yang, Yi-Hsuan Tsai, Ming-Hsuan Yang
    International Conference on Computer Vision (ICCV), Sydney, Australia, 2013 [paper] [supp] [code]

    Decomposed Learning for Joint Object Segmentation and Categorization
    Yi-Hsuan Tsai, Jimei Yang, Ming-Hsuan Yang
    British Machine Vision Conference (BMVC), Bristol, United Kingdom, 2013 [paper]

    2012

    Top-Down Visual Saliency via Joint CRF and Dictionary Learning
    Jimei Yang, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, 2012 [paper] [code]

    Transferring Visual Prior for Online Object Tracking
    Qing Wang, Feng Chen, Jimei Yang, Wenli Xu, Ming-Hsuan Yang
    IEEE Transactions on Image Processing (TIP), Vol. 21, No. 7, July, 2012 [paper]

    2011

    Learning Hierarchical Image Representation with Sparsity, Saliency and Locality
    Jimei Yang, Ming-Hsuan Yang
    British Machine Vision Conference (BMVC), Dundee, United Kingdom, 2011 (oral) [paper] [code]

    Before 2010

    Learning Mappings for Face Synthesis from Near Infrared to Visual Light Images
    Jie Chen, Dong Yi, Jimei Yang, Guoying Zhao, Stan Z. Li, Matti Pietikäinen
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, 2009 [paper]

    Automatic Partial Face Alignment in NIR Video Sequences
    Jimei Yang, Shengcai Liao, Stan Z. Li
    IAPR/IEEE Conference on Biometrics (ICB), Sardinia Island, Italy, 2009 [paper]

    An Analysis-by-Synthesis Method for Heterogeneous Face Biometrics
    Rui Wang, Jimei Yang, Dong Yi, Stan Z. Li
    IAPR/IEEE Conference on Biometrics (ICB), Sardinia Island, Italy, 2009 [paper]

    A Fast Incremental Algorithm for Low Rank Approximations of Matrices and Its Applications in Facial Images
    Jimei Yang, Shiming Xiang, Rong Liu, Zengfu Wang, Stan Z. Li
    Journal of University of Science and Technology of China, Volume 39, Number 9, September, 2009 [paper]

Professional Activities

  • Area Chair
    • BMVC 2018
  • Conference Reviewer
    • NIPS 2013, 2014, 2015, 2016, 2017
    • CVPR 2015, 2016, 2017, 2018
    • ICCV 2015, 2017
    • ECCV 2014, 2016, 2018
    • ICML 2016, 2017, 2018
    • ICLR 2016, 2017
    • IJCAI 2016
    • IROS 2012
  • Journal Reviewer
    • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
    • IEEE Transactions on Image Processing (TIP)
    • Computer Vision and Image Understanding (CVIU)
    • Image and Visual Computing (IVC)
    • Neural Networks
    • Pattern Recognition
    • Machine Vision and Applications (MVA)