Jimei Yang

Research Scientist, Adobe Research
Mailing Address: 345 Park Ave, San Jose, CA 95110
Email: jimyang -at- adobe.com


I received my Ph.D. degree from UC Merced in 2015 under supervision of Prof. Ming-Hsuan Yang. I was a visiting Ph.D. student in Prof. Honglak Lee's group at University of Michigan, Ann Arbor in 2015. Previously, I received my Master's degree from University of Science and Technology of China under supervision of Prof. Stan Z. Li and Prof. Zengfu Wang.

News

  • 07/16/2017: Five papers accepted by ICCV 2017.
  • 05/13/2017: Our paper on generating long-term future accepted by ICML 2017! Check out our paper and demos here.
  • 03/04/2017: Four papers accepted by CVPR 2017.
  • 02/07/2017: Our video prediction paper accepted by ICLR 2017. Check out our demos here.
  • 11/30/2017: We have released the code of our NIPS 2016 paper "Perspective Transformer Nets". Check it out on Github.
  • 08/14/2016: One paper accepted by NIPS 2016.
  • 06/23/2016: The code for object contour detection is available on GitHub.
  • 03/24/2016: The code for 3D view synthesis is available on GitHub.
  • 03/02/2016: Three papers were accepted by CVPR 2016, Las Vegas.
  • 02/22/2016: Our paper "Top-down visual saliency via joint CRF and dictionary learning" was accepted by TPAMI.
  • 01/14/2016: I gave a talk about "Weakly-supervised disentangling for 3D view synthesis" at EECS, UC Berkeley, CA.
  • 10/22/2015: I gave a talk about "Learning to rotate 3D objects" at Bay Area Machine Learning Symposium 2015.
  • 09/02/2015: I gave a talk about "Learning to rotate 3D objects" at Technicolor, Los Altos, CA.
  • 06/05/2015: I will be joining Adobe Research as a research scientist.
  • 04/06/2015: I am looking for a full time position on computer vision and machine learning.
  • 11/22/2014: I am visiting Prof. Honglak Lee at UMich, Ann Arbor.

Research Highlights

3D View Synthesis

Video Prediction

Bowl
Clean and Jerk
Bench Press
Golf Swing
Baseball Swing
Baseball Pitch

Human Motion Synthesis

Publications

(My Google scholar page)

    2017

    Learning to Generate Long-term Future via Hierarchical Prediction
    Ruben Villegas, Jimei Yang, Yuliang Zou, Sungryull Sohn, Xunyu Lin and Honglak Lee
    International Conference on Machine Learning (ICML)), Sydney, Australia, 2017. [paper] [project] [code coming soon]

    Transformation-Grounded Image Generation Network for Novel 3D View Synthesis
    Eunbyung Park, Jimei Yang, Ersin Yumer, Duygu Ceylan, Alex Berg
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. [paper] [project] [arXiv]

    Forecasting Human Dynamics from Static Images
    Yu-Wei Chao, Jimei Yang, Brian Price, Scott Cohen, Jia Deng
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. [paper] [project] [arXiv]

    Generative Face Completion
    Yijun Li, Sifei Liu, Jimei Yang, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. [paper] [project]

    Diversified Texture Synthesis with Feed-forward Networks
    Yijun Li, Chen Fang, Jimei Yang, Zhaowen Wang, Xin Lu, Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, 2017. (spotlight) [paper] [project]

    Decomposing Motion and Content for Natural Video Sequence Prediction
    Ruben Villegas, Jimei Yang, Seunghoon Hong, Xunyu Lin and Honglak Lee
    International Conference on Learning Representations (ICLR), Toulon, France, 2017 [paper] [project] [code coming soon]

    Top-Down Visual Saliency via Joint CRF and Dictionary Learning
    Jimei Yang and Ming-Hsuan Yang
    IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 39, No. 3, March 2017 [paper]

    2016

    Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervision
    Xinchen Yan, Jimei Yang, Ersin Yumer and Honglak Lee
    Advances in Neural Information Processing Systems (NIPS), Barcelona, Spain, 2016 [paper] [supp] [code]

    Attribute2Image: Conditional Image Generation from Visual Attributes
    Xinchen Yan, Jimei Yang, Kihyuk Sohn and Honglak Lee
    European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands, 2016 [paper] [arXiv] [project] [code] [demo]

    Object Contour Detection with a Fully Convolutional Encoder-Decoder Network
    Jimei Yang, Brian Price, Scott Cohen, Honglak Lee and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016. (spotlight) [paper] [arXiv] [project]

    Deep Interactive Object Selection
    Ning Xu, Brian Price, Scott Cohen, Jimei Yang and Thomas Huang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016. [paper]

    Object Tracking via Dual Linear Structured SVM and Explicit Feature Map
    Jifeng Ning, Jimei Yang, Shaojie Jiang, Lei Zhang and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016. [paper] [code] [project]

    2015

    Weakly-supervised Disentangling with Recurrent Transformations for 3D View Synthesis
    Jimei Yang, Scott Reed, Ming-Hsuan Yang and Honglak Lee
    Advances in Neural Information Processing Systems (NIPS), Montreal, Canada, 2015. [paper] [arXiv] [slides] [demo] [talk video] [GitHub]

    PatchCut: Data-Driven Object Segmentation via Local Shape Transfer
    Jimei Yang, Brian Price, Scott Cohen, Zhe Lin and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015. [paper] [results]

    Multi-Objective Convolutional Learning for Face Labeling
    Sifei Liu, Jimei Yang, Chang Huang and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, 2015. [paper]

    Extracting Image Regions by Structured Edge Detection
    Yi-Ting Chen, Jimei Yang and Ming-Hsuan Yang
    IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa Beach, HI, 2015. [paper] [code]

    2014

    Max-Margin Boltzmann Machines for Object Segmentation
    Jimei Yang, Simon Safar and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, 2014. [paper] [supp] [code] [Caltech-UCSD Birds 200 masks]

    Context Driven Scene Parsing with Attention to Rare Classes
    Jimei Yang, Brian Price, Scott Cohen and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, 2014. (oral) [paper] [slides] [code] [Results on SIFTflow] [Results on LMSun]

    2013

    Exemplar Cut
    Jimei Yang, Yi-Hsuan Tsai and Ming-Hsuan Yang
    International Conference on Computer Vision (ICCV), Sydney, Australia, 2013 [paper] [supp] [code]

    Decomposed Learning for Joint Object Segmentation and Categorization
    Yi-Hsuan Tsai, Jimei Yang and Ming-Hsuan Yang
    British Machine Vision Conference (BMVC), Bristol, United Kingdom, 2013 [paper]

    2012

    Top-Down Visual Saliency via Joint CRF and Dictionary Learning
    Jimei Yang and Ming-Hsuan Yang
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, 2012 [paper] [code]

    Transferring Visual Prior for Online Object Tracking
    Qing Wang, Feng Chen, Jimei Yang, Wenli Xu and Ming-Hsuan Yang
    IEEE Transactions on Image Processing (TIP), Vol. 21, No. 7, July, 2012 [paper]

    2011

    Learning Hierarchical Image Representation with Sparsity, Saliency and Locality
    Jimei Yang and Ming-Hsuan Yang
    British Machine Vision Conference (BMVC), Dundee, United Kingdom, 2011 (oral) [paper] [code]

    Before 2010

    Learning Mappings for Face Synthesis from Near Infrared to Visual Light Images
    Jie Chen, Dong Yi, Jimei Yang, Guoying Zhao, Stan Z. Li, Matti Pietikäinen
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, 2009 [paper]

    Automatic Partial Face Alignment in NIR Video Sequences
    Jimei Yang, Shengcai Liao, Stan Z. Li
    IAPR/IEEE Conference on Biometrics (ICB), Sardinia Island, Italy, 2009 [paper]

    An Analysis-by-Synthesis Method for Heterogeneous Face Biometrics
    Rui Wang, Jimei Yang, Dong Yi, Stan Z. Li
    IAPR/IEEE Conference on Biometrics (ICB), Sardinia Island, Italy, 2009 [paper]

    A Fast Incremental Algorithm for Low Rank Approximations of Matrices and Its Applications in Facial Images
    Jimei Yang, Shiming Xiang, Rong Liu, Zengfu Wang, Stan Z. Li
    Journal of University of Science and Technology of China, Volume 39, Number 9, September, 2009 [paper]

Professional Activities

  • Conference Reviewer
    • NIPS 2013, 2014, 2015, 2016, 2017
    • CVPR 2015, 2016, 2017
    • ICCV 2015, 2017
    • ECCV 2014, 2016
    • ICML 2016, 2017
    • ICLR 2016, 2017
    • IJCAI 2016
    • IROS 2012
  • Journal Reviewer
    • IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
    • IEEE Transactions on Image Processing (TIP)
    • Computer Vision and Image Understanding (CVIU)
    • Image and Visual Computing (IVC)
    • Neural Networks
    • Pattern Recognition
    • Machine Vision and Applications (MVA)