Welcome To Vision and Learning Lab!
About us

Vision and Learning Lab

The Vision and Learning Laboratory (VLLab), formerly named Computer Vision Laboratory (CVLab), was founded in the Research Center for Information Technology Innovation, Academia Sinica in January 2011, under the supervision of Dr. Yen-Yu Lin. Since August 2019, this laboratory was relocated to the Department of Computer Science, National Chiao Tung University. We dedicate ourselves to the development of cutting-edge technologies for computer vision, machine learning, pattern recognition, deep learning, and artificial intelligence.


RECENT NEWS


  • Congratulations! Our paper was accepted by AAAI 2020
    Yung-Han Huang, Kuang-Jui Hsu, Shyh-Kang Jeng, and Yen-Yu Lin, "Weakly-supervised Video Re-localization with Multiscale Attention Model," AAAI Conference on Artificial Intelligence (AAAI), February 2020.

  • Congratulations! Our paper was accepted by WACV 2020
    Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Yen-Yu Lin, Xiaohui Xie, and Wei Fan, "DGGAN: Depth-image Guided Generative Adversarial Networks for Disentangling RGB and Depth Images for 3D Hand Pose Estimation," IEEE Winter Conference on Applications of Computer Vision (WACV), March 2020.

  • Congratulations! Our paper was accepted by NeurIPS 2019
    Cheng-Chun Hsu*, Kuang-Jui Hsu*, Chung-Chi Tsai, Yen-Yu Lin, and Yung-Yu Chuang, "Weakly Supervised Instance Segmentation using the Bounding Box Tightness Prior," Thirty-third Conference on Neural Information Processing Systems (NeurIPS), December 2019.

  • Congratulations! Our paper was accepted by IJCV 2019
    Yi-Wen Chen, Yi-Hsuan Tsai, Yen-Yu Lin, and Ming-Hsuan Yang, "VOSTR: Video Object Segmentation via Transferable Representations," to appear in International Journal of Computer Vision (IJCV).

  • Congratulations! Our paper was accepted by ICCV 2019
    Yu-Jhe Li, Yun-Chun Chen, Yen-Yu Lin, Xiaofei Du, and Yu-Chiang Frank Wang, "Recover and Identify: A Generative Dual Model for Cross-Resolution Person Re-Identification," IEEE International Conference on Computer Vision (ICCV), October 2019.

  • Congratulations! Our paper was accepted by TMM 2019
    Chung-Chi Tsai, Kuang-Jui Hsu, Yen-Yu Lin, Xiaoning Qian, and Yung-Yu Chuang, "Deep Co-saliency Detection via Stacked Autoencoder-enabled Fusion and Self-trained CNNs," to appear in IEEE Transactions on Multimedia (TMM).

2019/07/19 Congratulations! One paper was accepted by AVSS 2019
Wen-Li Wei, Jen-Chun Lin, Yen-Yu Lin, and Hong-Yuan Mark Liao, "What Makes You Look Like You: Learning an Inherent Feature Representation for Person Re-Identification," has been accepted for AVSS 2019.
2019/07/19 Congratulations! One paper was accepted by BMVC 2019
Liangjian Chen, Shih-Yao Lin, Yusheng Xie, Hui Tang, Yufan Xue, Yen-Yu Lin, Xiaohui Xie, and Wei Fan, "TAGAN: Tonality Aligned Generative Adversarial Networks for Realistic Hand Pose Synthesis," has been accepted for BMVC 2019.
2019/07/19 Congratulations! One paper was accepted by BMVC 2019
Yi-Wen Chen, Yi-Hsuan Tsai, Tiantian Wang, Yen-Yu Lin, and Ming-Hsuan Yang, "Referring Expression Object Segmentation with Caption-Aware Consistency," has been accepted for BMVC 2019.
2019/06/16 Congratulations! One paper will be published in IEEE Trans. on Image Processing
Kuang-Jui Hsu, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "Weakly Supervised Salient Object Detection by Learning A Classifier-Driven Map Generator," has been accepted for IEEE Trans. on Image Processing (TIP), volume 28, number 11, pages 5435-5449, November 2019.
2019/04/14 Congratulations! Yi-Tung Liao won IICM best master thesis award.
Hyperlink (IICM best master thesis award): http://www.iicm.org.tw/award/paper2018.pdf
2019/02/26 Congratulations! Three paper were accepted by CVPR 2019
Congratulations to Tsun-Yi Yang, Yi-Ting Chen, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "FSA-Net: Learning Fine-Grained Structure Aggregation for Head Pose Estimation from a Single Image" has been accepted for CVPR 2019.

Congratulations to Yun-Chun Chen, Yen-Yu Lin, Ming-Hsuan Yang, and Jia-Bin Huang! Our work entitled "CrDoCo: Pixel-level Domain Transfer with Cross-Domain Consistency" has been accepted for CVPR 2019.

Congratulations to Kuang-Jui Hsu, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "DeepCO3: Deep Instance Co-segmentation by Co-peak Search and Co-saliency" has been accepted for CVPR 2019.
2019/02/21 Congratulations! One paper was accepted by DAC 2019
Congratulations to Yu-Chuan Chang, Wei-Ming Chen, Pi-Cheng Hsiu, Yen-Yu Lin, and Tei-Wei Kuo! Our work entitled "LSIM: Ultra Lightweight Similarity Measurement for Mobile Graphics Applications" has been accepted for DAC 2019.
2018/11/07 Congratulations! One paper was accepted by AAAI 2019
Congratulations to Yu-Lun Liu, Yi-Tung Liao, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "Deep Video Frame Interpolation using Cyclic Frame Generation" has been accepted for AAAI 2019.
2018/10/05 Congratulations! Two papers were accepted by ACCV 2018
Congratulations to Yun-Chun Chen, Po-Hsiang Huang, Li-Yu Yu, Jia-Bin Huang, Ming-Hsuan Yang, and Yen-Yu Lin! Our work entitled "Deep Semantic Matching with Foreground Detection and Cycle-Consistency" has been accepted for ACCV 2018.

Yi-Wen Chen, Yi-Hsuan Tsai, Chu-Ya Yang, Yen-Yu Lin, and Ming-Hsuan Yang! Our work entitled "Unseen Object Segmentation in Videos via Transferable Representations" has been accepted for ACCV 2018.
2018/07/23 Congratulations! One paper will be published in IEEE Trans. on Image Processing
Congratulations to Chung-Chi Tsai, Weizhi Li, Kuang-Jui Hsu, Xiaoning Qian, and Yen-Yu Lin! Our work entitled "Image Co-saliency Detection and Co-segmentation via Progressive Joint Optimization" has been accepted for IEEE Trans. on Image Processing (TIP).
2018/07/04 Congratulations! One papers was accepted by ECCV 2018
Congratulations to Kuang-Jui Hsu, Chung-Chi Tsai, Yen-Yu Lin, Xiaoning Qian, and Yung-Yu Chuang! Our work entitled "Unsupervised CNN-based Co-saliency Detection with Graphical Optimization" has been conditionally accepted for ECCV 2018.
2018/07/04 Congratulations! Two papers were accepted by BMVC 2018
Congratulations to Wei-Chih Hung, Yi-Hsuan Tsai, Yan-Ting Liou, Yen-Yu Lin, and Ming-Hsuan Yang! Our work entitled "Adversarial Learning for Semi-supervised Semantic Segmentation" has been accepted for BMVC 2018.

Congratulations to Shih-Yao Lin and Yen-Yu Lin! Our work entitled "Augmenting Mo-cap Data with Neural Data Translation for Human Action Recognition" has been accepted for BMVC 2018.
2018/07/04 Congratulations! Dr. Yen-Yu Lin receives The Young Scholars' Creativity Award 2018 from Foundation for the Advancement of Outstanding Scholarship
2018/06/13 Congratulations! One paper will be published in IEEE Trans. on Image Processing
Congratulations to Chun-Rong Huang, Wei-Cheng Wang, Wei-An Wang, Szu-Yu Lin, and Yen-Yu Lin! Our work entitled "USEQ: Ultra-Fast Superpixel Extraction via Quantization" has been accepted for IEEE Trans. on Image Processing (TIP).
2018/06/06 Congratulations! One paper was accepted by ICIP 2018
Congratulations to Wei-Cheng Wang, Hsin-Wei Cheng, Chun-Rong Huang, and Yen-Yu Lin! Our work entitled "Clustering Trajectories in Heterogeneous Representations for Video Event Detection" has been accepted for ICIP 2018.
2018/04/27 Congratulations! Dr. Yen-Yu Lin receives the Exploration Research Award 2018 from the Pan Wen-Yuan Foundation
2018/04/23 Congratulations! Two papers were accepted by IJCAI 2018
Congratulations to Kuang-Jui Hsu, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "Co-attention CNNs for Unsupervised Object Co-segmentation" has been conditionally accepted for IJCAI 2018.

Congratulations to Tsun-Yi Yang, Yi-Hsuan Huang, Yen-Yu Lin, Pi-Cheng Hsiu, and Yung-Yu Chuang! Our work entitled "SSR-Net: A Compact Soft Stagewise Regression Network for Age Estimation" has been accepted for IJCAI 2018.
2018/04/23 Congratulations! Ya-Fang Shih won IICM best master thesis award.
Hyperlink (IICM best master thesis award): http://www.iicm.org.tw/award/paper2017.pdf
2017/11/13 Congratulations! One paper was accepted by AAAI 2018
Congratulations to Ting-Kuei Hu, Yen-Yu Lin, and Pi-Cheng Hsiu! Our work entitled "Learning Adaptive Hidden Layers for Mobile Gesture Recognition" has been accepted for AAAI 2018.
2017/07/18 Congratulations! One paper was accepted by ICCV 2017
Congratulations to Tsun-Yi Yang, Jo-Han Hsu, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "DeepCD: Learning Deep Complementary Descriptors for Patch Representations" has been accepted for ICCV 2017.
2017/07/07 Congratulations! One paper was accepted by BMVC 2017
Congratulations to Kuang-Jui Hsu, Yen-Yu Lin, and Yung-Yu Chuang! Our work entitled "Weakly Supervised Saliency Detection with A Category-Driven Map Generator" has been accepted for BMVC 2017.

Our Team

Laboratory Director

Dr. Yen-Yu Lin

[Website]

Ph.D., Department of Computer Science and Information Engineering, National Taiwan University

Research Interests:
  • Computer Vision
  • Machine Learning
  • Deep Learning
  • Artificial Intelligence
Contact Information:
  • E-mail: lin[at]cs.nctu.edu.tw
  • Tel: +886-3-5712121 ext.54781

 

Research Assistants

Cheng-Chun Hsu

Bachelor, Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology

Advisors: Dr. Pi-Cheng Hsiu and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
Contact Information:
  • E-mail: hsu06118[at]iis.sinica.edu.tw

Han-Yi Wang

M.S., Department of Computer Science and Information Engineering, National Cheng Kung University

Advisors: Dr. Pi-Cheng Hsiu and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Machine Learning
Contact Information:
  • E-mail: wanghy917[at]gmail.com

 

Ph.D. Students

Han-Yi Lin

Ph.D. student, Department of Computer Science and Information Engineering, National Taiwan University

Advisors: Dr. Tei-Wei Kuo and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Deep Learning
Contact Information:
  • E-mail: d03922006[at]csie.ntu.edu.tw

Yu-Lun Liu

Ph.D. student, Department of Computer Science and Information Engineering, National Taiwan University

Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Deep Learning
  • Video Frame Interpolation
Contact Information:
  • E-mail: yulunliu[at]cmlab.csie.ntu.edu.tw

Cheng-Kun Yang

Ph.D. student, Department of Computer Science and Information Engineering, National Taiwan University

Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Deep Learning
  • Medical Imaging
Contact Information:
  • E-mail: d08922002[at]ntu.edu.tw

 

M.S. Students

Ching-Yuan Lin

M.S. Student, Department of Electrical Engineering, National Tsing Hua University

Advisors: Dr. Chia-Wen Lin and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Deep Learning
Contact Information:
  • E-mail: fantc.lin[at]gapp.nthu.edu.tw

De-Le Wang

M.S. Student, Departure of Electrical Engineering, National Tsing Hua University

Advisors: Dr. Chia-Wen Lin and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Image Processing
  • Deep Learning
Contact Information:
  • E-mail: alfwang[at]cloud.nthu.edu.tw

Yan-Ting Liou

M.S. Student, Department of Computer Science and Information Engineering, National Taiwan University

Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin

Research Interests:
  • Computer Vision
  • Rendering

Fu-Ren Tsai

M.S. Student, Institute of Communications Engineering, National Tsing Hua University

Advisors: Dr. Chia-Wen Lin and Dr. Yen-Yu Lin

Research Interests:
  • Salient Object Detection
  • Low-Shot Image Segmentation
Contact Information:
  • E-mail: pp00704831[at]yahoo.com.tw

 

Undergraduate Students

Hao-Cheng Yang

Undergraduate Student, Department of Computer Science, National Chiao Tung University

Research Interests:
  • Computer Vision
Contact Information:
  • E-mail: hcyang.cs06[at]nctu.edu.tw

 

Alumni

Ph.D.


Duration: 2014/09–2019/07
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Deep Feature Learning for Fast and Efficient Regression Application
Next Job: Scape Technologies, UK
Duration: 2014/09–2019/07
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Visual Attention-getting Object Discovery via Learning Weakly Supervised CNNs
Award: Ph.D. Thesis Award, the Chinese Image Processing and Pattern Recognition Society (IPPR), 2019
Next Job: Qualcomm, Taiwan
Duration: 2016/05–2018/08
Institute: Electrical Engineering, Texas A&M University
Advisors: Dr. Xiaoning Qian and Dr. Yen-Yu Lin
Thesis: Image Co-saliency Detection: Novel Approaches with Convex Optimization and Deep Neural Networks
Next Job: Qualcomm, US
Duration: 2014/06–2016/01
Institute: Graduate Institute of Networking and Multimedia, National Taiwan University
Advisors: Dr. Yi-Ping Hung, Dr. Chu-Song Chen, and Dr. Yen-Yu Lin
Thesis: Human Action Recognition based on Probabilistic Graphical Models
Award: Ph.D. Thesis Award, Institute of Information & Computing Machinery (IICM), 2016
Next Job: Bosch Research, USA -> Tencent Medical AI Lab, CA, USA

M.S.


Yi-Hsuan Huang
Duration: 2018/02–2019/09
Institute: Graduate Institute of Networking and Multimedia, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: OSSN: A One-shot Siamese Network for Semantic Segmentation of 3D Point Clouds
Next Job: MediaTek
Chiao-An Yang
Duration: 2017/09–2019/07
Institute: Graduate Institute of Networking and Multimedia, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Soft Ranking Losses for Deep Image Similarity Estimation
Next Job: Research assistant, National Taiwan University
Yung-Han Huang
Duration: 2017/09–2019/07
Institute: Data Science Degree Program, NTU & Sinica
Advisors: Dr. Shyh-Kang Jeng and Dr. Yen-Yu Lin
Thesis: Weakly Supervised Video Re-localization of Action Segments with Multiscale Attention Model
Next Job:
Yi-Tung Liao
Duration: 2016/09–2018/07
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Deep Video Frame Interpolation using Cyclic Frame Generation
Award: M.S. Thesis Award, Institute of Information & Computing Machinery (IICM), 2018
Next Job: World Quant
Jo-Han Hsu
Duration: 2015/09–2017/06
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Distilling from the Past: Self-Distillation by Using Epoch Regularization
Next Job: HTC
Ya-Fang Shih
Duration: 2016/02–2017/06
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Deep Co-occurrence Feature Learning for Visual Object Recognition
Award: M.S. Thesis Award, Institute of Information & Computing Machinery (IICM), 2017; M.S. Thesis Award, the Chinese Image Processing and Pattern Recognition (IPPR) Society, 2017
Next Job: HTC -> Verisk Analytics
Duration: 2013/08–2015/06
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Bing-Yu Chen and Dr. Yen-Yu Lin
Thesis: DescriptorBoost: An Unsupervised Approach to Fusing Multiple Descriptors in the Homography Space
Next Job: ULSee -> Ph.D. Student, Electrical and Computer Engineering, University of Illinois Urbana-Champaign
Han-Yi Tsai
Duration: 2013/06–2014/12
Institute: Computer Science and Information Engineering, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Patch Match with Multiple Descriptors for Scene Alignment
Next Job: Dynacolor
Duration: 2011/04–2013/06
Institute: Graduate Institute of Networking and Multimedia, National Taiwan University
Advisors: Dr. Yung-Yu Chuang and Dr. Yen-Yu Lin
Thesis: Augmented Multiple Instance Regression for Inferring Object Contours within Bounding Boxes
Award: M.S. Thesis Award, Institute of Information & Computing Machinery (IICM), 2013
Next Job: Ph.D. Student, Computer Science and Information Engineering, National Taiwan University
Yi-Chen Wang
Duration: 2011/07–2012/06
Institute: Graduate Institute of Communication Engineering, National Taiwan University
Advisors: Dr. Shyh-Kang Jeng and Dr. Yen-Yu Lin
Thesis: Anomaly Detection Localization via Foreground Motion Information
Next Job: Taiwan Semiconductor Manufacturing Company
Chin-An Lin
Duration: 2011/07–2012/06
Institute: Graduate Institute of Communication Engineering, National Taiwan University
Advisors: Dr. Shyh-Kang Jeng and Dr. Yen-Yu Lin
Thesis: An Efficient Temporal Model for Action Recognition Using Multivariate Linear Prediction
Award: Best Master Thesis Award, Institute of Information & Computing Machinery (IICM), 2012
Next Job: Quanta Research Institute

Research Assistants


Wei-Cheng Wang
2018/03–2019/07
Next Job: Ph.D. Student, Computer Science Engineering, Ghent University
Yi-Ting Chen
2018/07–2019/07
Next Job: M.S. student, Master of Science in Computer Vision, Robotics Institute, Carnegie Mellon University
Yi-Wen Chen
2017/07–2019/06
Next Job: Ph.D. Student, Electrical Engineering and Computer Science, University of California, Merced
Hao-Hsiang Hung
2017/07–2019/03
Next Job: M.S. student, Computer Science and Information Engineering, National Taiwan University
Chia-Chen Ho
2018/07–2019/03
Next Job: Research assistant, Computer Science, National Tsing Hua University
Yun-Chun (Johnny) Chen
2018/07–2019/03
Next Job: Short-term Visiting Scholar, Bradley Department of Electrical and Computer Engineering, Virginia Tech
Yu-Chiang Cheng
2017/09–2019/02
Next Job:
Chao-Te Chou
2017/07–2019/02
Next Job: Military service
Yang-Ming Yeh
2015/09–2018/07
Next Job: Ph.D. student, Graduate Institute of Electronics Engineering, National Taiwan University
Ting-Kuei Hu
2015/09–2018/07
Next Job: M.S. Student, Computer Science & Engineering, Texas A&M University
Yu-Kai Chiu
2018/05–2018/07
Next Job: M.S. student, Master of Entertainment Technology, School of Computer Science, Carnegie Mellon University
Li-Yu Yu
2016/07–2017/11
Next Job: M.S. student, Electrical Engineering, National Taiwan University
Po-Hsiang Huang
2016/07–2017/11
Next Job: M.S. student, Electrical Engineering, National Taiwan University
Fu-Yu Chuang
2016/07–2017/09
Next Job: M.S. student, Electrical Engineering, National Taiwan University
Chu-Ya Yang
2016/07–2017/08
Next Job: Research assistant, IIS, Academia Sinica -> M.S. Student, Computer Science, Texas A&M University
Hao-Hsuan Chang
2016/09–2017/06
Next Job: Ph.D. Student, Electrical and Computer Engineering, Virginia Tech
An An Yu
2016/01–2016/07
Next Job: Google
Wan-Rou Liu
2016/01–2016/05
Pai-Heng Hsiao
2013/11–2015/12
Next Job: Umbo CV -> Memorence AI
Wei-Sheng Lai
2014/09–2015/07
Next Job: Ph.D. Student, Electrical Engineering and Computer Science, University of California, Merced
Hsiao-Hang Su
2014/07–2015/04
Next Job: Undergraduate, School of Dentistry, Kaohsiung Medical University
Min-Hung Chen
2013/07–2014/07
Next Job: Ph.D. Student, Electrical and Computer Engineering, Georgia Institute of Technology
Hsiao-Tung Chen
2013/07–2014/07
Next Job: M.S. Student, Electrical and Computer Engineering, Cornell University -> Amazon
Hsin-Yi Chen
2011/07–2014/06
Next Job: Ph.D. Student, Computer Science and Information Engineering, National Taiwan University -> NVIDIA
Feng-Ju Chang
2011/08–2013/07
Next Job: Ph.D. Student, Electrical Engineering, University of Southern California
Yao-Chuan Chang
2012/06–2013/06
Next Job: Ph.D. Student, Biomedical Engineering, University of Southern California
Jeng-Tsung Tsai
2012/07–2013/06
Next Job: M.S. Student, Computer Science, University of Southern California -> MathWorks
Ju-Hsuan Hua
2012/08–2013/06
Next Job: M.S. Student, Robotics, Carnegie Mellon University
Tsung-Yi Lin
2011/02–2011/07
Next Job: Ph.D. Student, Computer Science, University of California, San Diego

PUBLICATIONS

Contact Us

Lab Location

    EC118, Engineering Building 3, 1001 University Road, Hsinchu 300, Taiwan