Skip to menu Skip to content Skip to footer
Dr Xin Yu
Dr

Xin Yu

Email: 

Overview

Background

My name is Xin Yu, a Senior Lecturer at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.

My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.

Availability

Dr Xin Yu is:
Available for supervision

Research impacts

One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.

I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.

I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.

Works

Search Professor Xin Yu’s works on UQ eSpace

152 works between 2011 and 2025

81 - 100 of 152 works

2022

Journal Article

Pro-UIGAN: progressive face hallucination from occluded thumbnails

Zhang, Yang, Yu, Xin, Lu, Xiaobo and Liu, Ping (2022). Pro-UIGAN: progressive face hallucination from occluded thumbnails. IEEE Transactions On Image Processing, 31, 3236-3250. doi: 10.1109/TIP.2022.3167280

Pro-UIGAN: progressive face hallucination from occluded thumbnails

2022

Conference Publication

Batch Multi-Fidelity Active Learning with Budget Constraints

Li, Shibo, Phillips, Jeff M., Yu, Xin, Kirby, Robert M. and Zhe, Shandian (2022). Batch Multi-Fidelity Active Learning with Budget Constraints. 36th Conference on Neural Information Processing Systems (NeurIPS 2022), Online, 28 November - 9 December 2022. Maryland Heights, MO United States: Morgan Kaufmann Publishers.

Batch Multi-Fidelity Active Learning with Budget Constraints

2022

Journal Article

Understanding atomic hand-object interaction with human intention

Fan, Hehe, Zhuo, Tao, Yu, Xin, Yang, Yi and Kankanhalli, Mohan (2022). Understanding atomic hand-object interaction with human intention. IEEE Transactions On Circuits and Systems for Video Technology, 32 (1), 275-285. doi: 10.1109/TCSVT.2021.3058688

Understanding atomic hand-object interaction with human intention

2021

Conference Publication

End-to-end multi-instance robotic reaching from monocular vision

Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2021). End-to-end multi-instance robotic reaching from monocular vision. IEEE International Conference on Robotics and Automation (ICRA), Xian, China, 30 May - 5 June 2021. Washington, DC United States: IEEE Computer Society. doi: 10.1109/ICRA48506.2021.9561518

End-to-end multi-instance robotic reaching from monocular vision

2021

Conference Publication

Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion

Wang, Suzhen, Li, Lincheng, Ding, Yu, Fan, Changjie and Yu, Xin (2021). Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion. Thirtieth International Joint Conference on Artificial Intelligence, Montreal, Canada, 19-27 August 2021. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2021/152

Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion

2021

Conference Publication

The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose

Ben-Shabat, Yizhak, Yu, Xin, Saleh, Fatemeh, Campbell, Dylan, Rodriguez-Opazo, Cristian, Li, Hongdong and Gould, Stephen (2021). The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE Computer Society. doi: 10.1109/WACV48630.2021.00089

The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose

2021

Conference Publication

Auto-navigator: decoupled neural architecture search for visual navigation

Tang, Tianqi, Yu, Xin, Dong, Xuanyi and Yang, Yi (2021). Auto-navigator: decoupled neural architecture search for visual navigation. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE. doi: 10.1109/WACV48630.2021.00379

Auto-navigator: decoupled neural architecture search for visual navigation

2021

Conference Publication

Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation

Ding, Yuhang, Yu, Xin and Yang, Yi (2021). Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i2.16212

Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation

2021

Conference Publication

Write-a-speaker: Text-based emotional and rhythmic talking-head generation

Li, Lincheng, Wang, Suzhen, Zhang, Zhimeng, Ding, Yu, Zheng, Yixing, Yu, Xin and Changjie Fan (2021). Write-a-speaker: Text-based emotional and rhythmic talking-head generation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i3.16286

Write-a-speaker: Text-based emotional and rhythmic talking-head generation

2021

Conference Publication

PSTNET: point spatio-temporal convolution on point cloud sequences

Fan, Hehe, Yu, Xin, Ding, Yuhang, Yang, Yi and Kankanhalli, Mohan (2021). PSTNET: point spatio-temporal convolution on point cloud sequences. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. International Conference on Learning Representations, ICLR.

PSTNET: point spatio-temporal convolution on point cloud sequences

2021

Conference Publication

VTNET: visual transformer network for object goal navigation

Du, Heming, Yu, Xin and Zheng, Liang (2021). VTNET: visual transformer network for object goal navigation. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. Appleton WI USA: International Conference on Learning Representations.

VTNET: visual transformer network for object goal navigation

2021

Journal Article

Learning with noisy labels via self-reweighting from class centroids

Ma, Fan, Wu, Yu, Yu, Xin and Yang, Yi (2021). Learning with noisy labels via self-reweighting from class centroids. IEEE Transactions On Neural Networks and Learning Systems, 33 (11), 6275-6285. doi: 10.1109/TNNLS.2021.3073248

Learning with noisy labels via self-reweighting from class centroids

2021

Journal Article

Progressive transfer learning for face anti-spoofing

Quan, Ruijie, Wu, Yu, Yu, Xin and Yang, Yi (2021). Progressive transfer learning for face anti-spoofing. IEEE Transactions on Image Processing, 30, 3946-3955. doi: 10.1109/TIP.2021.3066912

Progressive transfer learning for face anti-spoofing

2021

Conference Publication

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation

Liu, Jinhui, Zou, Zhikang, Ye, Xiaoqing, Tan, Xiao, Ding, Errui, Xu, Feng and Yu, Xin (2021). Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation. European Conference on Computer Vision ECCV 2020, Glasgow, United Kingdom, 23–28 August 2020. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-66096-3_47

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation

2021

Conference Publication

RGB-D saliency detection via cascaded mutual information minimization

Zhang, Jing, Fan, Deng-Ping, Dai, Yuchao, Yu, Xin, Zhong, Yiran, Barnes, Nick and Shao, Ling (2021). RGB-D saliency detection via cascaded mutual information minimization. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.00430

RGB-D saliency detection via cascaded mutual information minimization

2021

Conference Publication

A general approach to state refinement

Kennedy, Gerard, Gao, Jin, Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2021). A general approach to state refinement. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Virtual, 27 September - 1 October 2021. Piscataway, NJ, United States: IEEE. doi: 10.1109/IROS51168.2021.9636400

A general approach to state refinement

2021

Conference Publication

Self-supervised visibility learning for novel view synthesis

Shi, Yujiao, Li, Hongdong and Yu, Xin (2021). Self-supervised visibility learning for novel view synthesis. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Washington, DC, United States: I E E E Computer Society. doi: 10.1109/CVPR46437.2021.00955

Self-supervised visibility learning for novel view synthesis

2021

Conference Publication

Joint 3D human shape recovery and pose estimation from a single image with bilayer graph

Yu, Xin, van Baar, Jeroen and Chen, Siheng (2021). Joint 3D human shape recovery and pose estimation from a single image with bilayer graph. 9th International Conference on 3D Vision (3DV), London, United Kingdom, 1-3 December 2021. Piscataway, NJ United States: IEEE Computer Society. doi: 10.1109/3DV53792.2021.00060

Joint 3D human shape recovery and pose estimation from a single image with bilayer graph

2021

Conference Publication

Super-resolving cross-domain face miniatures by peeking at one-shot exemplar

Li, Peike, Yu, Xin and Yang, Yi (2021). Super-resolving cross-domain face miniatures by peeking at one-shot exemplar. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.00443

Super-resolving cross-domain face miniatures by peeking at one-shot exemplar

2021

Conference Publication

Few-shot Weighted Style Matching for Glaucoma Detection

Liu, Jinhui and Yu, Xin (2021). Few-shot Weighted Style Matching for Glaucoma Detection. First CAAI International Conference, CICAI 2021, Hangzhou, China, 5–6 June 2021. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-93046-2_25

Few-shot Weighted Style Matching for Glaucoma Detection

Supervision

Availability

Dr Xin Yu is:
Available for supervision

Before you email them, read our advice on how to contact a supervisor.

Supervision history

Current supervision

  • Doctor Philosophy

    Advancing Human Perception: Countering Evolving Malicious Fake Visual Data

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Automatic Retinal Health Monitoring through Multi-modal Medical Imaging

    Principal Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

  • Doctor Philosophy

    Understanding Human Intention and Performance

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Combating evolving deceptive fake visual information through deepfake detection

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Understanding Human Intention and Performance

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Enhancing Building Fire Safety by Utilising Machine Learning Techniques

    Principal Advisor

    Other advisors: Professor Brian Lovell

  • Doctor Philosophy

    Human Posture Recognition Applied to Physical Activity

    Principal Advisor

    Other advisors: Professor Sean Tweedy

  • Doctor Philosophy

    Two way Auslan Translation

    Principal Advisor

    Other advisors: Professor Helen Huang

  • Doctor Philosophy

    Two way Auslan Translation

    Principal Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

  • Doctor Philosophy

    Towards Efficient Pest Detection in Agriculture

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Multimodal foundation model design and analysis

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    The prediction, diagnosis, and severity estimation models for plant disease

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Remote Sensing Analysis in computer vision

    Associate Advisor

    Other advisors: Professor Helen Huang

  • Doctor Philosophy

    Data driven approaches for smart farming

    Associate Advisor

    Other advisors: Professor Helen Huang

  • Doctor Philosophy

    Enhancing Robustness and Generalizability in Computational Models

    Associate Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

Media

Enquiries

For media enquiries about Dr Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team:

communications@uq.edu.au