Overview
Background
My name is Xin Yu, an Associate Professor at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.
My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.
Availability
- Associate Professor Xin Yu is:
- Available for supervision
Research impacts
One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.
I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.
I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.
Works
Search Professor Xin Yu’s works on UQ eSpace
2022
Conference Publication
Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields
Yao, Guangming, Wu, Hongzhi, Yuan, Yi, Li, Lincheng, Zhou, Kun and Yu, Xin (2022). Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields. Thirty-First International Joint Conference on Artificial Intelligence IJCAI-ECAI 2022, Vienna, Austria, 23-29 July 2022. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2022/218
2022
Conference Publication
One-shot talking face generation from single-speaker audio-visual correlation learning
Wang, Suzhen, Li, Lincheng, Ding, Yu and Yu, Xin (2022). One-shot talking face generation from single-speaker audio-visual correlation learning. 36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, Online, 22 February –1 March 2022. Palo Alto, CA United States: ASSOC. doi: 10.1609/aaai.v36i3.20154
2022
Conference Publication
Monocular camera-based point-goal navigation by learning depth channel and cross-modality pyramid fusion
Tang, Tianqi, Du, Heming, Yu, Xin and Yang, Yi (2022). Monocular camera-based point-goal navigation by learning depth channel and cross-modality pyramid fusion. 36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, Online, 22 February –1 March 2022. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v36i5.20480
2022
Journal Article
High frame rate video reconstruction based on an event camera
Pan, Liyuan, Hartley, Richard, Scheerlinck, Cedric, Liu, Miaomiao, Yu, Xin and Dai, Yuchao (2022). High frame rate video reconstruction based on an event camera. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (5), 2519-2533. doi: 10.1109/TPAMI.2020.3036667
2022
Journal Article
Single-image deraining via recurrent residual multiscale networks
Zheng, Yupei, Yu, Xin, Liu, Miaomiao and Zhang, Shunli (2022). Single-image deraining via recurrent residual multiscale networks. IEEE Transactions On Neural Networks and Learning Systems, 33 (3), 1310-1323. doi: 10.1109/TNNLS.2020.3041752
2022
Conference Publication
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm
Ferguson, Mikey, Good, Aidan, Lin, Jiaqi, Serra, Thiago, Sieg, Hannah, Wieczorek, Jerzy, Yu, Xin and Zhe, Shandian (2022). Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm. San Diego, California, USA: Neural Information Processing Systems Foundation, Inc. (NeurIPS). doi: 10.52202/068431-2374
2022
Journal Article
Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting
Xu, Yunqiu, Yu, Xin, Zhang, Jing, Zhu, Linchao and Wang, Dadong (2022). Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting. IEEE Transactions On Image Processing, 31, 2148-2161. doi: 10.1109/TIP.2022.3151999
2022
Journal Article
Pro-UIGAN: progressive face hallucination from occluded thumbnails
Zhang, Yang, Yu, Xin, Lu, Xiaobo and Liu, Ping (2022). Pro-UIGAN: progressive face hallucination from occluded thumbnails. IEEE Transactions On Image Processing, 31, 3236-3250. doi: 10.1109/TIP.2022.3167280
2022
Conference Publication
Batch Multi-Fidelity Active Learning with Budget Constraints
Li, Shibo, Phillips, Jeff M., Yu, Xin, Kirby, Robert M. and Zhe, Shandian (2022). Batch Multi-Fidelity Active Learning with Budget Constraints. 36th Conference on Neural Information Processing Systems (NeurIPS 2022), Online, 28 November - 9 December 2022. Maryland Heights, MO United States: Morgan Kaufmann Publishers.
2022
Journal Article
Understanding atomic hand-object interaction with human intention
Fan, Hehe, Zhuo, Tao, Yu, Xin, Yang, Yi and Kankanhalli, Mohan (2022). Understanding atomic hand-object interaction with human intention. IEEE Transactions On Circuits and Systems for Video Technology, 32 (1), 275-285. doi: 10.1109/TCSVT.2021.3058688
2021
Conference Publication
End-to-end multi-instance robotic reaching from monocular vision
Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2021). End-to-end multi-instance robotic reaching from monocular vision. IEEE International Conference on Robotics and Automation (ICRA), Xian, China, 30 May - 5 June 2021. Washington, DC United States: IEEE Computer Society. doi: 10.1109/ICRA48506.2021.9561518
2021
Conference Publication
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion
Wang, Suzhen, Li, Lincheng, Ding, Yu, Fan, Changjie and Yu, Xin (2021). Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion. Thirtieth International Joint Conference on Artificial Intelligence, Montreal, Canada, 19-27 August 2021. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2021/152
2021
Conference Publication
The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose
Ben-Shabat, Yizhak, Yu, Xin, Saleh, Fatemeh, Campbell, Dylan, Rodriguez-Opazo, Cristian, Li, Hongdong and Gould, Stephen (2021). The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE Computer Society. doi: 10.1109/WACV48630.2021.00089
2021
Conference Publication
Auto-navigator: decoupled neural architecture search for visual navigation
Tang, Tianqi, Yu, Xin, Dong, Xuanyi and Yang, Yi (2021). Auto-navigator: decoupled neural architecture search for visual navigation. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE. doi: 10.1109/WACV48630.2021.00379
2021
Conference Publication
Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation
Ding, Yuhang, Yu, Xin and Yang, Yi (2021). Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i2.16212
2021
Conference Publication
Write-a-speaker: Text-based emotional and rhythmic talking-head generation
Li, Lincheng, Wang, Suzhen, Zhang, Zhimeng, Ding, Yu, Zheng, Yixing, Yu, Xin and Changjie Fan (2021). Write-a-speaker: Text-based emotional and rhythmic talking-head generation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i3.16286
2021
Conference Publication
PSTNET: point spatio-temporal convolution on point cloud sequences
Fan, Hehe, Yu, Xin, Ding, Yuhang, Yang, Yi and Kankanhalli, Mohan (2021). PSTNET: point spatio-temporal convolution on point cloud sequences. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. International Conference on Learning Representations, ICLR.
2021
Conference Publication
VTNET: visual transformer network for object goal navigation
Du, Heming, Yu, Xin and Zheng, Liang (2021). VTNET: visual transformer network for object goal navigation. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. Appleton WI USA: International Conference on Learning Representations.
2021
Journal Article
Learning with noisy labels via self-reweighting from class centroids
Ma, Fan, Wu, Yu, Yu, Xin and Yang, Yi (2021). Learning with noisy labels via self-reweighting from class centroids. IEEE Transactions On Neural Networks and Learning Systems, 33 (11), 6275-6285. doi: 10.1109/TNNLS.2021.3073248
2021
Journal Article
Progressive transfer learning for face anti-spoofing
Quan, Ruijie, Wu, Yu, Yu, Xin and Yang, Yi (2021). Progressive transfer learning for face anti-spoofing. IEEE Transactions on Image Processing, 30, 3946-3955. doi: 10.1109/TIP.2021.3066912
Funding
Current funding
Past funding
Supervision
Availability
- Associate Professor Xin Yu is:
- Available for supervision
Looking for a supervisor? Read our advice on how to choose a supervisor.
Supervision history
Current supervision
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Integrating Deep Learning and Remote Sensing for Precision Agriculture in Staple Crops
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Understanding Human Movements and Sport Performance Analysis
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Combating evolving deceptive fake visual information through deepfake detection
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Human Posture Recognition Applied to Physical Activity
Principal Advisor
Other advisors: Professor Sean Tweedy
-
Doctor Philosophy
Towards Data-Driven Analysis of Handheld Fundus Videos
Principal Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh, Dr Heming Du
-
Doctor Philosophy
Human Understanding in Sports
Principal Advisor
Other advisors: Associate Professor Sen Wang, Dr Heming Du
-
Doctor Philosophy
Compressed Video Restoration
Principal Advisor
Other advisors: Dr Miao Xu, Dr Heming Du
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Dr Heming Du, Dr Miao Xu
-
Doctor Philosophy
Towards Comprehensive Australian Sign Language Understanding: Datasets, Methodologies, and Systems
Principal Advisor
Other advisors: Professor Helen Huang, Dr Heming Du
-
Doctor Philosophy
Effective Visual Data Compression
Associate Advisor
Other advisors: Associate Professor Sen Wang, Dr Heming Du
-
Doctor Philosophy
Pose Estimation for Human with Disabilities
Associate Advisor
Other advisors: Dr Heming Du
-
Doctor Philosophy
Multimodal foundation model design and analysis
Associate Advisor
Other advisors: Dr Miao Xu, Dr Heming Du
-
Doctor Philosophy
Enhancing Robustness and Generalizability in Computational Models
Associate Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
The Unlabeled Truth: Rethinking Medical Imaging Supervision for Foundation Models in the Wild
Associate Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh, Dr Heming Du
-
Doctor Philosophy
Towards knowledge discovery from imperfect and evolving data
Associate Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Remote Sensing Analysis in computer vision
Associate Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Data driven approaches for smart farming
Associate Advisor
Other advisors: Professor Helen Huang
Completed supervision
-
2026
Doctor Philosophy
Object-Centric Audio-Visual Alignment for Sounding Source Segmentation
Principal Advisor
Other advisors: Associate Professor Sen Wang
Media
Enquiries
For media enquiries about Associate Professor Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team: