Overview
Background
My name is Xin Yu, an Associate Professor at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.
My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.
Availability
- Associate Professor Xin Yu is:
- Available for supervision
Research impacts
One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.
I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.
I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.
Works
Search Professor Xin Yu’s works on UQ eSpace
2022
Conference Publication
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm
Ferguson, Mikey, Good, Aidan, Lin, Jiaqi, Serra, Thiago, Sieg, Hannah, Wieczorek, Jerzy, Yu, Xin and Zhe, Shandian (2022). Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm. 36th Conference on Neural Information Processing Systems (NeurIPS), Electr Network, Nov 28-Dec 09, 2022. San Diego, California, USA: Neural Information Processing Systems Foundation, Inc. (NeurIPS). doi: 10.52202/068431-2374
2022
Journal Article
Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting
Xu, Yunqiu, Yu, Xin, Zhang, Jing, Zhu, Linchao and Wang, Dadong (2022). Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting. IEEE Transactions On Image Processing, 31, 2148-2161. doi: 10.1109/TIP.2022.3151999
2021
Conference Publication
End-to-end multi-instance robotic reaching from monocular vision
Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2021). End-to-end multi-instance robotic reaching from monocular vision. IEEE International Conference on Robotics and Automation (ICRA), Xian, China, 30 May - 5 June 2021. Washington, DC United States: IEEE Computer Society. doi: 10.1109/ICRA48506.2021.9561518
2021
Conference Publication
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion
Wang, Suzhen, Li, Lincheng, Ding, Yu, Fan, Changjie and Yu, Xin (2021). Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion. Thirtieth International Joint Conference on Artificial Intelligence, Montreal, Canada, 19-27 August 2021. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2021/152
2021
Conference Publication
The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose
Ben-Shabat, Yizhak, Yu, Xin, Saleh, Fatemeh, Campbell, Dylan, Rodriguez-Opazo, Cristian, Li, Hongdong and Gould, Stephen (2021). The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE Computer Society. doi: 10.1109/WACV48630.2021.00089
2021
Conference Publication
Auto-navigator: decoupled neural architecture search for visual navigation
Tang, Tianqi, Yu, Xin, Dong, Xuanyi and Yang, Yi (2021). Auto-navigator: decoupled neural architecture search for visual navigation. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE. doi: 10.1109/WACV48630.2021.00379
2021
Conference Publication
Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation
Ding, Yuhang, Yu, Xin and Yang, Yi (2021). Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i2.16212
2021
Conference Publication
Write-a-speaker: Text-based emotional and rhythmic talking-head generation
Li, Lincheng, Wang, Suzhen, Zhang, Zhimeng, Ding, Yu, Zheng, Yixing, Yu, Xin and Changjie Fan (2021). Write-a-speaker: Text-based emotional and rhythmic talking-head generation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i3.16286
2021
Conference Publication
PSTNET: point spatio-temporal convolution on point cloud sequences
Fan, Hehe, Yu, Xin, Ding, Yuhang, Yang, Yi and Kankanhalli, Mohan (2021). PSTNET: point spatio-temporal convolution on point cloud sequences. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. International Conference on Learning Representations, ICLR.
2021
Conference Publication
VTNET: visual transformer network for object goal navigation
Du, Heming, Yu, Xin and Zheng, Liang (2021). VTNET: visual transformer network for object goal navigation. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. Appleton WI USA: International Conference on Learning Representations.
2021
Journal Article
Learning with noisy labels via self-reweighting from class centroids
Ma, Fan, Wu, Yu, Yu, Xin and Yang, Yi (2021). Learning with noisy labels via self-reweighting from class centroids. IEEE Transactions On Neural Networks and Learning Systems, 33 (11), 6275-6285. doi: 10.1109/TNNLS.2021.3073248
2021
Journal Article
Progressive transfer learning for face anti-spoofing
Quan, Ruijie, Wu, Yu, Yu, Xin and Yang, Yi (2021). Progressive transfer learning for face anti-spoofing. IEEE Transactions on Image Processing, 30, 3946-3955. doi: 10.1109/TIP.2021.3066912
2021
Conference Publication
Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation
Liu, Jinhui, Zou, Zhikang, Ye, Xiaoqing, Tan, Xiao, Ding, Errui, Xu, Feng and Yu, Xin (2021). Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation. European Conference on Computer Vision ECCV 2020, Glasgow, United Kingdom, 23–28 August 2020. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-66096-3_47
2021
Journal Article
Face hallucination with finishing touches
Zhang, Yang, Tsang, Ivor W., Li, Jun, Liu, Ping, Lu, Xiaobo and Yu, Xin (2021). Face hallucination with finishing touches. IEEE Transactions On Image Processing, 30 9318504, 1728-1743. doi: 10.1109/TIP.2020.3046918
2021
Conference Publication
PR-RRN: pairwise-regularized residual-recursive networks for non-rigid structure-from-motion
Zeng, Haitian, Dai, Yuchao, Yu, Xin, Wang, Xiaohan and Yang, Yi (2021). PR-RRN: pairwise-regularized residual-recursive networks for non-rigid structure-from-motion. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.00555
2021
Conference Publication
Removing raindrops and rain streaks in one go
Quan, Ruijie, Yu, Xin, Liang, Yuanzhi and Yang, Yi (2021). Removing raindrops and rain streaks in one go. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/CVPR46437.2021.00903
2021
Conference Publication
Gait recognition via effective global-local feature representation and local temporal aggregation
Lin, Beibei, Zhang, Shunli and Yu, Xin (2021). Gait recognition via effective global-local feature representation and local temporal aggregation. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.01438
2021
Conference Publication
DSC-PoseNet: learning 6DoF object pose estimation via dual-scale consistency
Yang, Zongxin, Yu, Xin and Yang, Yi (2021). DSC-PoseNet: learning 6DoF object pose estimation via dual-scale consistency. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Washington, DC, United States: I E E E Computer Society. doi: 10.1109/CVPR46437.2021.00390
2021
Journal Article
Pyramidal multiple instance detection network with mask guided self-correction for weakly supervised object detection
Xu, Yunqiu, Zhou, Chunluan, Yu, Xin, Xiao, Bin and Yang, Yi (2021). Pyramidal multiple instance detection network with mask guided self-correction for weakly supervised object detection. IEEE Transactions On Image Processing, 30, 3029-3040. doi: 10.1109/TIP.2021.3056887
2021
Conference Publication
ARVo: learning all-range volumetric correspondence for video deblurring
Li, Dongxu, Xu, Chenchen, Zhang, Kaihao, Yu, Xin, Zhong, Yiran, Ren, Wenqi, Suominen, Hanna and Li, Hongdong (2021). ARVo: learning all-range volumetric correspondence for video deblurring. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Washington, DC, United States: I E E E Computer Society. doi: 10.1109/CVPR46437.2021.00763
Funding
Current funding
Past funding
Supervision
Availability
- Associate Professor Xin Yu is:
- Available for supervision
Looking for a supervisor? Read our advice on how to choose a supervisor.
Supervision history
Current supervision
-
Doctor Philosophy
Understanding Human Movements and Sport Performance Analysis
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Combating evolving deceptive fake visual information through deepfake detection
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Towards Scalable Sign Language Understanding: From Streaming Translation to Low Resource Transfer
Principal Advisor
Other advisors: Dr Heming Du, Dr Yujun Cai
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Dr Heming Du, Dr Miao Xu
-
Doctor Philosophy
Compressed Video Restoration
Principal Advisor
Other advisors: Dr Miao Xu, Dr Heming Du
-
Doctor Philosophy
Integrating Deep Learning and Remote Sensing for Precision Agriculture in Staple Crops
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Human Understanding in Sports
Principal Advisor
Other advisors: Associate Professor Sen Wang, Dr Heming Du
-
Doctor Philosophy
Human Posture Recognition Applied to Physical Activity
Principal Advisor
Other advisors: Professor Sean Tweedy
-
Doctor Philosophy
Multimodal foundation model design and analysis
Associate Advisor
Other advisors: Dr Miao Xu, Dr Heming Du
-
Doctor Philosophy
Efficient Remote Sensing under Real-world Constraints
Associate Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Data driven approaches for smart farming
Associate Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Effective Visual Data Compression
Associate Advisor
Other advisors: Associate Professor Sen Wang, Dr Heming Du
-
Doctor Philosophy
Enhancing Robustness and Generalizability in Computational Models
Associate Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
Towards knowledge discovery from imperfect and evolving data
Associate Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
The Unlabeled Truth: Rethinking Medical Imaging Supervision for Foundation Models in the Wild
Associate Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh, Mr Shijie Wang, Dr Heming Du
-
Doctor Philosophy
Pose Estimation for Human with Disabilities
Associate Advisor
Other advisors: Dr Heming Du
Completed supervision
-
2026
Doctor Philosophy
Towards Comprehensive Australian Sign Language Understanding: Datasets, Methodologies, and Systems
Principal Advisor
Other advisors: Professor Helen Huang, Dr Heming Du
-
2026
Doctor Philosophy
Towards Data-Driven Analysis of Handheld Fundus Videos
Principal Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh, Dr Heming Du
-
2026
Doctor Philosophy
Object-Centric Audio-Visual Alignment for Sounding Source Segmentation
Principal Advisor
Other advisors: Associate Professor Sen Wang
Media
Enquiries
For media enquiries about Associate Professor Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team: