Overview
Background
My name is Xin Yu, a Senior Lecturer at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.
My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.
Availability
- Dr Xin Yu is:
- Available for supervision
Research impacts
One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.
I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.
I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.
Works
Search Professor Xin Yu’s works on UQ eSpace
2023
Conference Publication
GaitStrip: Gait Recognition via Effective Strip-Based Feature Representations and Multi-level Framework
Wang, Ming, Lin, Beibei, Guo, Xianda, Li, Lincheng, Zhu, Zheng, Sun, Jiande, Zhang, Shunli, Liu, Yu and Yu, Xin (2023). GaitStrip: Gait Recognition via Effective Strip-Based Feature Representations and Multi-level Framework. 16th Asian Conference on Computer Vision, Macao, China, 4–8 December 2022. Cham, Switzerland: Springer. doi: 10.1007/978-3-031-26316-3_42
2022
Journal Article
Geometry-guided street-view panorama synthesis from satellite imagery
Shi, Yujiao, Campbell, Dylan, Yu, Xin and Li, Hongdong (2022). Geometry-guided street-view panorama synthesis from satellite imagery. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (12), 10009-10022. doi: 10.1109/TPAMI.2022.3140750
2022
Journal Article
Deep hierarchical representation of point cloud videos via spatio-temporal decomposition
Fan, Hehe, Yu, Xin, Yang, Yi and Kankanhalli, Mohan (2022). Deep hierarchical representation of point cloud videos via spatio-temporal decomposition. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (12), 9918-9930. doi: 10.1109/TPAMI.2021.3135117
2022
Journal Article
Single image based 3D human pose estimation via uncertainty learning
Han, Chuchu, Yu, Xin, Gao, Changxin, Sang, Nong and Yang, Yi (2022). Single image based 3D human pose estimation via uncertainty learning. Pattern Recognition, 132 108934, 108934. doi: 10.1016/j.patcog.2022.108934
2022
Conference Publication
MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views
Zeng, Haitian, Yu, Xin, Miao, Jiaxu and Yang, Yi (2022). MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views. European Conference on Computer Vision (ECCV 2022), Tel Aviv, Israel, 23-27 October 2022. Cham, Switzerland: Springer. doi: 10.1007/978-3-031-20086-1_1
2022
Conference Publication
Instance as identity: a generic online paradigm for video instance segmentation
Zhu, Feng, Yang, Zongxin, Yu, Xin, Yang, Yi and Wei, Yunchao (2022). Instance as identity: a generic online paradigm for video instance segmentation. Computer Vision – ECCV 2022 17th European Conference, Tel Aviv, Israel, 23–27 October 2022. Cham, Switzerland: Springer. doi: 10.1007/978-3-031-19818-2_30
2022
Journal Article
Recursive copy and paste GAN: face hallucination from shaded thumbnails
Zhang, Yang, Tsang, Ivor W., Luo, Yawei, Hu, Changhui, Lu, Xiaobo and Yu, Xin (2022). Recursive copy and paste GAN: face hallucination from shaded thumbnails. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (8), 4321-4338. doi: 10.1109/TPAMI.2021.3061312
2022
Conference Publication
Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields
Yao, Guangming, Wu, Hongzhi, Yuan, Yi, Li, Lincheng, Zhou, Kun and Yu, Xin (2022). Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields. Thirty-First International Joint Conference on Artificial Intelligence IJCAI-ECAI 2022, Vienna, Austria, 23-29 July 2022. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2022/218
2022
Conference Publication
One-shot talking face generation from single-speaker audio-visual correlation learning
Wang, Suzhen, Li, Lincheng, Ding, Yu and Yu, Xin (2022). One-shot talking face generation from single-speaker audio-visual correlation learning. 36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, Online, 22 February –1 March 2022. Palo Alto, CA United States: ASSOC. doi: 10.1609/aaai.v36i3.20154
2022
Conference Publication
Monocular camera-based point-goal navigation by learning depth channel and cross-modality pyramid fusion
Tang, Tianqi, Du, Heming, Yu, Xin and Yang, Yi (2022). Monocular camera-based point-goal navigation by learning depth channel and cross-modality pyramid fusion. 36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, Online, 22 February –1 March 2022. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v36i5.20480
2022
Journal Article
High frame rate video reconstruction based on an event camera
Pan, Liyuan, Hartley, Richard, Scheerlinck, Cedric, Liu, Miaomiao, Yu, Xin and Dai, Yuchao (2022). High frame rate video reconstruction based on an event camera. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (5), 2519-2533. doi: 10.1109/TPAMI.2020.3036667
2022
Journal Article
Single-image deraining via recurrent residual multiscale networks
Zheng, Yupei, Yu, Xin, Liu, Miaomiao and Zhang, Shunli (2022). Single-image deraining via recurrent residual multiscale networks. IEEE Transactions On Neural Networks and Learning Systems, 33 (3), 1310-1323. doi: 10.1109/TNNLS.2020.3041752
2022
Journal Article
Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting
Xu, Yunqiu, Yu, Xin, Zhang, Jing, Zhu, Linchao and Wang, Dadong (2022). Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting. IEEE Transactions On Image Processing, 31, 2148-2161. doi: 10.1109/TIP.2022.3151999
2022
Journal Article
Pro-UIGAN: progressive face hallucination from occluded thumbnails
Zhang, Yang, Yu, Xin, Lu, Xiaobo and Liu, Ping (2022). Pro-UIGAN: progressive face hallucination from occluded thumbnails. IEEE Transactions On Image Processing, 31, 3236-3250. doi: 10.1109/TIP.2022.3167280
2022
Conference Publication
Batch Multi-Fidelity Active Learning with Budget Constraints
Li, Shibo, Phillips, Jeff M., Yu, Xin, Kirby, Robert M. and Zhe, Shandian (2022). Batch Multi-Fidelity Active Learning with Budget Constraints. 36th Conference on Neural Information Processing Systems (NeurIPS 2022), Online, 28 November - 9 December 2022. Maryland Heights, MO United States: Morgan Kaufmann Publishers.
2022
Journal Article
Understanding atomic hand-object interaction with human intention
Fan, Hehe, Zhuo, Tao, Yu, Xin, Yang, Yi and Kankanhalli, Mohan (2022). Understanding atomic hand-object interaction with human intention. IEEE Transactions On Circuits and Systems for Video Technology, 32 (1), 275-285. doi: 10.1109/TCSVT.2021.3058688
2021
Conference Publication
End-to-end multi-instance robotic reaching from monocular vision
Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2021). End-to-end multi-instance robotic reaching from monocular vision. IEEE International Conference on Robotics and Automation (ICRA), Xian, China, 30 May - 5 June 2021. Washington, DC United States: IEEE Computer Society. doi: 10.1109/ICRA48506.2021.9561518
2021
Conference Publication
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion
Wang, Suzhen, Li, Lincheng, Ding, Yu, Fan, Changjie and Yu, Xin (2021). Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion. Thirtieth International Joint Conference on Artificial Intelligence, Montreal, Canada, 19-27 August 2021. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2021/152
2021
Conference Publication
The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose
Ben-Shabat, Yizhak, Yu, Xin, Saleh, Fatemeh, Campbell, Dylan, Rodriguez-Opazo, Cristian, Li, Hongdong and Gould, Stephen (2021). The IKEA ASM dataset: understanding people assembling furniture through actions, objects and pose. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE Computer Society. doi: 10.1109/WACV48630.2021.00089
2021
Conference Publication
Auto-navigator: decoupled neural architecture search for visual navigation
Tang, Tianqi, Yu, Xin, Dong, Xuanyi and Yang, Yi (2021). Auto-navigator: decoupled neural architecture search for visual navigation. IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 5-9 January 2021. Piscataway, NJ United States: IEEE. doi: 10.1109/WACV48630.2021.00379
Funding
Current funding
Past funding
Supervision
Availability
- Dr Xin Yu is:
- Available for supervision
Looking for a supervisor? Read our advice on how to choose a supervisor.
Supervision history
Current supervision
-
Doctor Philosophy
Multimodal foundation model design and analysis
Principal Advisor
Other advisors: Dr Miao Xu, Dr Heming Du
-
Doctor Philosophy
Human Posture Recognition Applied to Physical Activity
Principal Advisor
Other advisors: Professor Sean Tweedy
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Understanding Human Movements and Sport Performance Analysis
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Effective Visual Data Compression
Principal Advisor
Other advisors: Associate Professor Sen Wang, Dr Heming Du
-
Doctor Philosophy
Automatic Retinal Health Monitoring through Multi-modal Medical Imaging
Principal Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
Combating evolving deceptive fake visual information through deepfake detection
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Two way Auslan Translation
Principal Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh, Dr Heming Du
-
Doctor Philosophy
Integrating Deep Learning and Remote Sensing for Precision Agriculture in Staple Crops
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Dr Heming Du, Dr Miao Xu
-
Doctor Philosophy
Human Understanding in Sports
Principal Advisor
Other advisors: Associate Professor Sen Wang, Dr Heming Du
-
Doctor Philosophy
Pose Estimation for Human with Disabilities
Principal Advisor
Other advisors: Professor Brian Lovell
-
Doctor Philosophy
Two way Auslan Translation
Principal Advisor
Other advisors: Professor Helen Huang, Dr Heming Du
-
Doctor Philosophy
Compressed Video Restoration
Principal Advisor
Other advisors: Dr Miao Xu, Dr Heming Du
-
Doctor Philosophy
Object-Centric Audio-Visual Alignment for Sounding Source Segmentation
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Remote Sensing Analysis in computer vision
Associate Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Enhancing Robustness and Generalizability in Computational Models
Associate Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
Data driven approaches for smart farming
Associate Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Towards knowledge discovery from imperfect and evolving data
Associate Advisor
Other advisors: Dr Miao Xu
Media
Enquiries
For media enquiries about Dr Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team: