Overview
Background
My name is Xin Yu, a Senior Lecturer at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.
My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.
Availability
- Dr Xin Yu is:
- Available for supervision
Research impacts
One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.
I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.
I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.
Works
Search Professor Xin Yu’s works on UQ eSpace
2023
Conference Publication
CVLNet: Cross-view Semantic Correspondence Learning for Video-Based Camera Localization
Shi, Yujiao, Yu, Xin, Wang, Shan and Li, Hongdong (2023). CVLNet: Cross-view Semantic Correspondence Learning for Video-Based Camera Localization. 16th Asian Conference on Computer Vision, Macao, China, 4–8 December 2022. Cham, Switzerland: Springer. doi: 10.1007/978-3-031-26319-4_8
2023
Conference Publication
StyleTalk: one-shot talking head generation with controllable speaking styles
Ma, Yifeng, Wang, Suzhen, Hu, Zhipeng, Fan, Changjie, Lv, Tangjie, Ding, Yu, Deng, Zhidong and Yu, Xin (2023). StyleTalk: one-shot talking head generation with controllable speaking styles. 37th AAAI Conference on Artificial Intelligence (AAAI) / 35th Conference on Innovative Applications of Artificial Intelligence / 13th Symposium on Educational Advances in Artificial Intelligence, Washington, DC, United States, 7-14 February 2023. Palo Alto, CA, United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v37i2.25280
2023
Conference Publication
RVD: a handheld device-based fundus video dataset for retinal vessel segmentation
Khan, Md Wahiduzzaman, Sheng, Hongwei, Zhang, Hu, Du, Heming, Wang, Sen, Coroneo, Minas Theodore, Hajati, Farshid, Shariflou, Sahar, Kalloniatis, Michael, Phu, Jack, Agar, Ashish, Huang, Zi, Golzan, Mojtaba and Yu, Xin (2023). RVD: a handheld device-based fundus video dataset for retinal vessel segmentation. 37th Conference on Neural Information Processing Systems (NeurIPS 2023) Track on Datasets and Benchmarks, New Orleans, LA, United States, 10 - 16 December 2023. Maryland Heights, MO, United States: Morgan Kaufmann Publishers.
2023
Conference Publication
Meta knowledge condensation for federated learning
Liu, Ping, Yu, Xin and Zhou, Joey Tianyi (2023). Meta knowledge condensation for federated learning. 11th International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, 1-5 May 2023. International Conference on Learning Representations, ICLR.
2023
Journal Article
Cyclic self-training with proposal weight modulation for cross-supervised object detection
Xu, Yunqiu, Zhou, Chunluan, Yu, Xin and Yang, Yi (2023). Cyclic self-training with proposal weight modulation for cross-supervised object detection. IEEE Transactions on Image Processing, 32, 1992-2002. doi: 10.1109/TIP.2023.3261752
2023
Conference Publication
Sim2RealVS: A new benchmark for video stabilization with a strong baseline
Rao, Qi, Yu, Xin, Navasardyan, Shant and Shi, Humphrey (2023). Sim2RealVS: A new benchmark for video stabilization with a strong baseline. 23rd IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 3-7 January 2023. Piscataway, NJ United States: IEEE. doi: 10.1109/wacv56688.2023.00537
2023
Conference Publication
Auslan-Daily: Australian sign language translation for daily communication and news
Shen, Xin, Yuan, Shaozu, Sheng, Hongwei, Du, Heming and Yu, Xin (2023). Auslan-Daily: Australian sign language translation for daily communication and news. 37th Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, LA, United States, 10-16 December 2023. San Diego, CA, United States: Neural Information Processing Systems Foundation.
2022
Journal Article
Geometry-guided street-view panorama synthesis from satellite imagery
Shi, Yujiao, Campbell, Dylan, Yu, Xin and Li, Hongdong (2022). Geometry-guided street-view panorama synthesis from satellite imagery. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (12), 10009-10022. doi: 10.1109/TPAMI.2022.3140750
2022
Journal Article
Deep hierarchical representation of point cloud videos via spatio-temporal decomposition
Fan, Hehe, Yu, Xin, Yang, Yi and Kankanhalli, Mohan (2022). Deep hierarchical representation of point cloud videos via spatio-temporal decomposition. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (12), 9918-9930. doi: 10.1109/TPAMI.2021.3135117
2022
Journal Article
Single image based 3D human pose estimation via uncertainty learning
Han, Chuchu, Yu, Xin, Gao, Changxin, Sang, Nong and Yang, Yi (2022). Single image based 3D human pose estimation via uncertainty learning. Pattern Recognition, 132 108934, 108934. doi: 10.1016/j.patcog.2022.108934
2022
Conference Publication
MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views
Zeng, Haitian, Yu, Xin, Miao, Jiaxu and Yang, Yi (2022). MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views. European Conference on Computer Vision (ECCV 2022), Tel Aviv, Israel, 23-27 October 2022. Cham, Switzerland: Springer. doi: 10.1007/978-3-031-20086-1_1
2022
Conference Publication
Instance as identity: a generic online paradigm for video instance segmentation
Zhu, Feng, Yang, Zongxin, Yu, Xin, Yang, Yi and Wei, Yunchao (2022). Instance as identity: a generic online paradigm for video instance segmentation. Computer Vision – ECCV 2022 17th European Conference, Tel Aviv, Israel, 23–27 October 2022. Cham, Switzerland: Springer. doi: 10.1007/978-3-031-19818-2_30
2022
Journal Article
Recursive copy and paste GAN: face hallucination from shaded thumbnails
Zhang, Yang, Tsang, Ivor W., Luo, Yawei, Hu, Changhui, Lu, Xiaobo and Yu, Xin (2022). Recursive copy and paste GAN: face hallucination from shaded thumbnails. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (8), 4321-4338. doi: 10.1109/TPAMI.2021.3061312
2022
Conference Publication
Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields
Yao, Guangming, Wu, Hongzhi, Yuan, Yi, Li, Lincheng, Zhou, Kun and Yu, Xin (2022). Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields. Thirty-First International Joint Conference on Artificial Intelligence IJCAI-ECAI 2022, Vienna, Austria, 23-29 July 2022. Los Angeles, CA United States: International Joint Conferences on Artificial Intelligence Organization. doi: 10.24963/ijcai.2022/218
2022
Conference Publication
One-shot talking face generation from single-speaker audio-visual correlation learning
Wang, Suzhen, Li, Lincheng, Ding, Yu and Yu, Xin (2022). One-shot talking face generation from single-speaker audio-visual correlation learning. 36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, Online, 22 February –1 March 2022. Palo Alto, CA United States: ASSOC. doi: 10.1609/aaai.v36i3.20154
2022
Conference Publication
Monocular camera-based point-goal navigation by learning depth channel and cross-modality pyramid fusion
Tang, Tianqi, Du, Heming, Yu, Xin and Yang, Yi (2022). Monocular camera-based point-goal navigation by learning depth channel and cross-modality pyramid fusion. 36th AAAI Conference on Artificial Intelligence / 34th Conference on Innovative Applications of Artificial Intelligence / 12th Symposium on Educational Advances in Artificial Intelligence, Online, 22 February –1 March 2022. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v36i5.20480
2022
Journal Article
High frame rate video reconstruction based on an event camera
Pan, Liyuan, Hartley, Richard, Scheerlinck, Cedric, Liu, Miaomiao, Yu, Xin and Dai, Yuchao (2022). High frame rate video reconstruction based on an event camera. IEEE Transactions On Pattern Analysis and Machine Intelligence, 44 (5), 2519-2533. doi: 10.1109/TPAMI.2020.3036667
2022
Journal Article
Impaired neurogenesis alters brain biomechanics in a neuroprogenitor-based genetic subtype of congenital hydrocephalus
Duy, Phan Q., Weise, Stefan C., Marini, Claudia, Li, Xiao-Jun, Liang, Dan, Dahl, Peter J., Ma, Shaojie, Spajic, Ana, Dong, Weilai, Juusola, Jane, Kiziltug, Emre, Kundishora, Adam J., Koundal, Sunil, Pedram, Maysam Z., Torres-Fernández, Lucia A., Händler, Kristian, De Domenico, Elena, Becker, Matthias, Ulas, Thomas, Juranek, Stefan A., Cuevas, Elisa, Hao, Le Thi, Jux, Bettina, Sousa, André M. M., Liu, Fuchen, Kim, Suel-Kee, Li, Mingfeng, Yang, Yiying, Takeo, Yutaka ... Kahle, Kristopher T. (2022). Impaired neurogenesis alters brain biomechanics in a neuroprogenitor-based genetic subtype of congenital hydrocephalus. Nature Neuroscience, 25 (4), 458-473. doi: 10.1038/s41593-022-01043-3
2022
Journal Article
Single-image deraining via recurrent residual multiscale networks
Zheng, Yupei, Yu, Xin, Liu, Miaomiao and Zhang, Shunli (2022). Single-image deraining via recurrent residual multiscale networks. IEEE Transactions On Neural Networks and Learning Systems, 33 (3), 1310-1323. doi: 10.1109/TNNLS.2020.3041752
2022
Journal Article
Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting
Xu, Yunqiu, Yu, Xin, Zhang, Jing, Zhu, Linchao and Wang, Dadong (2022). Weakly supervised RGB-D salient object detection with prediction consistency training and active scribble boosting. IEEE Transactions On Image Processing, 31, 2148-2161. doi: 10.1109/TIP.2022.3151999
Supervision
Availability
- Dr Xin Yu is:
- Available for supervision
Before you email them, read our advice on how to contact a supervisor.
Supervision history
Current supervision
-
Doctor Philosophy
Enhancing Building Fire Safety by Utilising Machine Learning Techniques
Principal Advisor
Other advisors: Professor Brian Lovell
-
Doctor Philosophy
Human Posture Recognition Applied to Physical Activity
Principal Advisor
Other advisors: Professor Sean Tweedy
-
Doctor Philosophy
Two way Auslan Translation
Principal Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Two way Auslan Translation
Principal Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
Towards Efficient Pest Detection in Agriculture
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Multimodal foundation model design and analysis
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
The prediction, diagnosis, and severity estimation models for plant disease
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Advancing Human Perception: Countering Evolving Malicious Fake Visual Data
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Automatic Retinal Health Monitoring through Multi-modal Medical Imaging
Principal Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Combating evolving deceptive fake visual information through deepfake detection
Principal Advisor
Other advisors: Associate Professor Sen Wang
-
Doctor Philosophy
Understanding Human Intention and Performance
Principal Advisor
Other advisors: Dr Miao Xu
-
Doctor Philosophy
Data driven approaches for smart farming
Associate Advisor
Other advisors: Professor Helen Huang
-
Doctor Philosophy
Enhancing Robustness and Generalizability in Computational Models
Associate Advisor
Other advisors: Associate Professor Mahsa Baktashmotlagh
-
Doctor Philosophy
Remote Sensing Analysis in computer vision
Associate Advisor
Other advisors: Professor Helen Huang
Media
Enquiries
For media enquiries about Dr Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team: