Skip to menu Skip to content Skip to footer
Dr Xin Yu
Dr

Xin Yu

Email: 

Overview

Background

My name is Xin Yu, a Senior Lecturer at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.

My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.

Availability

Dr Xin Yu is:
Available for supervision

Research impacts

One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.

I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.

I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.

Works

Search Professor Xin Yu’s works on UQ eSpace

165 works between 2011 and 2025

101 - 120 of 165 works

2021

Conference Publication

Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation

Ding, Yuhang, Yu, Xin and Yang, Yi (2021). Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i2.16212

Modeling the probabilistic distribution of unlabeled data for one-shot medical image segmentation

2021

Conference Publication

Write-a-speaker: Text-based emotional and rhythmic talking-head generation

Li, Lincheng, Wang, Suzhen, Zhang, Zhimeng, Ding, Yu, Zheng, Yixing, Yu, Xin and Changjie Fan (2021). Write-a-speaker: Text-based emotional and rhythmic talking-head generation. 35th AAAI Conference on Artificial Intelligence / 33rd Conference on Innovative Applications of Artificial Intelligence / 11th Symposium on Educational Advances in Artificial Intelligence, Online, 2–9 February 2021. Palo Alto, CA United States: Association for the Advancement of Artificial Intelligence. doi: 10.1609/aaai.v35i3.16286

Write-a-speaker: Text-based emotional and rhythmic talking-head generation

2021

Conference Publication

PSTNET: point spatio-temporal convolution on point cloud sequences

Fan, Hehe, Yu, Xin, Ding, Yuhang, Yang, Yi and Kankanhalli, Mohan (2021). PSTNET: point spatio-temporal convolution on point cloud sequences. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. International Conference on Learning Representations, ICLR.

PSTNET: point spatio-temporal convolution on point cloud sequences

2021

Conference Publication

VTNET: visual transformer network for object goal navigation

Du, Heming, Yu, Xin and Zheng, Liang (2021). VTNET: visual transformer network for object goal navigation. 9th International Conference on Learning Representations, Virtual, 3-7 May 2021. Appleton WI USA: International Conference on Learning Representations.

VTNET: visual transformer network for object goal navigation

2021

Journal Article

Learning with noisy labels via self-reweighting from class centroids

Ma, Fan, Wu, Yu, Yu, Xin and Yang, Yi (2021). Learning with noisy labels via self-reweighting from class centroids. IEEE Transactions On Neural Networks and Learning Systems, 33 (11), 6275-6285. doi: 10.1109/TNNLS.2021.3073248

Learning with noisy labels via self-reweighting from class centroids

2021

Journal Article

Progressive transfer learning for face anti-spoofing

Quan, Ruijie, Wu, Yu, Yu, Xin and Yang, Yi (2021). Progressive transfer learning for face anti-spoofing. IEEE Transactions on Image Processing, 30, 3946-3955. doi: 10.1109/TIP.2021.3066912

Progressive transfer learning for face anti-spoofing

2021

Conference Publication

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation

Liu, Jinhui, Zou, Zhikang, Ye, Xiaoqing, Tan, Xiao, Ding, Errui, Xu, Feng and Yu, Xin (2021). Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation. European Conference on Computer Vision ECCV 2020, Glasgow, United Kingdom, 23–28 August 2020. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-66096-3_47

Leaping from 2D Detection to Efficient 6DoF Object Pose Estimation

2021

Conference Publication

RGB-D saliency detection via cascaded mutual information minimization

Zhang, Jing, Fan, Deng-Ping, Dai, Yuchao, Yu, Xin, Zhong, Yiran, Barnes, Nick and Shao, Ling (2021). RGB-D saliency detection via cascaded mutual information minimization. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.00430

RGB-D saliency detection via cascaded mutual information minimization

2021

Conference Publication

A general approach to state refinement

Kennedy, Gerard, Gao, Jin, Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2021). A general approach to state refinement. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Virtual, 27 September - 1 October 2021. Piscataway, NJ, United States: IEEE. doi: 10.1109/IROS51168.2021.9636400

A general approach to state refinement

2021

Conference Publication

Self-supervised visibility learning for novel view synthesis

Shi, Yujiao, Li, Hongdong and Yu, Xin (2021). Self-supervised visibility learning for novel view synthesis. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Washington, DC, United States: I E E E Computer Society. doi: 10.1109/CVPR46437.2021.00955

Self-supervised visibility learning for novel view synthesis

2021

Conference Publication

Joint 3D human shape recovery and pose estimation from a single image with bilayer graph

Yu, Xin, van Baar, Jeroen and Chen, Siheng (2021). Joint 3D human shape recovery and pose estimation from a single image with bilayer graph. 9th International Conference on 3D Vision (3DV), London, United Kingdom, 1-3 December 2021. Piscataway, NJ United States: IEEE Computer Society. doi: 10.1109/3DV53792.2021.00060

Joint 3D human shape recovery and pose estimation from a single image with bilayer graph

2021

Conference Publication

Super-resolving cross-domain face miniatures by peeking at one-shot exemplar

Li, Peike, Yu, Xin and Yang, Yi (2021). Super-resolving cross-domain face miniatures by peeking at one-shot exemplar. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.00443

Super-resolving cross-domain face miniatures by peeking at one-shot exemplar

2021

Conference Publication

Few-shot Weighted Style Matching for Glaucoma Detection

Liu, Jinhui and Yu, Xin (2021). Few-shot Weighted Style Matching for Glaucoma Detection. First CAAI International Conference, CICAI 2021, Hangzhou, China, 5–6 June 2021. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-93046-2_25

Few-shot Weighted Style Matching for Glaucoma Detection

2021

Journal Article

Face hallucination with finishing touches

Zhang, Yang, Tsang, Ivor W., Li, Jun, Liu, Ping, Lu, Xiaobo and Yu, Xin (2021). Face hallucination with finishing touches. IEEE Transactions On Image Processing, 30 9318504, 1728-1743. doi: 10.1109/TIP.2020.3046918

Face hallucination with finishing touches

2021

Conference Publication

PR-RRN: pairwise-regularized residual-recursive networks for non-rigid structure-from-motion

Zeng, Haitian, Dai, Yuchao, Yu, Xin, Wang, Xiaohan and Yang, Yi (2021). PR-RRN: pairwise-regularized residual-recursive networks for non-rigid structure-from-motion. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.00555

PR-RRN: pairwise-regularized residual-recursive networks for non-rigid structure-from-motion

2021

Conference Publication

Removing raindrops and rain streaks in one go

Quan, Ruijie, Yu, Xin, Liang, Yuanzhi and Yang, Yi (2021). Removing raindrops and rain streaks in one go. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/CVPR46437.2021.00903

Removing raindrops and rain streaks in one go

2021

Conference Publication

Gait recognition via effective global-local feature representation and local temporal aggregation

Lin, Beibei, Zhang, Shunli and Yu, Xin (2021). Gait recognition via effective global-local feature representation and local temporal aggregation. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.01438

Gait recognition via effective global-local feature representation and local temporal aggregation

2021

Conference Publication

DSC-PoseNet: learning 6DoF object pose estimation via dual-scale consistency

Yang, Zongxin, Yu, Xin and Yang, Yi (2021). DSC-PoseNet: learning 6DoF object pose estimation via dual-scale consistency. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Washington, DC, United States: I E E E Computer Society. doi: 10.1109/CVPR46437.2021.00390

DSC-PoseNet: learning 6DoF object pose estimation via dual-scale consistency

2021

Journal Article

Pyramidal multiple instance detection network with mask guided self-correction for weakly supervised object detection

Xu, Yunqiu, Zhou, Chunluan, Yu, Xin, Xiao, Bin and Yang, Yi (2021). Pyramidal multiple instance detection network with mask guided self-correction for weakly supervised object detection. IEEE Transactions On Image Processing, 30, 3029-3040. doi: 10.1109/TIP.2021.3056887

Pyramidal multiple instance detection network with mask guided self-correction for weakly supervised object detection

2021

Conference Publication

ARVo: learning all-range volumetric correspondence for video deblurring

Li, Dongxu, Xu, Chenchen, Zhang, Kaihao, Yu, Xin, Zhong, Yiran, Ren, Wenqi, Suominen, Hanna and Li, Hongdong (2021). ARVo: learning all-range volumetric correspondence for video deblurring. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, 19-25 June 2021. Washington, DC, United States: I E E E Computer Society. doi: 10.1109/CVPR46437.2021.00763

ARVo: learning all-range volumetric correspondence for video deblurring

Funding

Current funding

  • 2025 - 2026
    Creation of an interactive online seaweed production map to support policy-making for the Indonesian seaweed industry
    KONEKSI Environment and Climate Change Extension Support
    Open grant
  • 2024 - 2027
    AI-Empowered and Video-Based uplift of Paralympic classification systems (AQIRP project administered by Follow Me AI)
    Follow Me AI Pty Ltd
    Open grant
  • 2023 - 2028
    Breaking the Communication Barrier for the Australian Deaf Community: Vision Based Australian Sign Language Translation and Production
    Google Asia Pacific Pte Ltd
    Open grant
  • 2023 - 2026
    Advancing Human Perception: Countering Evolving Malicious Fake Visual Data
    ARC Discovery Early Career Researcher Award
    Open grant
  • 2023 - 2027
    Analytics for the Australian Grains Industry (AAGI)
    Grains Research & Development Corporation
    Open grant

Past funding

  • 2024
    Breaking the Communication Barrier for the Australian Deaf Community: Vision Based Australian Sign Language Translation and Production
    Google Inc
    Open grant
  • 2023 - 2024
    Developing applications of satellite imagery for modelling environmental and social impacts of climate change on seaweed farming in Indonesia (KONEKSI Grant administered by Griffith University)
    Griffith University
    Open grant
  • 2023 - 2025
    Two-way Auslan: Automatic Machine Translation of Australian Sign Language (ARC Discovery Project administered by ANU)
    The Australian National University
    Open grant

Supervision

Availability

Dr Xin Yu is:
Available for supervision

Looking for a supervisor? Read our advice on how to choose a supervisor.

Supervision history

Current supervision

  • Doctor Philosophy

    Automatic Retinal Health Monitoring through Multi-modal Medical Imaging

    Principal Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

  • Doctor Philosophy

    Two way Auslan Translation

    Principal Advisor

    Other advisors: Professor Helen Huang, Dr Heming Du

  • Doctor Philosophy

    Combating evolving deceptive fake visual information through deepfake detection

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Two way Auslan Translation

    Principal Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh, Dr Heming Du

  • Doctor Philosophy

    Human Posture Recognition Applied to Physical Activity

    Principal Advisor

    Other advisors: Professor Sean Tweedy

  • Doctor Philosophy

    Integrating Deep Learning and Remote Sensing for Precision Agriculture in Staple Crops

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Human Understanding in Sports

    Principal Advisor

    Other advisors: Associate Professor Sen Wang, Dr Heming Du

  • Doctor Philosophy

    Pose Estimation for Human with Disabilities

    Principal Advisor

    Other advisors: Professor Brian Lovell

  • Doctor Philosophy

    Compressed Video Restoration

    Principal Advisor

    Other advisors: Dr Miao Xu, Dr Heming Du

  • Doctor Philosophy

    Effective Visual Data Compression

    Principal Advisor

    Other advisors: Associate Professor Sen Wang, Dr Heming Du

  • Doctor Philosophy

    Object-Centric Audio-Visual Alignment for Sounding Source Segmentation

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Understanding Human Intention and Performance

    Principal Advisor

    Other advisors: Dr Heming Du, Dr Miao Xu

  • Doctor Philosophy

    Multimodal foundation model design and analysis

    Principal Advisor

    Other advisors: Dr Miao Xu, Dr Heming Du

  • Doctor Philosophy

    Understanding Human Intention and Performance

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Understanding Human Movements and Sport Performance Analysis

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Towards knowledge discovery from imperfect and evolving data

    Associate Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Remote Sensing Analysis in computer vision

    Associate Advisor

    Other advisors: Professor Helen Huang

  • Doctor Philosophy

    Enhancing Robustness and Generalizability in Computational Models

    Associate Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

  • Doctor Philosophy

    Data driven approaches for smart farming

    Associate Advisor

    Other advisors: Professor Helen Huang

Media

Enquiries

For media enquiries about Dr Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team:

communications@uq.edu.au