Skip to menu Skip to content Skip to footer
Dr Xin Yu
Dr

Xin Yu

Email: 

Overview

Background

My name is Xin Yu, a Senior Lecturer at the University of Queensland. I am an Australian Research Council Discovery Early Career Researcher Award 2023-2025 (DECRA) recipient and an awardee of the prestigious Google Research Scholar Program in 2021. I am also a Google Visiting Faculty. Previously, I was a research fellow at the Australian National University (ANU). I received my PhD degree from the Australian National Unversity under the supervision of Prof. Richard Hartley, Prof. Fatih Porikli and Dr. Basura Fernando. I also received a PhD degree from Tsinghua University supervised by Prof. Li Zhang. I am interested in Computer Vision and Machine Learning topics.

My research topics includes various computer vision and machine learning tasks, especially in efficient low-level image processing, image retrieval and localization, action recognition, 3D pose estimation, visual navigation and sign language recognition and translation.

Availability

Dr Xin Yu is:
Available for supervision

Research impacts

One of my research papers has been awarded "Best Paper Honorable Mention" award in the premium computer vision conference WACV 2020, and one paper has been nominated for the Best Paper Award in CVPR 2020.

I was awarded the Outstanding Reviewer Award in ECCV 2020, CVPR 2021 and ICCV 2021. CVPR, ICCV and ECCV are internationally world-leading computer vision and machine learning conferences. My research interests include deep learning techniques, image processing, and computer vision tasks. I am a program committee member of top-tier computer vision and machine learning conferences, such as CVPR, ICCV, ECCV, ICML, ICLR and NeurIPS, and a reviewer of prestigious journals, such as TPAMI, IJCV and TIP.

I am happy to supervise self-motivated PhD and MPhil students. If you are an undergraduate student and willing to conduct your honour project, please drop me an email.

Works

Search Professor Xin Yu’s works on UQ eSpace

165 works between 2011 and 2025

121 - 140 of 165 works

2021

Conference Publication

Gait recognition via effective global-local feature representation and local temporal aggregation

Lin, Beibei, Zhang, Shunli and Yu, Xin (2021). Gait recognition via effective global-local feature representation and local temporal aggregation. 18th IEEE/CVF International Conference on Computer Vision (ICCV), Virtual, 11-17 October 2021. New York, NY, United States: IEEE. doi: 10.1109/ICCV48922.2021.01438

Gait recognition via effective global-local feature representation and local temporal aggregation

2020

Conference Publication

TSPNet: hierarchical feature learning via temporal semantic pyramid for sign language translation

Li, Dongxu, Xu, Chenchen, Yu, Xin, Zhang, Kaihao, Swift, Ben, Suominen, Hanna and Li, Hongdong (2020). TSPNet: hierarchical feature learning via temporal semantic pyramid for sign language translation. 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada, 6-12 December 2020. Maryland Heights, MO USA: Morgan Kaufmann Publishers.

TSPNet: hierarchical feature learning via temporal semantic pyramid for sign language translation

2020

Journal Article

Single Image Portrait Relighting via Explicit Multiple Reflectance Channel Modeling

Wang, Zhibo, Yu, Xin, Lu, Ming, Wang, Quan, Qian, Chen and Xu, Feng (2020). Single Image Portrait Relighting via Explicit Multiple Reflectance Channel Modeling. ACM Transactions On Graphics, 39 (6) 220, 1-13. doi: 10.1145/3414685.3417824

Single Image Portrait Relighting via Explicit Multiple Reflectance Channel Modeling

2020

Journal Article

Semantic Face Hallucination: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes

Yu, Xin, Fernando, Basura, Hartley, Richard and Porikli, Fatih (2020). Semantic Face Hallucination: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes. IEEE Transactions On Pattern Analysis and Machine Intelligence, 42 (11), 2926-2943. doi: 10.1109/TPAMI.2019.2916881

Semantic Face Hallucination: Super-Resolving Very Low-Resolution Face Images with Supplementary Attributes

2020

Journal Article

Mapping the Brain-Wide Network Effects by Optogenetic Activation of the Corpus Callosum

Chen, Yi, Sobczak, Filip, Pais-Roldán, Patricia, Schwarz, Cornelius, Koretsky, Alan P. and Yu, Xin (2020). Mapping the Brain-Wide Network Effects by Optogenetic Activation of the Corpus Callosum. Cerebral Cortex, 30 (11), 5885-5898. doi: 10.1093/cercor/bhaa164

Mapping the Brain-Wide Network Effects by Optogenetic Activation of the Corpus Callosum

2020

Conference Publication

When humans meet machines: towards efficient segmentation networks

Li, Peike, Dong, Xuanyi, Yu, Xin and Yang, Yi (2020). When humans meet machines: towards efficient segmentation networks. 31st British Machine Vision Conference, Virtual, 7-10 September 2020. Bath, United Kingdom: British Machine Vision Association.

When humans meet machines: towards efficient segmentation networks

2020

Conference Publication

6DoF object pose estimation via differentiable proxy voting regularizer

Yu, Xin, Zhuang, Zheyu, Koniusz, Piotr and Li, Hongdong (2020). 6DoF object pose estimation via differentiable proxy voting regularizer. 31st British Machine Vision Conference, Virtual, 7-10 September 2020. Bath, United Kingdom: British Machine Vision Association, BMVA.

6DoF object pose estimation via differentiable proxy voting regularizer

2020

Journal Article

Can We See More? Joint Frontalization and Hallucination of Unaligned Tiny Faces

Yu, Xin, Shiri, Fatemeh, Ghanem, Bernard and Porikli, Fatih (2020). Can We See More? Joint Frontalization and Hallucination of Unaligned Tiny Faces. Ieee Transactions On Pattern Analysis and Machine Intelligence, 42 (9) 8704962, 2148-2164. doi: 10.1109/TPAMI.2019.2914039

Can We See More? Joint Frontalization and Hallucination of Unaligned Tiny Faces

2020

Conference Publication

Transferring Cross-domain Knowledge for Video Sign Language Recognition

Li, Dongxu, Yu, Xin, Xu, Chenchen, Petersson, Lars and Li, Hongdong (2020). Transferring Cross-domain Knowledge for Video Sign Language Recognition. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Online, 14-19 June 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/CVPR42600.2020.00624

Transferring Cross-domain Knowledge for Video Sign Language Recognition

2020

Conference Publication

Weakly-Supervised Salient Object Detection via Scribble Annotations

Zhang, Jing, Yu, Xin, Li, Aixuan, Song, Peipei, Liu, Bowen and Dai, Yuchao (2020). Weakly-Supervised Salient Object Detection via Scribble Annotations. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA United States, 13-19 June 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/cvpr42600.2020.01256

Weakly-Supervised Salient Object Detection via Scribble Annotations

2020

Conference Publication

Copy and Paste GAN: Face Hallucination From Shaded Thumbnails

Zhang, Yang, Tsang, Ivor W., Luo, Yawei, Hu, Chang-Hui, Lu, Xiaobo and Yu, Xin (2020). Copy and Paste GAN: Face Hallucination From Shaded Thumbnails. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA United States, 13-19 June 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/cvpr42600.2020.00738

Copy and Paste GAN: Face Hallucination From Shaded Thumbnails

2020

Conference Publication

Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching

Shi, Yujiao, Yu, Xin, Campbell, Dylan and Li, Hongdong (2020). Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Online, 14-19 June 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/CVPR42600.2020.00412

Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching

2020

Conference Publication

Going Beyond Real Data: A Robust Visual Representation for Vehicle Re-identification

Zheng, Zhedong, Jiang, Minyue, Wang, Zhigang, Wang, Jian, Bai, Zechen, Zhang, Xuanmeng, Yu, Xin, Tan, Xiao, Yang, Yi, Wen, Shilei and Ding, Errui (2020). Going Beyond Real Data: A Robust Visual Representation for Vehicle Re-identification. IEEE/CVF Conference on Computer Vision and Pattern Recognition CVPRW 2020, Online, 14-19 June 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/CVPRW50498.2020.00307

Going Beyond Real Data: A Robust Visual Representation for Vehicle Re-identification

2020

Conference Publication

Learning Object Relation Graph and Tentative Policy for Visual Navigation

Du, Heming, Yu, Xin and Zheng, Liang (2020). Learning Object Relation Graph and Tentative Policy for Visual Navigation. European Conference on Computer Vision ECCV 2020, Glasgow, United Kingdom, 23–28 August 2020. Cham, Switzerland: Springer. doi: 10.1007/978-3-030-58571-6_2

Learning Object Relation Graph and Tentative Policy for Visual Navigation

2020

Conference Publication

LyRN (Lyapunov Reaching Network): A Real-Time Closed Loop approach from Monocular Vision

Zhuang, Zheyu, Yu, Xin and Mahony, Robert (2020). LyRN (Lyapunov Reaching Network): A Real-Time Closed Loop approach from Monocular Vision. 2020 IEEE International Conference on Robotics and Automation (ICRA), Online, 31 May - 15 June 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/icra40945.2020.9196781

LyRN (Lyapunov Reaching Network): A Real-Time Closed Loop approach from Monocular Vision

2020

Conference Publication

Optimal Feature Transport for Cross-View Image Geo-Localization

Shi, Yujiao, Yu, Xin, Liu, Liu, Zhang, Tong and Li, Hongdong (2020). Optimal Feature Transport for Cross-View Image Geo-Localization. 34th AAAI Conference on Artificial Intelligence / 32nd Innovative Applications of Artificial Intelligence Conference / 10th AAAI Symposium on Educational Advances in Artificial Intelligence, New York, NY United States, 7-12 February 2020. Palo Alto, CA United States: AAAI Press.

Optimal Feature Transport for Cross-View Image Geo-Localization

2020

Conference Publication

Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison

Li, Dongxu, Opazo, Cristian Rodriguez, Yu, Xin and Li, Hongdong (2020). Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Snowmass, CO United States, 1-5 March 2020. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/WACV45572.2020.9093512

Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison

2019

Conference Publication

Spatial-Aware Feature Aggregation for Cross-View Image based Geo-Localization

Shi, Yujiao, Liu, Liu, Yu, Xin and Li, Hongdong (2019). Spatial-Aware Feature Aggregation for Cross-View Image based Geo-Localization. 33rd Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, 8-14 December 2019. Maryland Heights, MO United States: Morgan Kaufmann Publishers.

Spatial-Aware Feature Aggregation for Cross-View Image based Geo-Localization

2019

Journal Article

Hallucinating Unaligned Face Images by Multiscale Transformative Discriminative Networks

Yu, Xin, Porikli, Fatih, Fernando, Basura and Hartley, Richard (2019). Hallucinating Unaligned Face Images by Multiscale Transformative Discriminative Networks. International Journal of Computer Vision, 128 (2), 500-526. doi: 10.1007/s11263-019-01254-5

Hallucinating Unaligned Face Images by Multiscale Transformative Discriminative Networks

2019

Conference Publication

SOSNet: Second Order Similarity Regularization for Local Descriptor Learning

Tian, Yurun, Yu, Xin, Fan, Bin, Wu, Fuchao, Heijnen, Huub and Balntas, Vassileios (2019). SOSNet: Second Order Similarity Regularization for Local Descriptor Learning. 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA United States, 16-20 June 2019. Piscataway, NJ United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/CVPR.2019.01127

SOSNet: Second Order Similarity Regularization for Local Descriptor Learning

Funding

Current funding

  • 2025 - 2026
    Creation of an interactive online seaweed production map to support policy-making for the Indonesian seaweed industry
    KONEKSI Environment and Climate Change Extension Support
    Open grant
  • 2024 - 2027
    AI-Empowered and Video-Based uplift of Paralympic classification systems (AQIRP project administered by Follow Me AI)
    Follow Me AI Pty Ltd
    Open grant
  • 2023 - 2028
    Breaking the Communication Barrier for the Australian Deaf Community: Vision Based Australian Sign Language Translation and Production
    Google Asia Pacific Pte Ltd
    Open grant
  • 2023 - 2026
    Advancing Human Perception: Countering Evolving Malicious Fake Visual Data
    ARC Discovery Early Career Researcher Award
    Open grant
  • 2023 - 2027
    Analytics for the Australian Grains Industry (AAGI)
    Grains Research & Development Corporation
    Open grant

Past funding

  • 2024
    Breaking the Communication Barrier for the Australian Deaf Community: Vision Based Australian Sign Language Translation and Production
    Google Inc
    Open grant
  • 2023 - 2024
    Developing applications of satellite imagery for modelling environmental and social impacts of climate change on seaweed farming in Indonesia (KONEKSI Grant administered by Griffith University)
    Griffith University
    Open grant
  • 2023 - 2025
    Two-way Auslan: Automatic Machine Translation of Australian Sign Language (ARC Discovery Project administered by ANU)
    The Australian National University
    Open grant

Supervision

Availability

Dr Xin Yu is:
Available for supervision

Looking for a supervisor? Read our advice on how to choose a supervisor.

Supervision history

Current supervision

  • Doctor Philosophy

    Multimodal foundation model design and analysis

    Principal Advisor

    Other advisors: Dr Miao Xu, Dr Heming Du

  • Doctor Philosophy

    Human Posture Recognition Applied to Physical Activity

    Principal Advisor

    Other advisors: Professor Sean Tweedy

  • Doctor Philosophy

    Understanding Human Intention and Performance

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Understanding Human Movements and Sport Performance Analysis

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Effective Visual Data Compression

    Principal Advisor

    Other advisors: Associate Professor Sen Wang, Dr Heming Du

  • Doctor Philosophy

    Automatic Retinal Health Monitoring through Multi-modal Medical Imaging

    Principal Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

  • Doctor Philosophy

    Combating evolving deceptive fake visual information through deepfake detection

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Two way Auslan Translation

    Principal Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh, Dr Heming Du

  • Doctor Philosophy

    Integrating Deep Learning and Remote Sensing for Precision Agriculture in Staple Crops

    Principal Advisor

    Other advisors: Dr Miao Xu

  • Doctor Philosophy

    Understanding Human Intention and Performance

    Principal Advisor

    Other advisors: Dr Heming Du, Dr Miao Xu

  • Doctor Philosophy

    Human Understanding in Sports

    Principal Advisor

    Other advisors: Associate Professor Sen Wang, Dr Heming Du

  • Doctor Philosophy

    Pose Estimation for Human with Disabilities

    Principal Advisor

    Other advisors: Professor Brian Lovell

  • Doctor Philosophy

    Two way Auslan Translation

    Principal Advisor

    Other advisors: Professor Helen Huang, Dr Heming Du

  • Doctor Philosophy

    Compressed Video Restoration

    Principal Advisor

    Other advisors: Dr Miao Xu, Dr Heming Du

  • Doctor Philosophy

    Object-Centric Audio-Visual Alignment for Sounding Source Segmentation

    Principal Advisor

    Other advisors: Associate Professor Sen Wang

  • Doctor Philosophy

    Remote Sensing Analysis in computer vision

    Associate Advisor

    Other advisors: Professor Helen Huang

  • Doctor Philosophy

    Enhancing Robustness and Generalizability in Computational Models

    Associate Advisor

    Other advisors: Associate Professor Mahsa Baktashmotlagh

  • Doctor Philosophy

    Data driven approaches for smart farming

    Associate Advisor

    Other advisors: Professor Helen Huang

  • Doctor Philosophy

    Towards knowledge discovery from imperfect and evolving data

    Associate Advisor

    Other advisors: Dr Miao Xu

Media

Enquiries

For media enquiries about Dr Xin Yu's areas of expertise, story ideas and help finding experts, contact our Media team:

communications@uq.edu.au