Overview
Background
I am a researcher in Interaction Design, building new interactive devices and seeking to understand the experience of using those devices. I am a future technologist and pursue technology-first human-computer interaction - building and exploring novel tech that may later provide solutions to human-centered problems. I have a special interest in Haptics for Extended Reality and Smart Clothing for Muscle Control. My research typically involves device design and engineering, studies of human perception, and user experience explorations of new technologies.
I have published over 40 peer-reviewed articles across top venues in Human-Computer Interaction, including CHI, UIST, CSCW, and ISMAR. I serve frequently as an associate editor for CHI, UIST, VR, and ISS.
Availability
- Dr Jarrod Knibbe is:
- Available for supervision
Qualifications
- Masters (Research) of Computer Science, University of Bristol
- Doctor of Philosophy of Computer-Human Interaction, University of Bristol
Research interests
-
Haptics for Virtual Reality
One of the great challenges of virtual reality is that you can't actually touch stuff - you can't feel it's texture, weight, heat, etc. There are two broad camps trying to address this: the Accuracy camp and the Naturalness camp. The accuracy camp wants you to experience material properties as accurately as possible, so they build specialist controllers. The naturalness camp wants you to be unencumbered by controllers, so they use illusions. I have no allegiance to either camp and work across them both. I am currently building controllers to let you grasp objects of complex shapes and sizes, and building illusions that play with your sense of where you are in the room so you can use physical props in your VR experiences.
-
Smart Clothing
We are increasingly able to integrate an amazing range of sensors and actuators into fabric, creating Smart Clothing. However, we are not seeing these clothes in stores or in our wardrobes. I believe this is for two key reasons: (1) no killer app - we are not yet doing anything really convincing with these clothes, and (2) tailoring is hard - we are not yet able to make smart clothing work regardless of your body shape or size. Once we have solved problem (2), I believe solutions to problem (1) will follow.
Research impacts
My research has inspired new features in smartphones from Google (the Pixel's battery share) and Samsung (PowerShare), and has been featured in various news outlets (including Wired, the Economist, Hackaday, Fast Company, and the Guardian).
I also work extensively with companies and organisations to explore ways for digital transformation to solve their challenges. I facilitate design thinking workshops to help identify new opportunities, build new partnerships, and reveal next steps for new projects. I have run workshops for numerous multinationals and government organisations, leading to substantial new work packages and meaningful change. I have run professional courses on scientific leadership.
Works
Search Professor Jarrod Knibbe’s works on UQ eSpace
2023
Conference Publication
An empirical evaluation of educational data mining techniques in a dynamic VR application
Khorasani, Sara, Nawaz, Sadia, Syiem, Brandon Victor, Wei, Jing, Pardos, Zachary A., Knibbe, Jarrod and Velloso, Eduardo (2023). An empirical evaluation of educational data mining techniques in a dynamic VR application. OzCHI '23: 35th Australian Computer-Human Interaction Conference, Wellington, New Zealand, 2 - 6 December 2023. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3638380.3638387
2023
Journal Article
Hands-on or hands-off: deciphering the impact of interactivity on embodied learning in VR
Khorasani, Sara, Victor Syiem, Brandon, Nawaz, Sadia, Knibbe, Jarrod and Velloso, Eduardo (2023). Hands-on or hands-off: deciphering the impact of interactivity on embodied learning in VR. Computers and Education: X Reality, 3 100037, 1-13. doi: 10.1016/j.cexr.2023.100037
2023
Journal Article
Fused Spectatorship: Designing Bodily Experiences Where Spectators Become Players
Patibanda, Rakesh, Saini, Aryan, Overdevest, Nathalie, Montoya, Maria F., Li, Xiang, Chen, Yuzheng, Nisal, Shreyas, Andres, Josh, Knibbe, Jarrod, van den Hoven, Elise and Mueller, Florian ‘Floyd’ (2023). Fused Spectatorship: Designing Bodily Experiences Where Spectators Become Players. Proceedings of the ACM on Human-Computer Interaction, 7 (CHI PLAY) 403, 769-802. doi: 10.1145/3611049
2023
Journal Article
Auto-Paizo Games: Towards Understanding the Design of Games That Aim to Unify a Player’s Physical Body and the Virtual World
Patibanda, Rakesh, Hill, Chris, Saini, Aryan, Li, Xiang, Chen, Yuzheng, Matviienko, Andrii, Knibbe, Jarrod, van den Hoven, Elise and Mueller, Florian ‘Floyd’ (2023). Auto-Paizo Games: Towards Understanding the Design of Games That Aim to Unify a Player’s Physical Body and the Virtual World. Proceedings of the ACM on Human-Computer Interaction, 7 (CHI PLAY) 408, 893-918. doi: 10.1145/3611054
2023
Journal Article
InfoPrint : Embedding Interactive Information in 3D Prints Using Low-Cost Readily-Available Printers and Materials
Jiang, Weiwei, Wang, Chaofan, Sarsenbayeva, Zhanna, Irlitti, Andrew, Wei, Jing, Knibbe, Jarrod, Dingler, Tilman, Goncalves, Jorge and Kostakos, Vassilis (2023). InfoPrint : Embedding Interactive Information in 3D Prints Using Low-Cost Readily-Available Printers and Materials. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 7 (3) 102, 1-29. doi: 10.1145/3610933
2023
Conference Publication
Towards a Bedder Future: A Study of Using Virtual Reality while Lying Down
van Gemert, Thomas, Hornbæk, Kasper, Knibbe, Jarrod and Bergström, Joanna (2023). Towards a Bedder Future: A Study of Using Virtual Reality while Lying Down. CHI conference on Human Factors in Computing Systems (CHI), Hamburg, Germany, 23-28 April 2023. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3544548.3580963
2023
Conference Publication
'Labelling the gaps': a weakly supervised automatic eye gaze estimation
Ghosh, Shreya, Dhall, Abhinav, Hayat, Munawar and Knibbe, Jarrod (2023). 'Labelling the gaps': a weakly supervised automatic eye gaze estimation. 16th Asian Conference on Computer Vision (ACCV), Macao, Peoples Republic of China, 4-8 December 2022. Cham, Switzerland: Springer Cham. doi: 10.1007/978-3-031-26316-3_44
2023
Conference Publication
“Hello, Fellow Villager!”: perceptions and impact of displaying users’ locations on Weibo
Ma, Ying, Zhou, Qiushi, Tag, Benjamin, Sarsenbayeva, Zhanna, Knibbe, Jarrod and Goncalves, Jorge (2023). “Hello, Fellow Villager!”: perceptions and impact of displaying users’ locations on Weibo. 19th IFIP TC13 International Conference, York, United Kingdom, 28 August - 1 September 2023. Cham, Switzerland: Springer Nature Switzerland. doi: 10.1007/978-3-031-42286-7_29
2022
Book Chapter
Body-based user interfaces
Strohmeier, Paul, Mottelson, Aske, Pohl, Henning, McIntosh, Jess, Knibbe, Jarrod, Bergström, Joanna, Jansen, Yvonne and Hornbæk, Kasper (2022). Body-based user interfaces. The Routledge handbook of bodily awareness. (pp. 478-502) edited by Adrian J. T. Alsmith and Matthew R. Longo. Abingdon, Oxon, United Kingdom: Routledge. doi: 10.4324/9780429321542-39
2022
Conference Publication
AV-GAZE: a study on the effectiveness of audio guided visual attention estimation for non-profilic faces
Ghosh, Shreya, Dhall, Abhinav, Hayat, Munawar and Knibbe, Jarrod (2022). AV-GAZE: a study on the effectiveness of audio guided visual attention estimation for non-profilic faces. 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France, 16-19 October 2022. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/icip46576.2022.9897360
2022
Conference Publication
Investigating the effect of direction on the limits of haptic retargeting
Clarence, Aldrich, Knibbe, Jarrod, Cordeil, Maxime and Wybrow, Michael (2022). Investigating the effect of direction on the limits of haptic retargeting. 21st IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Singapore, Singapore, 17-22 October 2022. Washington, DC, United States: IEEE Computer Society. doi: 10.1109/ismar55827.2022.00078
2022
Journal Article
Sense of agency and user experience: is there a link?
Bergström, Joanna, Knibbe, Jarrod, Pohl, Henning and Hornbæk, Kasper (2022). Sense of agency and user experience: is there a link?. ACM Transactions on Computer-Human Interaction, 29 (4) 28, 1-22. doi: 10.1145/3490493
2022
Conference Publication
MTGLS: Multi-Task Gaze Estimation with Limited Supervision
Ghosh, Shreya, Hayat, Munawar, Dhall, Abhinav and Knibbe, Jarrod (2022). MTGLS: Multi-Task Gaze Estimation with Limited Supervision. 22nd IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI United States, 4-8 January 2022. Piscataway, NJ, United States: Institute of Electrical and Electronics Engineers. doi: 10.1109/WACV51458.2022.00123
2021
Journal Article
The MADE-Axis: a modular actuated device to embody the axis of a data dimension
Smiley, Jim, Lee, Benjamin, Tandon, Siddhant, Cordeil, Maxime, Besançon, Lonni, Knibbe, Jarrod, Jenny, Bernhard and Dwyer, Tim (2021). The MADE-Axis: a modular actuated device to embody the axis of a data dimension. Proceedings of the ACM on Human-Computer Interaction, 5 (ISS) 501, 1-23. doi: 10.1145/3488546
2021
Journal Article
Towards understanding the design of bodily integration
Mueller, Florian Floyd, Lopes, Pedro, Andres, Josh, Byrne, Richard, Semertzidis, Nathan, Li, Zhuying, Knibbe, Jarrod and Greuter, Stefan (2021). Towards understanding the design of bodily integration. International Journal of Human-Computer Studies, 152 102643, 102643. doi: 10.1016/j.ijhcs.2021.102643
2021
Conference Publication
Optimising automatic calibration of electric muscle stimulation
Gange, Graeme and Knibbe, Jarrod (2021). Optimising automatic calibration of electric muscle stimulation. Thirty-Fifth AAAI Conference on Artificial Intelligence, Virtual, 2-9 February 2021. Washington, DC USA: Association for the Advancement of Artificial Intelligence.
2021
Conference Publication
Unscripted retargeting: reach prediction for haptic retargeting in virtual reality
Clarence, Aldrich, Knibbe, Jarrod, Cordeil, Maxime and Wybrow, Michael (2021). Unscripted retargeting: reach prediction for haptic retargeting in virtual reality. 28th IEEE Conference on Virtual Reality and 3D User Interfaces (IEEE VR), Lisboa, Portugal, 27 March-3 April 2021. Los Alamitos, CA USA: Institute of Electrical and Electronics Engineers. doi: 10.1109/vr50410.2021.00036
2021
Conference Publication
Bad breakdowns, useful seams, and face slapping: analysis of VR fails on YouTube
Dao, Emily, Muresan, Andreea, Hornbaek, Kasper and Knibbe, Jarrod (2021). Bad breakdowns, useful seams, and face slapping: analysis of VR fails on YouTube. Human Factors in Computing Systems, Yokohama, Japan, 8-13 May 2021. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3411764.3445435
2021
Conference Publication
Dance and choreography in hci: A two-decade retrospective
Zhou, Qiushi, Chua, Cheng Cheng, Knibbe, Jarrod, Goncalves, Jorge and Velloso, Eduardo (2021). Dance and choreography in hci: A two-decade retrospective. CHI '21: CHI Conference on Human Factors in Computing Systems, Yokohama, Japan, 8-13 May 2021. New York, NY USA: Association for Computing Machinery. doi: 10.1145/3411764.3445804
2021
Conference Publication
Modeling Pointing for 3D Target Selection in VR
Dalsgaard, Tor-Salve, Knibbe, Jarrod and Bergstrom, Joanna (2021). Modeling Pointing for 3D Target Selection in VR. 27th ACM Symposium on Virtual Reality Software and Technology (VRST), Osaka, Japan, 8-10 December 2021. New York, NY United States: Association for Computing Machinery. doi: 10.1145/3489849.3489853
Funding
Current funding
Supervision
Availability
- Dr Jarrod Knibbe is:
- Available for supervision
Looking for a supervisor? Read our advice on how to choose a supervisor.
Supervision history
Current supervision
-
Doctor Philosophy
Tailoring Haptic Interaction to Perception in Virtual Reality
Principal Advisor
Other advisors: Dr Maxime Cordeil
-
Doctor Philosophy
Extreme Analytics
Associate Advisor
Other advisors: Associate Professor Stephen Viller, Professor Gianluca Demartini, Dr Maxime Cordeil
-
Doctor Philosophy
Augmented Human Operations: Using XR and AI in Remote Challenging Environments
Associate Advisor
Other advisors: Associate Professor Chelsea Dobbins, Dr Maxime Cordeil
-
Doctor Philosophy
The Impact of AI-enabled Avatars on Body Ownership within Individualised Virtual Reality for Mental Health
Associate Advisor
Other advisors: Associate Professor James Kirby, Professor Julie Henry, Dr Nell Baghaei
Media
Enquiries
For media enquiries about Dr Jarrod Knibbe's areas of expertise, story ideas and help finding experts, contact our Media team: