Home Research CV Games Photos Contact

Research

A UI to change volume and frequency of individual sounds in a VR environment.

SoundModVR: Sound Modifications in Virtual Reality to Support People who are Deaf and Hard of Hearing

ASSETS 24 Paper + Demo, UIST 24 Demo

Xinyun Cao, Dhruv Jain

In this paper, we explore the possibilities of modifying sounds in VR to support DHH people. We designed and implemented 18 VR sound modification tools spanning four categories, including prioritizing sounds, modifying sound parameters, providing spatial assistance, and adding additional sounds. We evaluated the tools with DHH people and Unity VR Develoeprs.


Three pictures illustrating the three steps in the user study. A red body is picking up a cube, turning, and handing off a cube to a blue body, with words Selection, Manipulation and Coordination.

Dual Body Bimanual Coordination in Immersive Environments

DIS23 Paper

James Smith, Xinyun Cao, Adolfo Ramirez-Aristizabal, Bjoern Hartmann

ACM Digital Library - Paper - Video

Dual Body Bimanual Coordination is an empirical study where users control and interact with the world through two bodies in virtual reality simultaneously. Users select and manipulate objects to perform a coordinated handoff between two bodies under the control of a single user. We investigate people's performance in doing this task, classify strategies for how they chose to coordinate their hands, report on sense of embodiment during the scenario, and share qualitative observations about user body schema.