IEEE PerCom2024
Four Presentations at IEEE PerCom 2024, Including Main Conference (Short) and Workshops
Publications & Talks
International Conference · 2024
3D Point Cloud-Based Interaction System Bridging Physical Spaces in Virtual Environments
Abstract
Thanks to advancement of IT technologies, VR technologies and VR interfaces have been proposed to enhance interaction in virtual spaces. Conventional interaction systems using 3D images are limited to communicating in a static space, reproduced in advance in a virtual space. For more realistic interaction, it is important to capture the physical space around the participants and reproduce it in the virtual space. However, such new interaction methods trigger new privacy concerns. This study aims to develop an immersive spatial sharing system based on point cloud technologies. A prototype system incorporating LiDAR cameras and a mechanism to hide private objects was tested with 41 participants using VR headsets. The study gathered 16 family responses, indicating the system’s utility and the variation in privacy concerns based on gender, IT familiarity, and age. These insights are crucial for developing privacy filters in spatial sharing systems, especially for Metaverse interactions. We demonstrate our proposed system enhancing spatial sharing communication with 3D point clouds. The system integrates distant spaces, such as the venue and laboratory, in a virtual world. Participants can experience interactions along the scenario of a remote cooking class using the privacy-aware spatial sharing system through VR headsets.
Research Note
Many VR technologies and interfaces have been proposed for enriching interaction in virtual spaces, yet conventional systems based on 3D imagery have largely confined conversation to a static space reproduced in advance. Making the interaction more realistic requires capturing the physical space around the participants as it is and reproducing it virtually.
This work develops an immersive spatial sharing system built on point cloud technology. A prototype incorporating LiDAR cameras and a mechanism for hiding private objects was tested with 41 participants using VR headsets. Sixteen family responses confirmed the utility of the system and showed that privacy concerns vary with gender, familiarity with information technology and age.
The demonstration integrates two distant places, the venue and the laboratory, within a virtual world and lets participants follow a remote cooking class scenario through the privacy-aware spatial sharing system. Sharing the space itself as a point cloud means that what someone is doing with their hands and how their tools are arranged is directly visible, so a good deal is conveyed without being described in words. A cooking task, which proceeds through ordered steps, was chosen because it shows that advantage clearly.
Related Lab Activities
Related Projects
新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤
National Institute of Information and Communications Technology (NICT) 高度通信・放送研究開発委託研究
ウイルス等感染症対策に資する情報通信技術の研究開発 課題C: アフターコロナ社会を形成するICT
