Journal · 2024

Visual Privacy Control for Metaverse and the Beyond

Tatsuya Amano , Teruhiro Mizumoto , Srikant Manas Kala , Hirozumi Yamaguchi , Tomokazu Matsui , Keiichi Yasumoto

IEEE Pervasive Computing, vol. 23, no. 01, pp. 10-17, Jan.-March 2024

DOI: 10.1109/MPRV.2024.3365989

Abstract

Metaverse technologies are transforming how distant individuals interact in immersive virtual environments. These technologies, in combination with the latest developments in 3D sensing, will create a hybrid metaverse blending virtual and physical spaces. However, high-resolution 3D sensing poses privacy risks from unrestricted spatial data sharing. It may inadvertently expose the human visual appearance and private objects and spaces in the users’ physical environments to the shared metaverse. To mitigate these challenges, this article surveys the visual privacy issues in the era of the metaverse. It then introduces a visual privacy control method enabling privacy protection in the current metaverse and beyond. Our goal is to empower users to control the visual privacy of spatial objects by comprehending their inherent semantics. The design allows users to define their privacy protection levels or, if preferred, delegate this responsibility to an automated control system. We present two use-case scenarios to demonstrate this concept.

Research Note

Metaverse technologies are changing how distant individuals interact in immersive virtual environments, and combined with recent developments in 3D sensing they will produce a hybrid metaverse that blends virtual and physical space. High-resolution 3D sensing brings privacy risks with it, because sharing spatial data without restriction can inadvertently expose private objects and spaces in a user's physical environment, along with the visual appearance of the people there.

Visual privacy concerns what leaks through being captured in imagery or 3D data. It sits at a different layer from location privacy or the confidentiality of communication content, and it cannot be controlled without understanding what is being seen, since whether an object on a shelf should be hidden depends on what that object is.

This article surveys the visual privacy issues that arise in the era of the metaverse, and then introduces a visual privacy control method for protecting privacy in the current metaverse and beyond. The goal is to let users control the visual privacy of spatial objects by comprehending their inherent semantics. The design allows users either to define their own level of protection or to delegate that responsibility to an automated control system. Two use-case scenarios are presented to illustrate the concept.

新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤

新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤

National Institute of Information and Communications Technology (NICT) 高度通信・放送研究開発委託研究
ウイルス等感染症対策に資する情報通信技術の研究開発 課題C: アフターコロナ社会を形成するICT

Environment-Aware Distributed Scheduling for Emergency LoRa Networks

Yuto Inaba, Tatsuya Amano, Akihito Hiromori, Hirozumi Yamaguchi

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), SPT-IoT 2026, pp. 1366–1371

DOI 10.1109/PerComWorkshops68308.2026.11585469

Disaster CommunicationLoRa +4

A Lightweight Vision-Language Model for Disaster Image Summarization

Hibiki Yoshizaki, Akira Uchiyama, Akihito Hiromori, Mineo Takai, Hirozumi Yamaguchi

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerconAI 2026, pp. 1203–1208

DOI 10.1109/PerComWorkshops68308.2026.11585419

Semantic CommunicationDisaster Response +4

Physics-Integrated Deep Learning for Urban Landslide Prediction

Ren Ozeki, Hamada Rizk, Hirozumi Yamaguchi

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), URBSENSE 2026, pp. 1094–1099

DOI 10.1109/PerComWorkshops68308.2026.11585337

Landslide PredictionPhysics-Integrated Learning +3

A Simulation Framework for Precision Formation Flying of Massive Satellite Swarms

Tatsuya Amano, Akihito Hiromori, Hirozumi Yamaguchi, Sumio Morioka

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerVehicle , pp. 230–235

DOI 10.1109/PerComWorkshops68308.2026.11585321

Satellite Formation FlyingDistributed Simulation +4

Ray-Tracing-Driven Pattern-Based Vehicle Recognition in ISAC Radar

Heetae Jin, Akira Uchiyama

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerRad 2026, pp. 328–333

DOI 10.1109/PerComWorkshops68308.2026.11585327

ISACBeyond 5G +4

A Questionnaire-Only Counterfactual Machine Learning Approach to Assess the Spatial Impact of Green Mobility Vehicles in Urban Parks

Rami Naeem, Srikant Manas, Tatsuya Amano, Hirozumi Yamaguchi

ICDCN 2026 Workshop: IWNDSC2026

DOI 10.1145/3737611.3776620