Intelligent Environment & Wireless Sensing

知的環境・無線センシング

Intelligent Environment & Wireless Sensing

Keywords

Wi-Fi sensingWearable computingCore body temperature estimationActivity recognitionBackscatterHealthcare monitoringEnergy harvesting IoTSports sensing

An intelligent environment is a physical space equipped with information and communication technology, sensor systems, and embedded computing so that it can understand human states and behavior and provide support naturally. In our lab, we pursue spaces that behave intelligently through wireless sensing, portable 3D LiDAR, privacy-preserving spatial sharing, and physiological data analysis.

A major feature of intelligent environments is that they can understand context and provide timely support without requiring explicit user commands. At the same time, we address many practical challenges, including avoiding excessive intervention, collecting data with privacy in mind, and realizing sensing systems that minimize battery replacement and deployment burden.


Wireless Sensing and Backscatter Tags

We study wireless sensing technologies that use existing radio signals such as Wi-Fi and Bluetooth to understand human activities and surrounding environments without physical contact. By capturing different reflection characteristics caused by material properties and spatial configurations, we connect radio observations to identification of people and objects, activity recognition, and scene understanding.

We also develop tags based on ultra-low-power backscatter communication. By controlling how surrounding radio waves are affected, we separate the influence of multiple targets, infer nearby situations such as conversation or TV watching, and pursue monitoring systems that reduce the burden of battery replacement.

Daily Living Activity Recognition with Frequency-Shift WiFi Backscatter Tags
Hikoto Iseda, Keiichi Yasumoto, Akira Uchiyama, Teruo Higashino
MDPI Sensors, Vol. 24, No. 11, pp. 3277, May 2024.
DOI: 10.3390/s24113277
Activity Recognition Using CSI Backscatter with Commodity Wi-Fi
Viktor Erdelyi, Kazuki Miyao, Akira Uchiyama, Tomoki Murakami
The 22nd ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'24 Posters)
Wireless Sensing for Future Smart Home and Society
Akira Uchiyama
The 34th International Conference on Computer Theory and Applications (ICCTA 2024)

Portable 3D LiDAR Device "Hitonavi-µ"

We developed "Hitonavi-µ," a portable sensing device based on micro-sized 3D LiDAR sensors, and study activity recognition and anomaly detection for elderly care, monitoring, and daily-life support. A key feature is that the device can capture human motion and posture three-dimensionally while remaining compact enough to be carried and deployed easily.

Fall Detection and Assessment using Multitask Learning and Micro-Sized LiDAR in Elderly Care
Shota Yamada, Hamada Rizk, Tatsuya Amano, Hirozumi Yamaguchi
EAI MobiQuitous 2023 - 20th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
Details DOI: 10.1007/978-3-031-63992-0_19 Related Project: 安全安心な移動を支援する省電力ウェアラブルデバイス「ネックウェア」の研究開発
🏆 Best Demo Award
Demonstrating Hitonavi-µ: A Novel Wearable LiDAR for Human Activity Recognition
Hamada Rizk, Yuma Okochi, Hirozumi Yamaguchi
Proceedings of the 28th Annual International Conference on Mobile Computing And Networking (MobiCom '22) POSTER/DEMO, pp.756 - 757
Details DOI: 10.1145/3495243.3558744 Related Project: 安全安心な移動を支援する省電力ウェアラブルデバイス「ネックウェア」の研究開発

See the project page for Hitonavi-µ here.


Privacy-Preserving Spatial Sharing and the Metaverse

In remote spatial sharing and metaverse systems, convenience must be balanced with visual privacy and careful handling of spatial information. We study privacy awareness in immersive spatial-sharing systems as well as per-user control of visible regions and information presentation.

Understanding Privacy Awareness in Immersive Spatial Sharing System
Tomokazu Matsui, Shigetomo Sakuma, Yuki Mishima, Hirohiko Suwa, Keiichi Yasumoto, Tatsuya Amano, and Hirozumi Yamaguchi
Sensors and Materials, Volume 36, Number 10(3) (2024), pp. 4567-4583
Details DOI: 10.18494/SAM5213 Related Project: 新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤
Visual Privacy Control for Metaverse and the Beyond
Tatsuya Amano; Teruhiro Mizumoto; Srikant Manas Kala; Hirozumi Yamaguchi; Tomokazu Matsui; Keiichi Yasumoto
IEEE Pervasive Computing, vol. 23, no. 01, pp. 10-17, Jan.-March 2024
Details DOI: 10.1109/MPRV.2024.3365989 Related Project: 新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤

See the spatial-sharing project here.


Behavior Understanding with Smartphone Sensing

We also study methods that capture subtle changes in daily life by using mobility and usage patterns obtained from smartphone sensors. As an application in education and welfare, we investigate ways to gently detect early signs of school attendance issues.

Detecting Subtle Signs of School Attendance Issues Using Smartphone-Based Sensing
Viktor Erdélyi, Teruhiro Mizumoto, Yuichiro Kitai, Daiki Ishimaru, Hiroyoshi Adachi, Teruo Higashino, Manabu Ikeda
IEEE Access, vol. 13, pp. 4652-4669, 2025
DOI: 10.1109/ACCESS.2024.3523108

Physiological Data Analysis and Core Body Temperature Estimation

We use physiological data obtained from wearable sensors and thermography to study core body temperature estimation, early heatstroke detection, stress-level estimation, and related tasks. We emphasize methods that can be measured in practical settings such as hospitals, sports, and universities, with a view toward real-world deployment.

A Preliminary Study on Core Temperature Estmiation Using a Neonatal Thermal Model via Backpropagation Algorithm
Natsumi Sakamoto, Hiroki Kudo, Akira Uchiyama, Keisuke Hamada, Eiji Hirakawa
EAI MobiQuitous 2024

Student Engagement Measurement Through Micro-Action Detection with Multi-Modal Foundation Model

Masato Matsuura, Tatsuya Amano, Hirozumi Yamaguchi

2025 Fifteenth International Conference on Mobile Computing and Ubiquitous Networking (ICMU), 2025, pp. 1-6

DOI 10.23919/ICMU65253.2025.11219132

SelfLoc: Robust Self-Supervised Indoor Localization with IEEE 802.11az Wi-Fi for Smart Environments

Hamada Rizk, Ahmed Elmogy.

Electronics, 14(13), 2675.

DOI 10.3390/electronics14132675

Self-Supervised WiFi-Based Identity Recognition in Multi-User Smart Environments

Hamada Rizk, Ahmed Elmogy

Sensors 2025, 25(10), 3108

DOI 10.3390/s25103108

Reference-Free 3D WiFi AP Localization by Outdoor-to-Indoor Bridging

Tatsuya Amano; Hirozumi Yamaguchi; Teruo Higashino

IEEE Open Journal of the Computer Society, vol. 6, pp. 688-700, 2025

DOI 10.1109/OJCS.2025.3566774

MultiSenseX: A Sustainable Solution for Multi-Human Activity Recognition and Localization in Smart Environments

Hamada Rizk, Ahmed Elmogy, Mohamed Rihan, Hirozumi Yamaguchi

AI 2025, vol. 6, no. 6

DOI 10.3390/ai6010006

Demonstrating OmniCells: A Resilient Indoor Localization System to Devices' Diversity

Hamada Rizk, Tatsuya Amano, Hirozumi Yamaguchi, Moustafa Youssef

Proceedings of the 28th Annual International Conference on Mobile Computing And Networking (MobiCom '22) POSTER/DEMO, pp.781 - 782

DOI 10.1145/3495243.3558753

LocFree: a WiFi RTT-based Device-Free Indoor Localization System

Mohamed Mohsen, Hamada Rizk, Hirozumi Yamaguchi and Moustafa Youssef

GeoIndustry at the 31st ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems (ACM SIGSPATIAL 2023)

DOI 10.1145/3615888.3627813

Environment-Independent Activity Recognition via Wi-Fi CSI Using an Encoder-Decoder Network

Yu Sugimoto, Hamada Rizk, Akira Uchiyama, Hirozumi Yamaguchi

8th Workshop on Body-Centric Computing Systems (BodySys 2023)

DOI 10.1145/3597061.3597261

Wi-Fi CSIAutoencoder +2

Localization Focusing on Human Poses Using a Single Camera Towards Social Distance Monitoring During Sports

Ryosuke Hasegawa, Akira Uchiyama, Fumio Okura, Daigo Muramatsu, Issei Ogasawara, Hiromi Takahata, Ken Nakata, and Teruo Higashino

IEEE Access, Vol. 10, pp.15457-15468, 2022

Wheelchair BasketballActivity Recognition +1

A method for improving semantic segmentation using thermographic images in infants

Hidetsugu Asano, Eiji Hirakawa, Hayato Hayashi, Keisuke Hamada, Yuto Asayama, Masaaki Oohashi, Akira Uchiyama, Teruo Higashino

BMC Medical Imaging, Vol. 22, No. 1, 2022.

DOI 10.1186/s12880-021-00730-0

Body Part Detection from Neonatal Thermal Images Using Deep Learning

Fumika Beppu, Hiroki Yoshikawa, Akira Uchiyama, Teruo Higashino, Keisuke Hamada, Eiji Hirakawa

18th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services

premature infants/thermal images/parts detection/temperature extraction/deep learning

Environment-Agnostic In-home Human Activity Recognition Using Wi-Fi Signals

Environment-Agnostic In-home Human Activity Recognition Using Wi-Fi Signals