Intelligent Environment & Wireless Sensing

知的環境・無線センシング

Intelligent Environment & Wireless Sensing

Keywords

Wi-Fi sensingWearable computingCore body temperature estimationActivity recognitionBackscatterHealthcare monitoringEnergy harvesting IoTSports sensing

An intelligent environment is a physical space equipped with information and communication technology, sensor systems, and embedded computing so that it can understand human states and behavior and provide support naturally. In our lab, we pursue spaces that behave intelligently through wireless sensing, portable 3D LiDAR, privacy-preserving spatial sharing, and physiological data analysis.

A major feature of intelligent environments is that they can understand context and provide timely support without requiring explicit user commands. At the same time, we address many practical challenges, including avoiding excessive intervention, collecting data with privacy in mind, and realizing sensing systems that minimize battery replacement and deployment burden.


Wireless Sensing and Backscatter Tags

We study wireless sensing technologies that use existing radio signals such as Wi-Fi and Bluetooth to understand human activities and surrounding environments without physical contact. By capturing different reflection characteristics caused by material properties and spatial configurations, we connect radio observations to identification of people and objects, activity recognition, and scene understanding.

We also develop tags based on ultra-low-power backscatter communication. By controlling how surrounding radio waves are affected, we separate the influence of multiple targets, infer nearby situations such as conversation or TV watching, and pursue monitoring systems that reduce the burden of battery replacement.

Daily Living Activity Recognition with Frequency-Shift WiFi Backscatter Tags
Hikoto Iseda, Keiichi Yasumoto, Akira Uchiyama, Teruo Higashino
MDPI Sensors, Vol. 24, No. 11, pp. 3277, May 2024.
DOI:10.3390/s24113277
Activity Recognition Using CSI Backscatter with Commodity Wi-Fi
Viktor Erdelyi, Kazuki Miyao, Akira Uchiyama, Tomoki Murakami
The 22nd ACM International Conference on Mobile Systems, Applications, and Services (MobiSys'24 Posters)
Wireless Sensing for Future Smart Home and Society
Akira Uchiyama
The 34th International Conference on Computer Theory and Applications (ICCTA 2024)

Portable 3D LiDAR Device "Hitonavi-µ"

We developed "Hitonavi-µ," a portable sensing device based on micro-sized 3D LiDAR sensors, and study activity recognition and anomaly detection for elderly care, monitoring, and daily-life support. A key feature is that the device can capture human motion and posture three-dimensionally while remaining compact enough to be carried and deployed easily.

Fall Detection and Assessment using Multitask Learning and Micro-Sized LiDAR in Elderly Care
Shota Yamada, Hamada Rizk, Tatsuya Amano, Hirozumi Yamaguchi
EAI MobiQuitous 2023 - 20th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services
PDF DOI:10.1007/978-3-031-63992-0_19Related Project:安全安心な移動を支援する省電力ウェアラブルデバイス「ネックウェア」の研究開発
🏆Best Demo Award
Demonstrating Hitonavi-µ: A Novel Wearable LiDAR for Human Activity Recognition
Hamada Rizk, Yuma Okochi, Hirozumi Yamaguchi
Proceedings of the 28th Annual International Conference on Mobile Computing And Networking (MobiCom '22) POSTER/DEMO, pp.756 - 757
PDF DOI:10.1145/3495243.3558744Related Project:安全安心な移動を支援する省電力ウェアラブルデバイス「ネックウェア」の研究開発

See the project page for Hitonavi-µ here.


Privacy-Preserving Spatial Sharing and the Metaverse

In remote spatial sharing and metaverse systems, convenience must be balanced with visual privacy and careful handling of spatial information. We study privacy awareness in immersive spatial-sharing systems as well as per-user control of visible regions and information presentation.

Understanding Privacy Awareness in Immersive Spatial Sharing System
Tomokazu Matsui, Shigetomo Sakuma, Yuki Mishima, Hirohiko Suwa, Keiichi Yasumoto, Tatsuya Amano, and Hirozumi Yamaguchi
Sensors and Materials, Volume 36, Number 10(3) (2024), pp. 4567-4583
DOI:10.18494/SAM5213Related Project:新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤
Visual Privacy Control for Metaverse and the Beyond
Tatsuya Amano; Teruhiro Mizumoto; Srikant Manas Kala; Hirozumi Yamaguchi; Tomokazu Matsui; Keiichi Yasumoto
IEEE Pervasive Computing, vol. 23, no. 01, pp. 10-17, Jan.-March 2024
PDF DOI:10.1109/MPRV.2024.3365989Related Project:新生活様式におけるコミュニティ形成のためのサイバーフィジカル空間共有基盤

See the spatial-sharing project here.


Behavior Understanding with Smartphone Sensing

We also study methods that capture subtle changes in daily life by using mobility and usage patterns obtained from smartphone sensors. As an application in education and welfare, we investigate ways to gently detect early signs of school attendance issues.

Detecting Subtle Signs of School Attendance Issues Using Smartphone-Based Sensing
Viktor Erdélyi, Teruhiro Mizumoto, Yuichiro Kitai, Daiki Ishimaru, Hiroyoshi Adachi, Teruo Higashino, Manabu Ikeda
IEEE Access, vol. 13, pp. 4652-4669, 2025
PDF DOI:10.1109/ACCESS.2024.3523108

Physiological Data Analysis and Core Body Temperature Estimation

We use physiological data obtained from wearable sensors and thermography to study core body temperature estimation, early heatstroke detection, stress-level estimation, and related tasks. We emphasize methods that can be measured in practical settings such as hospitals, sports, and universities, with a view toward real-world deployment.

A Preliminary Study on Core Temperature Estmiation Using a Neonatal Thermal Model via Backpropagation Algorithm
Natsumi Sakamoto, Hiroki Kudo, Akira Uchiyama, Keisuke Hamada, Eiji Hirakawa
EAI MobiQuitous 2024

Ray-Tracing-Driven Pattern-Based Vehicle Recognition in ISAC Radar

Heetae Jin, Akira Uchiyama

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerRad 2026, pp. 328–333

ISACBeyond 5G +4

Activity Recognition Using CSI Backscatter with Commodity Wi-Fi

BackscatterActivity Recognition +3

Point Cloud-based Fall Detection for Healthcare Applications

Fall DetectionPrivacy Preservation +1

Human Presence Detection Using Bluetooth Channel Sounding

Bluetooth Channel SoundingBLE +2

Indoor Drone Propeller Speed Estimation Using Wi-Fi CSI

WiFi CSIDrone

Environment-Independent Activity Recognition via Wi-Fi CSI Using an Encoder-Decoder Network

Wi-Fi CSIAutoencoder +2

Investigation of Core Body Temperature Estimation Based on Facial Surface Temperature Using Thermography

Core Body Temperature EstimationFeature Selection +4

Environment-Independent Wi-Fi CSI Activity Recognition Method Based on an Extended Autoencoder

Wi-Fi CSIAutoencoder +2

Energy-Free Sensing and Context Recognition through Photovoltaic Cells

Step countingLocalization +3

Mobile Health System using Facial Image for Assessment of Work Engagement, Recovery and Reattachment

Recovery EstimationSmart Toothbrush

Environment-Agnostic In-home Human Activity Recognition Using Wi-Fi Signals

Environment-Agnostic In-home Human Activity Recognition Using Wi-Fi Signals

Light-weight Object Detection of 3-D Point Cloud Data by Micro-size LiDAR

3D point cloudobject detection +2

Dynamic Offset Correction for Smartphone Thermal Cameras Using a Wristband Sensor

Thermal cameraSmartphone +2

Reliability Estimation of Heart Rate Measurement Using Wrist-Worn Devices

Heart rateReliability +2

Localization Focusing on Human Poses Using a Single Camera Towards Social Distance Monitoring During Sports

Wheelchair BasketballActivity Recognition +1

Backscatter Tag Detection Method Using Sinusoidal Frames towards Wi-Fi Sensing

Wi-Fi SensingBackscatter

Performance Evaluation of Angle of Arrival Estimation by MUSIC Method Using Backscatter Tags

BackscatterWi-Fi

Person Identification Method Based on 3D Point Cloud Using Small Depth Sensor

human identification3D point cloud +1

3D Point Cloud-Based Sitting Posture Recognition Using Deep Learning

sitting postureobject detection +2

Identification of Conductive Tags Based on Radio Reflection Patterns Using LSTM

Target IdentificationWi-Fi Imaging +2