International Conference · 2026

Socially-Aware Robot Navigation Using Large Language Models: System and Evaluation

Xuqing Liu , Tatsuya Amano , Hamada Rizk , Hirozumi Yamaguchi

ICDCN 2026 Doctoral Symposium

Award Best Doctoral Symposium Paper Award

DOI: 10.1145/3737611.3776944

Abstract

The embodied intelligence system based on the Large Language Model (LLM) enhances the social perception and navigation capabilities of robots in dense populations. The system achieves semantic understanding and decision-making through LLM, combines MPC controller to separate high-level planning and real-time obstacle avoidance, and integrates social factor analysis. Experiments have shown that it outperforms existing methods in terms of navigation success rate and social compliance. In the future, we will build real-world datasets and explore multi machine collaboration.

Research Note

When a robot moves through a crowded space, avoiding collisions is not sufficient. Whether it crosses in front of someone or waits, how it joins a queue, which side of a corridor it keeps to, all follow unwritten conventions, and a robot that ignores them makes the people around it uncomfortable even when nothing is physically at risk. This is the problem of socially aware navigation, and it differs in kind from geometric obstacle avoidance.

The difficulty is that these conventions shift with context, so enumerating them as rules in advance is not realistic. This work therefore delegates the high-level judgement of what is happening and what would be an appropriate response to the semantic understanding of a large language model.

Language model inference is, however, too slow to react to a person stepping suddenly into the path. Control is accordingly split into two layers, with the language model producing high-level plans and an MPC controller handling real-time obstacle avoidance. MPC solves for control inputs afresh each cycle while predicting a short way into the future, which suits avoidance in dynamic surroundings.

Experiments showed the system outperforming existing methods in both navigation success rate and social compliance. The stated next steps are building real-world datasets and extending the approach to cooperation between multiple robots.

Environment-Aware Distributed Scheduling for Emergency LoRa Networks

Yuto Inaba, Tatsuya Amano, Akihito Hiromori, Hirozumi Yamaguchi

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), SPT-IoT 2026, pp. 1366–1371

DOI 10.1109/PerComWorkshops68308.2026.11585469

Disaster CommunicationLoRa +4

A Lightweight Vision-Language Model for Disaster Image Summarization

Hibiki Yoshizaki, Akira Uchiyama, Akihito Hiromori, Mineo Takai, Hirozumi Yamaguchi

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerconAI 2026, pp. 1203–1208

DOI 10.1109/PerComWorkshops68308.2026.11585419

Semantic CommunicationDisaster Response +4

Physics-Integrated Deep Learning for Urban Landslide Prediction

Ren Ozeki, Hamada Rizk, Hirozumi Yamaguchi

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), URBSENSE 2026, pp. 1094–1099

DOI 10.1109/PerComWorkshops68308.2026.11585337

Landslide PredictionPhysics-Integrated Learning +3

A Simulation Framework for Precision Formation Flying of Massive Satellite Swarms

Tatsuya Amano, Akihito Hiromori, Hirozumi Yamaguchi, Sumio Morioka

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerVehicle , pp. 230–235

DOI 10.1109/PerComWorkshops68308.2026.11585321

Satellite Formation FlyingDistributed Simulation +4

Ray-Tracing-Driven Pattern-Based Vehicle Recognition in ISAC Radar

Heetae Jin, Akira Uchiyama

2026 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), PerRad 2026, pp. 328–333

DOI 10.1109/PerComWorkshops68308.2026.11585327

ISACBeyond 5G +4

A Questionnaire-Only Counterfactual Machine Learning Approach to Assess the Spatial Impact of Green Mobility Vehicles in Urban Parks

Rami Naeem, Srikant Manas, Tatsuya Amano, Hirozumi Yamaguchi

ICDCN 2026 Workshop: IWNDSC2026

DOI 10.1145/3737611.3776620