Young Researcher Paper Award 2023
🥇Winners

Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 37, Number 8(4) (2025)
Copyright(C) MYU K.K.
pp. 3723-3743
S&M4148 Research paper of Special Issue
https://doi.org/10.18494/SAM5356
Published: August 28, 2025

Design of Real-time Interactive Healthcare System for Acupoint Analysis Based on Augmented Reality [PDF]

Yu-Xiang Zhao, Chung-Yen Wei, and Bo-Yuan Xu

(Received August 30, 2024; Accepted August 14, 2025)

Keywords: interactive healthcare, edge computing, acupoint analysis, augmented reality, MediaPipe, gesture recognition, DNN, RASA, BERT

Acupressure is a valuable method for maintaining good health and also helps in the overall regulation of bodily functions and the promotion of physical fitness. In this paper, we propose a real-time interactive healthcare system for acupoint analysis based on augmented reality (AR). We utilized the edge computing of the Jetson Nano J1010 development board, and employed MediaPipe technology and an acupoint mapping algorithm to display acupoints on the screen. By using our proposed deep neural network (DNN)-based hand gesture recognition, we achieved AR-based interaction with acupoints. Users can view the locations of the corresponding acupoints on the body and the descriptions of the acupoints through gestures. Additionally, we developed a mobile app that enables interaction with the system via Bluetooth technology. Users can select the symptoms they wish to understand, and the system will display acupoints that can alleviate those symptoms. We also developed a bidirectional encoder representations from transformers (BERT)-based AI consultation, which utilizes the open-source conversational receive, appreciate, summarize, ask (RASA) natural language understanding (NLU) to determine the user’s intents from input on the mobile app. When the intent is related to medical content, the information is passed to a BERT model for diagnosis analysis, determining possible diseases or symptoms and providing corresponding recommended acupoints for symptom relief. This aids users in making preliminary judgments about their own conditions. All AI diagnostic information is transmitted to the server side, where physicians can view user information through a website. By visualizing the data through charts, physicians can quickly understand the user’s condition and further save medical resources. This acupoint-analysis-based healthcare system offers a safe, convenient, and efficient solution for health management, particularly valuable for individuals lacking experience and medical knowledge. We hope that by using this proposed system, users will feel like they have a virtual healthcare advisor at their disposal.

Corresponding author: Yu-Xiang Zhao


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Yu-Xiang Zhao, Chung-Yen Wei, and Bo-Yuan Xu, Design of Real-time Interactive Healthcare System for Acupoint Analysis Based on Augmented Reality, Sens. Mater., Vol. 37, No. 8, 2025, p. 3723-3743.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Novel Sensors, Materials, and Related Technologies on Artificial Intelligence of Things Applications
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)
Call for paper


Special Issue on Unique Physical Behavior at the Nano to Atomic Scales
Guest editor, Takahiro Namazu (Kyoto University of Advanced Science)
Call for paper


Special Issue on Support Systems for Human Environment Utilizing Sensor Technology and Image Processing Including AI
Guest editor, Takashi Oyabu (Nihonkai International Exchange Center)
Call for paper


Special Issue on Innovations in Multimodal Sensing for Intelligent Devices, Systems, and Applications
Guest editor, Jiahui Yu (Research scientist, Zhejiang University), Kairu Li (Professor, Shenyang University of Technology), Yinfeng Fang (Professor, Hangzhou Dianzi University), Chin Wei Hong (Professor, Tokyo Metropolitan University), Zhiqiang Zhang (Professor, University of Leeds)
Call for paper


Special Issue on Signal Collection, Processing, and System Integration in Automation Applications
Guest editor, Hsiung-Cheng Lin (National Chin-Yi University of Technology)
Call for paper


Special Issue on Artificial Intelligence Predication and Application for Energy-saving Smart Manufacturing System
Guest editor, Cheng-Chi Wang (National Sun Yat-sen University)
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.