Young Researcher Paper Award 2023
🥇Winners

Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 37, Number 3(1) (2025)
Copyright(C) MYU K.K.
pp. 801-819
S&M3958 Research Paper of Special Issue
https://doi.org/10.18494/SAM5281
Published: March 12, 2025

AI-powered Personalized Online Drawing Assistant with Hand Skeleton Analysis [PDF]

Chiao-Wen Kao, Wen-Hsuan Wu, and Chi-Sheng Huang

(Received August 5, 2024; Accepted February 12, 2025)

Keywords: assistive technology, MediaPipe, deep learning models, real-time feedback system

In this paper, we present a computer-vision-based system designed to enhance online drawing instruction by offering prompt feedback and evaluating learners’ hand movements and pen handling. The system utilizes only webcam data, avoiding the need for expensive external devices. It consists of three main components: hand skeleton analysis, drawing tool isolation, and movement similarity assessment. MediaPipe is employed for hand skeleton analysis, interpreting the pen-holding postures of both the instructor and the learner. A dual-phase strategy is employed to isolate drawing tools. You Only Look Once (YOLO) v5 performs precise object detection to locate the drawing tool within the image, and U-Net is then used to separate the tool from the surrounding area in the identified region. Movement similarity is assessed using dynamic time warping and Procrustes-aligned mean per-joint position error, comparing the hand movements of the instructor and learner. This drawing assistant system is designed to effectively replicate the instructor’s role in online environments, focusing on improving learning outcomes and experiences through interactivity and personalization. Experimental evaluation confirms the system’s effectiveness and usability. Results demonstrate that the system provides accurate and timely feedback and assessment for online drawing instruction, thereby enhancing learners’ drawing skills and learning experiences.

Corresponding author: Chi-Sheng Huang


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Chiao-Wen Kao, Wen-Hsuan Wu, and Chi-Sheng Huang, AI-powered Personalized Online Drawing Assistant with Hand Skeleton Analysis, Sens. Mater., Vol. 37, No. 3, 2025, p. 801-819.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Novel Sensors, Materials, and Related Technologies on Artificial Intelligence of Things Applications
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)
Call for paper


Special Issue on Advanced Sensing Technologies for Green Energy
Guest editor, Yong Zhu (Griffith University)
Call for paper


Special Issue on Room-temperature-operation Solid-state Radiation Detectors
Guest editor, Toru Aoki (Shizuoka University)
Call for paper


Special Issue on International Conference on Biosensors, Bioelectronics, Biomedical Devices, BioMEMS/NEMS and Applications 2023 (Bio4Apps 2023)
Guest editor, Dzung Viet Dao (Griffith University) and Cong Thanh Nguyen (Griffith University)
Conference website
Call for paper


Special Issue on Signal Collection, Processing, and System Integration in Automation Applications
Guest editor, Hsiung-Cheng Lin (National Chin-Yi University of Technology)
Call for paper


Special Issue on Artificial Intelligence Predication and Application for Energy-saving Smart Manufacturing System
Guest editor, Cheng-Chi Wang (National Sun Yat-sen University)
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.