|
pp. 965-983
S&M4358 Research paper https://doi.org/10.18494/SAM5799 Published: February 27, 2026 Teaching Traditional Embroidery Using Digital Immersive Tool Based on Augmented Reality and Sensor-based Recognition [PDF] Xuehong Zhao, Mingyu Zhao, and Hailing Wang (Received June 5, 2025; Accepted February 24, 2026) Keywords: AR, Kinect/Leap Motion sensor, sensor fusion, embroidery, intangible cultural heritage
In this study, we introduced an augmented reality and deep-learning-based system for the digital preservation and interactive learning of traditional embroidery skills. Recognizing the vulnerability of traditions in preserving intricate intangible cultural heritage, this system integrates multisource data from Kinect, Leap Motion, inertial measurement units, and force-sensitive resistor sensors to capture precise embroidery actions. An extended Kalman filter is employed for robust multisensor data fusion and accurate motion trajectory estimation. The system was developed on the basis of a combined graph convolutional network–long short-term memory model, which showed a 95% accuracy in recognizing diverse needlework techniques by effectively capturing both spatial and temporal features of embroidery movements. This real-time recognition ability in an immersive augmented reality interface provides learners with dynamic visual guidance, step-by-step instructions, and performance feedback. The system overcomes the limitations of traditional preservation methods and offers a scalable, interactive, and effective platform for the transmission and documentation of traditional craftsmanship.
Corresponding author: Mingyu Zhao![]() ![]() This work is licensed under a Creative Commons Attribution 4.0 International License. Cite this article Xuehong Zhao, Mingyu Zhao, and Hailing Wang, Teaching Traditional Embroidery Using Digital Immersive Tool Based on Augmented Reality and Sensor-based Recognition, Sens. Mater., Vol. 38, No. 2, 2026, p. 965-983. |