|
pp. 1365-1381
S&M4382 Technical paper https://doi.org/10.18494/SAM6090 Published: March 17, 2026 Task Time Estimation Based on Action Classification in Dyeing Processes Using Video Data [PDF] Kazuma Sakamoto, Fuya Shibata, Iori Iwata, Aki Mimura, and Yoshihiro Ueda (Received December 1, 2025; Accepted February 13, 2026) Keywords: VGG16, ST-GCN, two-stage model, classification, task time estimation
In this research, we developed a two-stage model that integrates first-person video and third-person skeletal information to perform task classification and task time estimation in a textile dyeing process. In the first stage, Visual Geometry Group 16 (VGG16) recognizes task-related objects, whereas in the second stage, Spatial Temporal Graph Convolutional Network (ST-GCN) classifies detailed task actions. Through the incorporation of additional training data for the latter stage, we have attained enhanced classification accuracy across all categories, with particularly noteworthy advancements observed in tasks characterized by ambiguous boundaries. Furthermore, by automatically detecting task start and end points from the predicted action label sequences, we estimated task durations and confirmed reductions in estimation error through noncontact sensing using cameras as optical sensors combined with advanced action recognition technologies. Moreover, by calculating the mean and standard deviation of task durations for each task, we were able to evaluate process bottlenecks and the stability of each task. The proposed method demonstrates the feasibility of achieving task analysis and time estimation through noncontact, camera-based measurement without disrupting on-site operations. This approach offers a promising framework for facilitating process optimization and task standardization in manufacturing environments.
Corresponding author: Kazuma Sakamoto![]() ![]() This work is licensed under a Creative Commons Attribution 4.0 International License. Cite this article Kazuma Sakamoto, Fuya Shibata, Iori Iwata, Aki Mimura, and Yoshihiro Ueda, Task Time Estimation Based on Action Classification in Dyeing Processes Using Video Data , Sens. Mater., Vol. 38, No. 3, 2026, p. 1365-1381. |