Young Researcher Paper Award 2025
🥇Winners

Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 38, Number 9(4) (2026)
Copyright(C) MYU K.K.
pp. 5503-5522
S&M4635 Report
https://doi.org/10.18494/SAM6284
Published: September 30, 2026

A Semi-supervised Industrial Time Series Anomaly Detection Method Based on Deep Reinforcement Learning [PDF]

Liming Du, Guolin Wang, and Fengying Wang

(Received February 9, 2026; Accepted September 17, 2026)

Keywords: sensor signal processing, industrial time series data, deep reinforcement learning, anomaly detection, semi-supervised learning

Industrial manufacturing systems increasingly rely on large-scale sensor networks to monitor equipment states and production processes. For example, in continuous casting, casting-speed signals are continuously acquired by encoders and transmitted to a programmable logic controller (PLC) or a distributed control system (DCS) through industrial sensing links. These sensor-generated time-series signals provide essential information for intelligent perception and fault diagnosis, yet often lack high-quality annotations. To address this issue, in this paper, we proposed the Industrial Deep Time Series Detection-Q-Network (IDTS-DQN), a semi-supervised deep reinforcement learning algorithm, for anomaly detection in industrial sensing systems. The method integrates deep learning and reinforcement learning through a dual reward mechanism and an anomaly-based experience replay strategy, enabling the agent to learn temporal patterns with limited labeled samples and dynamically improve detection performance. Extensive experiments on real-world industrial datasets demonstrate that IDTS-DQN outperforms baseline methods in recall, precision, and F1-score, providing an adaptive sensing-data analysis approach for industrial monitoring and demonstrating the potential of deep reinforcement learning in sensor-based anomaly perception. However, the framework has been evaluated only offline on historical sensing data, and its applicability to broader signal types and fault modes remains to be examined. Future work will focus on multimodal sensor fusion, edge-based online deployment, and domain-knowledge integration for industrial sensor-signal analysis.

Corresponding author: Fengying Wang


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Liming Du, Guolin Wang, and Fengying Wang, A Semi-supervised Industrial Time Series Anomaly Detection Method Based on Deep Reinforcement Learning, Sens. Mater., Vol. 38, No. 9, 2026, p. 5503-5522.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Signal Collection, Processing, and System Integration in Automation Applications 2026
Guest editor, Hsiung-Cheng Lin (National Chin-Yi University of Technology), Ming-Te Chen (National Chin-Yi University of Technology), and Chin-Yi Cheng (National Yunlin University of Science and Technology)
Call for paper


Special Issue on Converging Smart Materials, Artificial Intelligence, and Quantum Technologies for Intelligent Sensing and Future Electronics
Guest editor, Prof. Wipoo Sriseubsai (King Mongkut’s Institute of Technology Ladkrabang)
Call for paper


Special Issue on Emerging Trends in Advanced Sensor Applications
Guest editor, Shih-Chen Shi (National Cheng Kung University) and Tao-Hsing Chen (National Kaohsiung University of Science and Technology)
Call for paper


Special Issue on Sensing Beyond Transduction: Materials, Devices, and Signal Processing for Intelligent Sensory Systems
Guest editor, Masayuki Sohgawa (Niigata University)
Call for paper


Special Issue on Advanced Materials and Technologies for Sensor and Artificial- Intelligence-of-Things Applications (Selected Papers from ICASI 2026)
Guest editor, Sheng-Joue Young (National Yunlin University of Science and Technology)
Conference website
Call for paper


Special Issue on Biosensing Devices
Guest editor, Kiyotaka Sasagawa (Nara Institute of Science and Technology)
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.