Young Researcher Paper Award 2021
🥇Winners

Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 34, Number 1(2) (2022)
Copyright(C) MYU K.K.
pp. 203-216
S&M2804 Research Paper of Special Issue
https://doi.org/10.18494/SAM3557
Published: January 27, 2022

RGB-D Depth-sensor-based Hand Gesture Recognition Using Deep Learning of Depth Images with Shadow Effect Removal for Smart Gesture Communication [PDF]

Ing-Jr Ding and Nai-Wei Zheng

(Received May 26, 2021; Accepted November 25, 2021)

Keywords: RGB-D depth sensor, shadow effect, serial binary image extraction, deep learning, hand gesture recognition

Recently, compound image sensor devices have been widely used to construct many next-generation human–machine interaction applications, including hand gesture action recognition. Such devices, generally known as RGB-D devices, contain an RGB color camera and a depth sensor set. The depth sensor in RGB-D devices is essentially a set of a specific type of sensor and comprises one IR projector and one IR camera. This structure of the depth sensor inevitably generates an undesired shadow effect, adversely affecting hand gesture recognition. To tackle this issue and alleviate the shadow effect on hand gesture recognition, we have developed a serial binary image extraction approach. The proposed approach is essentially composed of two consecutive computation phases, phase-1 and phase-2 binary image extraction. In this work, the Kinect compound sensor device is employed to capture hand gesture depth images. The deep learning model, a visual geometry group (VGG)-type convolutional neural network (CNN), i.e., the well-known VGG-CNN, is utilized to evaluate the recognition effectiveness of improved hand gesture depth images derived from serial binary image extraction. Ten hand gestures that are common in daily life are chosen to evaluate depth-sensor-based interactive action recognition. Experimental results show that the proposed serial binary image extraction can effectively eliminate the undesired shadow region in hand gesture depth images and significantly improve the recognition accuracy of VGG-type CNN hand gesture recognition. The proposed depth-sensor-based hand gesture recognition approach can benefit people requiring interaction action recognition and further promote smart gesture communication.

Corresponding author: Ing-Jr Ding


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Ing-Jr Ding and Nai-Wei Zheng, RGB-D Depth-sensor-based Hand Gesture Recognition Using Deep Learning of Depth Images with Shadow Effect Removal for Smart Gesture Communication, Sens. Mater., Vol. 34, No. 1, 2022, p. 203-216.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Collection, Processing, and Applications of Measured Sensor Signals
Guest editor, Hsiung-Cheng Lin (National Chin-Yi University of Technology)


Special Issue on Advanced Materials and Sensing Technologies on IoT Applications: Part 4-3
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)


Special Issue on IoT Wireless Networked Sensing for Life and Safety
Guest editor, Toshihiro Itoh (The University of Tokyo) and Jian Lu (National Institute of Advanced Industrial Science and Technology)
Call for paper


Special Issue on the International Multi-Conference on Engineering and Technology Innovation 2021 (IMETI2021)
Guest editor, Wen-Hsiang Hsieh (National Formosa University)
Conference website


Special Issue on Biosensors and Biofuel Cells for Smart Community and Smart Life
Guest editor, Seiya Tsujimura (University of Tsukuba), Isao Shitanda (Tokyo University of Science), and Hiroaki Sakamoto (University of Fukui)
Call for paper


Special Issue on Novel Sensors and Related Technologies on IoT Applications: Part 1
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.