Young Researcher Paper Award 2023
🥇Winners

Notice of retraction
Vol. 34, No. 8(3), S&M3042

Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 34, Number 5(4) (2022)
Copyright(C) MYU K.K.
pp. 2001-2006
S&M2949 Research Paper of Special Issue
https://doi.org/10.18494/SAM3773
Published: May 31, 2022

Picture-to-text Translation-based Assistive Communication System for People with Autism Spectrum Disorder [PDF]

Yeou-Jiunn Chen

(Received December 5, 2021; Accepted February 15, 2022)

Keywords: assistive communication system, word prediction, picture-to-text translation, autism spectrum disorder

People with autism spectrum disorder (ASD) have different degrees of communication disorder, reducing the quality of their daily lives. Therefore, an assistive communication system could effectively help people with ASD to communicate with other people or with devices. In this study, an assistive communication system with word prediction and picture-to-text conversion is proposed to help people with ASD. To help them use the system, touch sensors are adopted at the operating interfaces. To overcome the problem of the limited number of items that can be displayed by the operating interfaces, recurrent neural networks are adopted to predict the next input picture. To help people understand the meaning of the picture sequences inputted by people with ASD, a picture-to-text translation system, which is based on bidirectional encoder representations from transformers (BERTs), is integrated to convert picture sequences to sentences. Experimental results showed that the proposed assistive communication system can effectively predict the next picture and exactly convert picture sequences to sentences. Thus, the proposed system can effectively help people with ASD communicate with others.

Corresponding author: Yeou-Jiunn Chen


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Yeou-Jiunn Chen, Picture-to-text Translation-based Assistive Communication System for People with Autism Spectrum Disorder, Sens. Mater., Vol. 34, No. 5, 2022, p. 2001-2006.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Applications of Novel Sensors and Related Technologies for Internet of Things
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)
Call for paper


Special Issue on Advanced Sensing Technologies for Green Energy
Guest editor, Yong Zhu (Griffith University)
Call for paper


Special Issue on Room-temperature-operation Solid-state Radiation Detectors
Guest editor, Toru Aoki (Shizuoka University)
Call for paper


Special Issue on International Conference on Biosensors, Bioelectronics, Biomedical Devices, BioMEMS/NEMS and Applications 2023 (Bio4Apps 2023)
Guest editor, Dzung Viet Dao (Griffith University) and Cong Thanh Nguyen (Griffith University)
Conference website
Call for paper


Special Issue on Advanced Sensing Technologies and Their Applications in Human/Animal Activity Recognition and Behavior Understanding
Guest editor, Kaori Fujinami (Tokyo University of Agriculture and Technology)
Call for paper


Special Issue on Piezoelectric Thin Films and Piezoelectric MEMS
Guest editor, Isaku Kanno (Kobe University)
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.