Young Researcher Paper Award 2021
🥇Winners

Notice of retraction
Vol. 32, No. 8(2), S&M2292

Print: ISSN 0914-4935
Online: ISSN 2435-0869
Sensors and Materials
is an international peer-reviewed open access journal to provide a forum for researchers working in multidisciplinary fields of sensing technology.
Sensors and Materials
is covered by Science Citation Index Expanded (Clarivate Analytics), Scopus (Elsevier), and other databases.

Instructions to authors
English    日本語

Instructions for manuscript preparation
English    日本語

Template
English

Publisher
 MYU K.K.
 Sensors and Materials
 1-23-3-303 Sendagi,
 Bunkyo-ku, Tokyo 113-0022, Japan
 Tel: 81-3-3827-8549
 Fax: 81-3-3827-8547

MYU Research, a scientific publisher, seeks a native English-speaking proofreader with a scientific background. B.Sc. or higher degree is desirable. In-office position; work hours negotiable. Call 03-3827-8549 for further information.


MYU Research

(proofreading and recording)


MYU K.K.
(translation service)


The Art of Writing Scientific Papers

(How to write scientific papers)
(Japanese Only)

Sensors and Materials, Volume 34, Number 8(1) (2022)
Copyright(C) MYU K.K.
pp. 3017-3027
S&M3020 Research Paper of Special Issue
https://doi.org/10.18494/SAM3959
Published: August 2, 2022

Quantitative Evaluation System for Online Meetings Based on Multimodal Microbehavior Analysis [PDF]

Chenhao Chen, Yutaka Arakawa, Ko Watanabe, and Shoya Ishimaru

(Received May 2, 2022; Accepted July 4, 2022)

Keywords: online meeting, neural network, smile detection, head pose estimation, active speaker detection

Maintaining a positive interaction is the key to a healthy and efficient meeting. Aiming to improve the quality of online meetings, we present an end-to-end neural-network-based system, named MeetingPipe, which is capable of quantitative microbehavior detection (smiling, nodding, and speaking) from recorded meeting videos. For smile detection, we build a neural network framework that consists of an 18-layer residual network for feature representation, and a self-attention layer to explore the correlation between each receptive field. To perform nodding detection, we obtain head rotation data as the key nodding feature. Then we use a gated recurrent unit followed by a squeeze-and-excitation mechanism to capture the temporal information of nodding patterns from head pitch angles. In addition, we utilize TalkNet, an active speaker detection model, which can effectively recognize active speakers from videos. Experiments demonstrate that with K-fold cross validation, the F1 scores of the smile, nodding, and speaking detection are 97.34, 81.26, and 94.90%, respectively. The processing can be accelerated with multiple GPUs due to the multithread design. The code is available at https://github.com/humanophilic/MeetingPipe.

Corresponding author: Chenhao Chen


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

Cite this article
Chenhao Chen, Yutaka Arakawa, Ko Watanabe, and Shoya Ishimaru, Quantitative Evaluation System for Online Meetings Based on Multimodal Microbehavior Analysis, Sens. Mater., Vol. 34, No. 8, 2022, p. 3017-3027.



Forthcoming Regular Issues


Forthcoming Special Issues

Special Issue on Biosensors and Biofuel Cells for Smart Community and Smart Life
Guest editor, Seiya Tsujimura (University of Tsukuba), Isao Shitanda (Tokyo University of Science), and Hiroaki Sakamoto (University of Fukui)


Special Issue on the International Multi-Conference on Engineering and Technology Innovation 2021 (IMETI2021)
Guest editor, Wen-Hsiang Hsieh (National Formosa University)
Conference website


Special Issue on Novel Sensors and Related Technologies on IoT Applications: Part 1-2
Guest editor, Teen-Hang Meen (National Formosa University), Wenbing Zhao (Cleveland State University), and Cheng-Fu Yang (National University of Kaohsiung)
Call for paper


Special Issue on Advanced Micro/Nanomaterials for Various Sensor Applications (Selected Papers from ICASI 2021)
Guest editor, Sheng-Joue Young (National United University), Shoou-Jinn Chang (National Cheng Kung University), Liang-Wen Ji (National Formosa University), and Yu-Jen Hsiao (Southern Taiwan University of Science and Technology)
Conference website
Call for paper


Special Issue on Advanced Technologies for Remote Sensing and Geospatial Analysis: Part 3
Guest editor, Dong Ha Lee (Kangwon National University) and Myeong Hun Jeong (Chosun University)
Call for paper


Special Issue on APCOT 2022
Guest editor, Yuelin Wang, Tie Li (Shanghai Institute of Microsystem and Information Technology) and Qingan Huang (Southeast University)
Conference website
Call for paper


Copyright(C) MYU K.K. All Rights Reserved.