pp. 1061-1067
S&M1399 Research Paper of Special Issue https://doi.org/10.18494/SAM.2017.1594 Published: July 26, 2017 Haptic Telepresence System for Individuals with Visual Impairments [PDF] Yeongil Ryu and Eun-Seok Ryu (Received April 1, 2016; Accepted May 15, 2017) Keywords: haptic telepresence, individuals with visual impairments, video streaming
In this paper, we propose a new haptic telepresence system for individuals with visual impairments (VIs) using a red-green-blue-depth (RGB-D) sensor and a haptic device. Recent improvements in RGB-D sensors have enabled real-time access to 3D spatial information. However, the real-time representation of the tangible haptic experience has not been sufficiently challenged. Thus, the proposed system addresses the telepresence of remote 3D information using an RGB-D sensor through video encoding and 3D depth-map enhancement. In the implemented system, the Kinect sensor from Microsoft is an RGB-D sensor that provides depth and 2D color images at a rate of approximately 30 fps. The Kinect depth data frame is buffered, projected into a 3D coordinate system with a resolution of 640 × 480 pixels, and then is transformed into a 3D map. To verify the benefits of the proposed video content adaptation method for individuals with VIs, in this study, we implemented a ‘2D plus depth map’-based haptic telepresence system; it conducts user experience experiments and presents the results of user response time.
Corresponding author: Eun-Seok RyuCite this article Yeongil Ryu and Eun-Seok Ryu, Haptic Telepresence System for Individuals with Visual Impairments, Sens. Mater., Vol. 29, No. 7, 2017, p. 1061-1067. |