Cluster Haptic Texture Database: Haptic Texture Database with Variety in Velocity and Direction of Sliding Contacts (2407.16206v1)
Abstract: Human perception integrates multisensory information, with tactile perception playing a key role in object and surface recognition. While human-machine interfaces with haptic modalities offer enhanced system performance, existing datasets focus primarily on visual data, overlooking comprehensive haptic information. Previous haptic texture databases have recorded sound and acceleration signals, but often ignore the nuanced differences between probe-texture and finger-texture interactions. Recognizing this shortcoming, we present the Cluster Haptic Texture Database, a multimodal dataset that records visual, auditory, and haptic signals from an artificial urethane rubber fingertip interacting with different textured surfaces. This database, designed to mimic the properties of the human finger, includes five velocity levels and eight directional variations, providing a comprehensive study of tactile interactions. Our evaluations reveal the effectiveness of classifiers trained on this dataset in identifying surfaces, and the subtleties of estimating velocity and direction for each surface.
- S. J. Lederman and R. L. Klatzky, “Haptic perception: A tutorial,” Attention, Perception & Psychophysics, vol. 71, no. 7, pp. 1439–1459, Oct. 2009.
- A. El Saddik, “The potential of haptics technologies,” IEEE Instrumentation & Measurement Magazine, vol. 10, no. 1, pp. 10–17, Feb. 2007.
- R. Picard, C. Graczyk, S. Mann, J. Wachman, L. Picard, and L. Campbell, “VisTex: Vision texture database,” 1995.
- J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in Proceedings of 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009, pp. 248–255.
- H. Culbertson, J. Unwin, B. E. Goodman, and K. J. Kuchenbecker, “Generating haptic texture models from unconstrained tool-surface interactions,” in Proceedings of 2013 World Haptics Conference (WHC), Apr. 2013, pp. 295–300.
- H. Culbertson, J. J. Lopez Delgado, and K. J. Kuchenbecker, “One hundred data-driven haptic texture models and open-source methods for rendering on 3D objects,” in Proceedings of 2014 IEEE Haptics Symposium (HAPTICS), Feb. 2014, pp. 319–325.
- M. Strese, J.-Y. Lee, C. Schuwerk, Q. Han, H.-G. Kim, and E. Steinbach, “A haptic texture database for tool-mediated texture recognition and classification,” in Proceedings of 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE), Oct. 2014, pp. 118–123.
- H. Zheng, L. Fang, M. Ji, M. Strese, Y. Ozer, and E. Steinbach, “Deep learning for surface material classification using haptic and visual information,” IEEE Transactions on Multimedia, vol. 18, no. 12, pp. 2407–2416, Dec. 2016.
- M. Strese, Y. Boeck, and E. Steinbach, “Content-based surface material retrieval,” in Proceedings of 2017 IEEE World Haptics Conference (WHC), Jun. 2017, pp. 352–357.
- A. Burka, S. Hu, S. Helgeson, S. Krishnan, Y. Gao, L. A. Hendricks, T. Darrell, and K. J. Kuchenbecker, “Proton: A visuo-haptic data acquisition system for robotic learning of surface properties,” in Proceedings of 2016 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI), 2016, pp. 58–65.
- T. Yoshioka, S. J. Bensmaïa, J. C. Craig, and S. S. Hsiao, “Texture perception through direct and indirect touch: an analysis of perceptual space for tactile textures in two modes of exploration,” Somatosensory & Motor Research, vol. 24, no. 1-2, pp. 53–70, 2007.
- R. L. Klatzky and S. J. Lederman, “Tactile roughness perception with a rigid link interposed between skin and surface,” Perception & Psychophysics, vol. 61, no. 4, pp. 591–607, May 1999.
- M. Wiertlewski, C. Hudin, and V. Hayward, “On the 1/f noise and non-integer harmonic decay of the interaction of a finger sliding on flat and sinusoidal surfaces,” in Proceedings of 2011 IEEE World Haptics Conference (WHC), Jun. 2011, pp. 25–30.
- J. Platkiewicz, A. Mansutti, M. Bordegoni, and V. Hayward, “Recording device for natural haptic textures felt with the bare fingertip,” in Haptics: Neuroscience, Devices, Modeling, and Applications (Proceedings of 2014 EuroHaptics Conference). Springer, 2014, pp. 521–528.
- Y. Tanaka, Y. Horita, and A. Sano, “Finger-Mounted skin vibration sensor for active touch,” in Haptics: Perception, Devices, Mobility, and Communication (Proceedings of 2012 EuroHaptics Conference). Springer, 2012, pp. 169–174.
- L. P. Kirsch, X. E. Job, M. Auvray, and V. Hayward, “Harnessing tactile waves to measure skin-to-skin interactions,” Behavior Research Methods, vol. 53, no. 4, pp. 1469–1477, Aug. 2021.
- J. Jiao, Y. Zhang, D. Wang, X. Guo, and X. Sun, “HapTex: A database of fabric textures for surface tactile display,” in Proceedings of 2019 IEEE World Haptics Conference (WHC), 2019, pp. 331–336.
- A. Devillard, A. Ramasamy, D. Faux, V. Hayward, and E. Burdet, “Concurrent haptic, audio, and visual data set during bare finger interaction with textured surfaces,” in Proceedings of 2023 IEEE World Haptics Conference (WHC), 2023, pp. 101–106.
- K. Kuramitsu, T. Nomura, S. Nomura, T. Maeno, and Y. Nonomura, “Friction evaluation system with a human finger model,” Chemistry Letters, vol. 42, no. 3, pp. 284–285, Mar. 2013.
- M. Kouchi, N. Miyata, and M. Mochimaru, “An analysis of hand measurements for obtaining representative japanese hand models,” in SAE Technical Paper, no. 2005-01-2734, Jun. 2005, pp. 1–7.
- Artificial Intelligence Research Center, AIST, “AIST japanese hand dimension data,” https://www.airc.aist.go.jp/dhrt/hand/data/list.html, accessed: 2023-9-25.
- M. Strese, L. Brudermueller, J. Kirsch, and E. Steinbach, “Haptic material analysis and classification inspired by human exploratory procedures,” IEEE Transactions on Haptics, vol. 13, no. 2, pp. 404–424, 2020.
- A. Isleyen, Y. Vardar, and C. Basdogan, “Tactile roughness perception of virtual gratings by electrovibration,” IEEE Transactions on Haptics, vol. 13, no. 3, pp. 562–570, 2020.
- Y. Vardar, A. Isleyen, M. K. Saleem, and C. Basdogan, “Roughness perception of virtual textures displayed by electrovibration on touch screens,” in Proceedings of 2017 IEEE World Haptics Conference (WHC), Jun. 2017, pp. 263–268.
- D. J. Meyer, M. Wiertlewski, M. A. Peshkin, and J. E. Colgate, “Dynamics of ultrasonic and electrostatic friction modulation for rendering texture on haptic surfaces,” in Proceedings of 2014 IEEE Haptics Symposium (HAPTICS), Feb. 2014, pp. 63–67.
- B. Vimal, M. Surya, Darshan, V. S. Sridhar, and A. Ashok, “MFCC based audio classification using machine learning,” in Proceedings of 12th International Conference on Computing Communication and Networking Technologies (ICCCNT). IEEE, Jul. 2021, pp. 1–4.
- F. Rong, “Audio classification method based on machine learning,” in Proceedings of 2016 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Dec. 2016, pp. 81–84.
- K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Dec. 2015, pp. 770–778.
- S. Cai, L. Zhao, Y. Ban, T. Narumi, Y. Liu, and K. Zhu, “GAN-based image-to-friction generation for tactile simulation of fabric material,” Computers & Graphics, vol. 102, pp. 460–473, Feb. 2022.
- R. Song, X. Sun, and G. Liu, “Cross-Modal generation of tactile friction coefficient from audio and visual measurements by transformer,” IEEE Transactions on Instrumentation and Measurement, 2023.
- O. Bau, I. Poupyrev, A. Israr, and C. Harrison, “TeslaTouch: electrovibration for touch surfaces,” in Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology (UIST), Oct. 2010, pp. 283–292.
- Y. Miyatake, T. Hiraki, D. Iwai, and K. Sato, “HaptoMapping: Visuo-haptic augmented reality by embedding user-imperceptible tactile display control signals in a projected image,” IEEE Transactions on Visualization and Computer Graphics, vol. 29, no. 4, pp. 2005–2019, Apr. 2023.
- M. Ito, R. Sakuma, H. Ishizuka, and T. Hiraki, “AirHaptics: Vibrotactile presentation method using an airflow from audio speakers of smart devices,” in Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (VRST), no. Article 39, Nov. 2022, pp. 1–2.