Noncontact Haptic Rendering of Static Contact with Convex Surface Using Circular Movement of Ultrasound Focus on a Finger Pad (2301.11572v2)
Abstract: A noncontact tactile stimulus can be presented by focusing airborne ultrasound on the human skin. Focused ultrasound has recently been reported to produce not only vibration but also static pressure sensation on the palm by modulating the sound pressure distribution at a low frequency. This finding expands the potential for tactile rendering in ultrasound haptics as static pressure sensation is perceived with a high spatial resolution. In this study, we verified that focused ultrasound can render a static pressure sensation associated with contact with a small convex surface on a finger pad. This static contact rendering enables noncontact tactile reproduction of a fine uneven surface using ultrasound. In the experiments, four ultrasound foci were simultaneously and circularly rotated on a finger pad at 5 Hz. When the orbit radius was 3 mm, vibration and focal movements were barely perceptible, and the stimulus was perceived as static pressure. Moreover, under the condition, the pressure sensation rendered a contact with a small convex surface with a radius of 2 mm. The perceived intensity of the static contact sensation was equivalent to a physical contact force of 0.24 N on average, which was 12 times the radiation force physically applied to the skin.
- I. Rakkolainen, E. Freeman, A. Sand, R. Raisamo, and S. Brewster, “A survey of mid-air ultrasound haptics and its applications,” IEEE Transactions on Haptics, vol. 14, no. 1, pp. 2–19, 2020.
- T. Hoshi, M. Takahashi, T. Iwamoto, and H. Shinoda, “Noncontact tactile display based on radiation pressure of airborne ultrasound,” IEEE Transactions on Haptics, vol. 3, no. 3, pp. 155–165, 2010.
- T. Carter, S. A. Seah, B. Long, B. Drinkwater, and S. Subramanian, “Ultrahaptics: multi-point mid-air haptic feedback for touch surfaces,” in Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 2013, pp. 505–514.
- K. Yosioka and Y. Kawasima, “Acoustic radiation pressure on a compressible sphere,” Acta Acustica united with Acustica, vol. 5, no. 3, pp. 167–173, 1955.
- G. Wilson, T. Carter, S. Subramanian, and S. A. Brewster, “Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion,” in Proceedings of the SIGCHI conference on human factors in computing systems, 2014, pp. 1133–1142.
- S. Suzuki, M. Fujiwara, Y. Makino, and H. Shinoda, “Midair hand guidance by an ultrasound virtual handrail,” in Proceedings of 2019 IEEE World Haptics Conference (WHC). IEEE, 2019, pp. 271–276.
- A. Yoshimoto, K. Hasegawa, Y. Makino, and H. Shinoda, “Midair haptic pursuit,” IEEE Transactions on Haptics, vol. 12, no. 4, pp. 652–657, 2019.
- E. Freeman, D.-B. Vo, and S. Brewster, “Haptiglow: Helping users position their hands for better mid-air gestures and ultrasound haptic feedback,” in Proceedings of 2019 IEEE World Haptics Conference (WHC). IEEE, 2019, pp. 289–294.
- Y. Monnai, K. Hasegawa, M. Fujiwara, K. Yoshino, S. Inoue, and H. Shinoda, “Haptomime: mid-air haptic interaction with a floating virtual screen,” in Proceedings of the 27th annual ACM symposium on User interface software and technology, 2014, pp. 663–667.
- T. Romanus, S. Frish, M. Maksymenko, W. Frier, L. Corenthy, and O. Georgiou, “Mid-air haptic bio-holograms in mixed reality,” in Proceedings of 2019 IEEE international symposium on mixed and augmented reality adjunct (ISMAR-Adjunct). IEEE, 2019, pp. 348–352.
- T. Morisaki, M. Fujiwara, Y. Makino, and H. Shinoda, “Midair haptic-optic display with multi-tactile texture based on presenting vibration and pressure sensation by ultrasound,” in Proceedings of SIGGRAPH Asia 2021 Emerging Technologies, 2021, pp. 1–2.
- Y. Makino, Y. Furuyama, S. Inoue, and H. Shinoda, “Haptoclone (haptic-optical clone) for mutual tele-environment by real-time 3d image transfer with midair force feedback.” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2016, pp. 1980–1990.
- S. Rümelin, T. Gabler, and J. Bellenbaum, “Clicks are in the air: how to support the interaction with floating objects through ultrasonic feedback,” in Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications, 2017, pp. 103–108.
- O. Georgiou, V. Biscione, A. Harwood, D. Griffiths, M. Giordano, B. Long, and T. Carter, “Haptic in-vehicle gesture controls,” in Proceedings of the 9th international conference on automotive user interfaces and interactive vehicular applications adjunct, 2017, pp. 233–238.
- G. Young, H. Milne, D. Griffiths, E. Padfield, R. Blenkinsopp, and O. Georgiou, “Designing mid-air haptic gesture controlled user interfaces for cars,” Proceedings of the ACM on human-computer interaction, vol. 4, no. EICS, pp. 1–23, 2020.
- G. Korres, S. Chehabeddine, and M. Eid, “Mid-air tactile feedback co-located with virtual touchscreen improves dual-task performance,” IEEE Transactions on Haptics, vol. 13, no. 4, pp. 825–830, 2020.
- T. Morisaki, M. Fujiwara, Y. Makino, and H. Shinoda, “Non-vibratory pressure sensation produced by ultrasound focus moving laterally and repetitively with fine spatial step width,” IEEE Transactions on Haptics, vol. 15, no. 2, pp. 441–450, 2021.
- R. S. Johansson and Å. B. Vallbo, “Tactile sensory coding in the glabrous skin of the human hand,” Trends in neurosciences, vol. 6, pp. 27–32, 1983.
- S. J. Bolanowski Jr, G. A. Gescheider, R. T. Verrillo, and C. M. Checkosky, “Four channels mediate the mechanical aspects of touch,” The Journal of the Acoustical society of America, vol. 84, no. 5, pp. 1680–1694, 1988.
- K. Hasegawa and H. Shinoda, “Aerial vibrotactile display based on multiunit ultrasound phased array,” IEEE Transactions on Haptics, vol. 11, no. 3, pp. 367–377, 2018.
- R. Takahashi, K. Hasegawa, and H. Shinoda, “Tactile stimulation by repetitive lateral movement of midair ultrasound focus,” IEEE Transactions on Haptics, vol. 13, no. 2, pp. 334–342, 2019.
- W. Frier, D. Ablart, J. Chilles, B. Long, M. Giordano, M. Obrist, and S. Subramanian, “Using spatiotemporal modulation to draw tactile patterns in mid-air,” in Proceedings of International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 2018, pp. 270–281.
- T. Howard, G. Gallagher, A. Lécuyer, C. Pacchierotti, and M. Marchal, “Investigating the recognition of local shapes using mid-air ultrasound haptics,” in Proceedings of 2019 IEEE World Haptics Conference (WHC). IEEE, 2019, pp. 503–508.
- Z. Somei, T. Morisaki, Y. Toide, M. Fujiwara, Y. Makino, and H. Shinoda, “Spatial resolution of mesoscopic shapes presented by airborne ultrasound,” in Proceedings of International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 2022, pp. 243–251.
- R. Takahashi, K. Hasegawa, and H. Shinoda, “Lateral modulation of midair ultrasound focus for intensified vibrotactile stimuli,” in Proceedings of International Conference on Human Haptic Sensing and Touch Enabled Computer Applications. Springer, 2018, pp. 276–288.
- W. Frier, D. Pittera, D. Ablart, M. Obrist, and S. Subramanian, “Sampling strategy for ultrasonic mid-air haptics,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–11.
- M. Konyo, S. Tadokoro, A. Yoshida, and N. Saiwaki, “A tactile synthesis method using multiple frequency vibrations for representing virtual touch,” in Proceedings of 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems. IEEE, 2005, pp. 3965–3971.
- G. Korres and M. Eid, “Haptogram: Ultrasonic point-cloud tactile stimulation,” IEEE Access, vol. 4, pp. 7758–7769, 2016.
- I. Rutten, W. Frier, L. Van den Bogaert, and D. Geerts, “Invisible touch: How identifiable are mid-air haptic shapes?” in Extended abstracts of the 2019 CHI conference on human factors in computing systems, 2019, pp. 1–6.
- P. Marti, O. Parlangeli, A. Recupero, S. Guidi, and M. Sirizzotti, “Mid-air haptics for shape recognition of virtual objects,” Ergonomics, vol. 65, no. 5, pp. 1–19, 2021.
- D. Hajas, D. Pittera, A. Nasce, O. Georgiou, and M. Obrist, “Mid-air haptic rendering of 2d geometric shapes with a dynamic tactile pointer,” IEEE Transactions on Haptics, vol. 13, no. 4, pp. 806–817, 2020.
- L. Mulot, G. Gicquel, Q. Zanini, W. Frier, M. Marchal, C. Pacchierotti, and T. Howard, “Dolphin: A framework for the design and perceptual evaluation of ultrasound mid-air haptic stimuli,” in Proceedings of ACM Symposium on Applied Perception 2021, 2021, pp. 1–10.
- L. Mulot, G. Gicquel, W. Frier, M. Marchal, C. Pacchierotti, and T. Howard, “Curvature discrimination for dynamic ultrasound mid-air haptic stimuli,” in Proceedings of 2021 IEEE World Haptics Conference (WHC). IEEE, 2021, pp. 1145–1145.
- S. Inoue, Y. Makino, and H. Shinoda, “Active touch perception produced by airborne ultrasonic haptic hologram,” in Proceedings of 2015 IEEE World Haptics Conference (WHC). IEEE, 2015, pp. 362–367.
- B. Long, S. A. Seah, T. Carter, and S. Subramanian, “Rendering volumetric haptic shapes in mid-air using ultrasound,” ACM Transactions on Graphics (TOG), vol. 33, no. 6, pp. 1–10, 2014.
- A. Matsubayashi, Y. Makino, and H. Shinoda, “Direct finger manipulation of 3d object image with ultrasound haptic feedback,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–11.
- A. Matsubayashi, H. Oikawa, S. Mizutani, Y. Makino, and H. Shinoda, “Display of haptic shape using ultrasound pressure distribution forming cross-sectional shape,” in Proceedings of 2019 IEEE World Haptics Conference. IEEE, 2019, pp. 419–424.
- D. M. Plasencia, R. Hirayama, R. Montano-Murillo, and S. Subramanian, “Gs-pat: high-speed multi-point sound-fields for phased arrays of transducers,” ACM Transactions on Graphics (TOG), vol. 39, no. 4, pp. 138–1, 2020.
- Z. Shen, M. K. Vasudevan, J. Kučera, M. Obrist, and D. Martinez Plasencia, “Multi-point stm: Effects of drawing speed and number of focal points on users’ responses using ultrasonic mid-air haptics,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023, pp. 1–11.
- S. Suzuki, S. Inoue, M. Fujiwara, Y. Makino, and H. Shinoda, “Autd3: Scalable airborne ultrasound tactile display,” IEEE Transactions on Haptics, vol. 14, no. 4, pp. 740–749, 2021.
- N. I. of Advanced Industrial Science and Technology, “Icam: Identification code of anthropometric measurements,” 2011, https://www.airc.aist.go.jp/dhrt/hand/data/list.html.
- J. P. Nafe and K. S. Wagoner, “The nature of sensory adaptation,” The Journal of General Psychology, vol. 25, no. 2, pp. 295–321, 1941.
- A. Iggo and A. R. Muir, “The structure and function of a slowly adapting touch corpuscle in hairy skin,” The Journal of Physiology, vol. 200, no. 3, p. 763, 1969.
- A. B. Vallbo, R. S. Johansson et al., “Properties of cutaneous mechanoreceptors in the human hand related to touch sensation,” Hum neurobiol, vol. 3, no. 1, pp. 3–14, 1984.
- A. Goodwin, K. John, and A. Marceglia, “Tactile discrimination of curvature by humans using only cutaneous information from the fingerpads,” Experimental brain research, vol. 86, no. 3, pp. 663–672, 1991.
- J. Chilles, W. Frier, A. Abdouni, M. Giordano, and O. Georgiou, “Laser doppler vibrometry and fem simulations of ultrasonic mid-air haptics,” in Proceedings of 2019 IEEE World Haptics Conference (WHC). IEEE, 2019, pp. 259–264.
- W. Frier, A. Abdouni, D. Pittera, O. Georgiou, and R. Malkin, “Simulating airborne ultrasound vibrations in human skin for haptic applications,” IEEE Access, vol. 10, pp. 15 443–15 456, 2022.
- E. Freeman and G. Wilson, “Perception of ultrasound haptic focal point motion,” in Proceedings of the 2021 International Conference on Multimodal Interaction, 2021, pp. 697–701.
- R. Onishi, T. Kamigaki, S. Suzuki, T. Morisaki, M. Fujiwara, Y. Makino, and H. Shinoda, “Two-dimensional measurement of airborne ultrasound field using thermal images,” Physical Review Applied, vol. 18, no. 4, p. 044047, 2022.
- S. Suzuki, M. Fujiwara, Y. Makino, and H. Shinoda, “Reducing amplitude fluctuation by gradual phase shift in midair ultrasound haptics,” IEEE Transactions on Haptics, vol. 13, no. 1, pp. 87–93, 2020.