Papers
Topics
Authors
Recent
Search
2000 character limit reached

Designing Distinguishable Mid-Air Ultrasound Tactons with Temporal Parameters

Published 5 May 2024 in cs.HC | (2405.02800v1)

Abstract: Mid-air ultrasound technology offers new design opportunities for contactless tactile patterns (i.e., Tactons) in user applications. Yet, few guidelines exist for making ultrasound Tactons easy to distinguish for users. In this paper, we investigated the distinguishability of temporal parameters of ultrasound Tactons in five studies (n=72 participants). Study 1 established the discrimination thresholds for amplitude-modulated (AM) frequencies. In Studies 2-5, we investigated distinguishable ultrasound Tactons by creating four Tacton sets based on mechanical vibrations in the literature and collected similarity ratings for the ultrasound Tactons. We identified a subset of temporal parameters, such as rhythm and low envelope frequency, that could create distinguishable ultrasound Tactons. Also, a strong correlation (mean Spearman's $\rho$=0.75) existed between similarity ratings for ultrasound Tactons and similarities of mechanical Tactons from the literature, suggesting vibrotactile designers can transfer their knowledge to ultrasound design. We present design guidelines and future directions for creating distinguishable mid-air ultrasound Tactons.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (70)
  1. Vibrotactile Similarity Perception in Crowdsourced and Lab Studies. In Haptics: Science, Technology, Applications: 13th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2022, Hamburg, Germany, May 22–25, 2022, Proceedings. Springer, 255–263.
  2. Stephen A Brewster and Lorna M Brown. 2004. Tactons: structured tactile messages for non-visual information display. (2004).
  3. Augmenting automotive gesture infotainment interfaces through mid-air haptic icon design. In Ultrasound Mid-Air Haptics for Touchless Interfaces. Springer, 119–145.
  4. Ultrahapticons:“Haptifying” drivers’ mental models to transform automotive mid-air haptic gesture infotainment interfaces. In 12th international conference on automotive user interfaces and interactive vehicular applications. 54–57.
  5. A first investigation into the effectiveness of tactons. In First joint eurohaptics conference and symposium on haptic interfaces for virtual environment and teleoperator systems. world haptics conference. IEEE, 167–176.
  6. YH Chan. 2003. Biostatistics 104: correlational analysis. Singapore Med J 44, 12 (2003), 614–619.
  7. Seungmoon Choi and Katherine J Kuchenbecker. 2012. Vibrotactile display: Perception, technology, and applications. Proc. IEEE 101, 9 (2012), 2093–2104.
  8. A user-derived mapping for mid-air haptic experiences. International Journal of Human-Computer Studies 168 (2022), 102920.
  9. Ove Franzén and Jan Nordmark. 1975. Vibrotactile frequency discrimination. Perception & Psychophysics 17 (1975), 480–484.
  10. HaptiGlow: Helping users position their hands for better mid-air gestures and ultrasound haptic feedback. In 2019 IEEE World haptics conference (WHC). IEEE, 289–294.
  11. Euan Freeman and Graham Wilson. 2021. Perception of ultrasound haptic focal point motion. In Proceedings of the 2021 International Conference on Multimodal Interaction. 697–701.
  12. Using spatiotemporal modulation to draw tactile patterns in mid-air. In Haptics: Science, Technology, and Applications: 11th International Conference, EuroHaptics 2018, Pisa, Italy, June 13-16, 2018, Proceedings, Part I 11. Springer, 270–281.
  13. Sampling strategy for ultrasonic mid-air haptics. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–11.
  14. The frequency selectivity of information-processing channels in the tactile sensory system. Somatosensory & Motor Research 18, 3 (2001), 191–201.
  15. George A Gescheider. 2013. Psychophysics: the fundamentals. Psychology Press.
  16. Alan K Goble and Mark Hollins. 1994. Vibrotactile adaptation enhances frequency discrimination. The Journal of the Acoustical Society of America 96, 2 (1994), 771–780.
  17. Genevieve D Goff. 1967. Differential discrimination of frequency of cutaneous mechanical vibration. Journal of experimental psychology 74, 2p1 (1967), 294.
  18. Mid-air haptic rendering of 2D geometric shapes with a dynamic tactile pointer. IEEE transactions on haptics 13, 4 (2020), 806–817.
  19. Exploring the use of mid-air ultrasonic feedback to enhance automotive user interfaces. In Proceedings of the 10th international conference on automotive user interfaces and interactive vehicular applications. 11–20.
  20. Keisuke Hasegawa and Hiroyuki Shinoda. 2018. Aerial vibrotactile display based on multiunit ultrasound phased array. IEEE transactions on haptics 11, 3 (2018), 367–377.
  21. Non-contact tactile sensation synthesized by ultrasound transducers. In World Haptics 2009-Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, 256–260.
  22. Investigating the recognition of local shapes using mid-air ultrasound haptics. In 2019 IEEE World Haptics Conference (WHC). IEEE, 503–508.
  23. Ultrasound mid-air tactile feedback for immersive virtual reality interaction. In Ultrasound Mid-Air Haptics for Touchless Interfaces. Springer, 147–183.
  24. Inwook Hwang and Seungmoon Choi. 2010. Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device. In 2010 IEEE Haptics Symposium. IEEE, 1–8.
  25. Perceptual space of superimposed dual-frequency vibrations in the hands. PloS one 12, 1 (2017), e0169570.
  26. Vibrotactile perceived intensity for mobile devices as a function of direction, amplitude, and frequency. IEEE Transactions on Haptics 6, 3 (2013), 352–362.
  27. AirPiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback. In 2017 IEEE world haptics conference (WHC). IEEE, 213–218.
  28. Frequency and amplitude discrimination along the kinesthetic-cutaneous continuum in the presence of masking stimuli. The Journal of the Acoustical society of America 120, 5 (2006), 2789–2800.
  29. Feel effects: enriching storytelling with haptic feedback. ACM Transactions on Applied Perception (TAP) 11, 3 (2014), 1–17.
  30. Responses of mechanoreceptive afferent units in the glabrous skin of the human hand to sinusoidal skin displacements. Brain research 244, 1 (1982), 17–25.
  31. Georgios Korres and Mohamad Eid. 2016. Haptogram: Ultrasonic point-cloud tactile stimulation. IEEE Access 4 (2016), 7758–7769.
  32. Joseph B Kruskal. 1964. Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika 29, 1 (1964), 1–27.
  33. Can we crowdsource Tacton similarity perception and metaphor ratings?. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–13.
  34. Susan J Lederman and Roberta L Klatzky. 2009. Haptic perception: A tutorial. Attention, Perception, & Psychophysics 71, 7 (2009), 1439–1459.
  35. Jaebong Lee and Seungmoon Choi. 2013. Real-time perception-level translation from audio signals to vibrotactile effects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2567–2576.
  36. Chungman Lim and Gunhyuk Park. 2023. Can a Computer Tell Differences between Vibrations?: Physiology-Based Computational Model for Perceptual Dissimilarity Prediction. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–15.
  37. User engagement for mid-air haptic interactions with digital signage. In Proceedings of the 8th ACM international symposium on pervasive displays. 1–7.
  38. Rendering volumetric haptic shapes in mid-air using ultrasound. ACM Transactions on Graphics (TOG) 33, 6 (2014), 1–10.
  39. Dolphin: A framework for the design and perceptual evaluation of ultrasound mid-air haptic stimuli. In ACM Symposium on Applied Perception 2021. 1–10.
  40. Improving the Perception of Mid-Air Tactile Shapes With Spatio-Temporally-Modulated Tactile Pointers. ACM Transactions on Applied Perception (2023).
  41. Talking about tactile experiences. In Proceedings of the SIGCHI conference on human factors in computing systems. 1659–1668.
  42. Emotions mediated through mid-air haptics. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 2053–2062.
  43. Gunhyuk Park and Seungmoon Choi. 2011. Perceptual space of amplitude-modulated vibrotactile stimuli. In 2011 IEEE world haptics conference. IEEE, 59–64.
  44. Perceptual analysis of haptic icons: an investigation into the validity of cluster sorted mds. In 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, 437–444.
  45. A survey of mid-air ultrasound haptics and its applications. IEEE Transactions on Haptics 14, 1 (2020), 2–19.
  46. Perceptually correct haptic rendering in mid-air using ultrasound phased array. IEEE Transactions on Industrial Electronics 67, 1 (2019), 736–745.
  47. Vibrotactile frequency for encoding a speech parameter. The Journal of the Acoustical Society of America 62, 4 (1977), 1003–1012.
  48. Discriminating between intensities and velocities of mid-air haptic patterns. In Haptics: Science, Technology, Applications: 12th International Conference, EuroHaptics 2020, Leiden, The Netherlands, September 6–9, 2020, Proceedings 12. Springer, 78–86.
  49. Invisible touch: How identifiable are mid-air haptic shapes?. In Extended abstracts of the 2019 CHI conference on human factors in computing systems. 1–6.
  50. Vibrotactile feedback for information delivery in the vehicle. IEEE Transactions on Haptics 3, 2 (2010), 138–149.
  51. Psychophysical model for vibrotactile rendering in mobile devices. Presence 19, 4 (2010), 364–387.
  52. Oliver S Schneider and Karon E MacLean. 2016. Studying design process and example use with Macaron, a web-based vibrotactile effect editor. In IEEE Haptics Symposium (HAPTICS). IEEE, 52–58.
  53. Feellustrator: A Design Tool for Ultrasound Mid-Air Haptics. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–16.
  54. Hasti Seifi and Karon E Maclean. 2013. A first look at individuals’ affective ratings of vibrations. In 2013 World Haptics Conference (WHC). IEEE, 605–610.
  55. VibViz: Organizing, visualizing and navigating vibration libraries. In 2015 IEEE World Haptics Conference (WHC). IEEE, 254–259.
  56. Multi-point STM: Effects of Drawing Speed and Number of Focal Points on Users’ Responses using Ultrasonic Mid-Air Haptics. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–11.
  57. Lateral modulation of midair ultrasound focus for intensified vibrotactile stimuli. In Haptics: Science, Technology, and Applications: 11th International Conference, EuroHaptics 2018, Pisa, Italy, June 13-16, 2018, Proceedings, Part II 11. Springer, 276–288.
  58. Information transmission with a multifinger tactual display. Perception & psychophysics 61, 6 (1999), 993–1008.
  59. David Ternes and Karon E MacLean. 2008. Designing large sets of haptic icons with rhythm. In Haptics: Perception, Devices and Scenarios: 6th International Conference, EuroHaptics 2008 Madrid, Spain, June 10-13, 2008 Proceedings 6. Springer, 199–208.
  60. RecHap: An Interactive Recommender System For Navigating a Large Number of Mid-Air Haptic Designs. IEEE Transactions on Haptics (2023).
  61. Ultraleap. 2013. Haptic Muse. https://ir.immersion.com/news-releases/news-release-details/immersion-releases-haptic-muse-effect-preview-app-android-game [Online; accessed 27-August-2023].
  62. Ultraleap. 2022. STRATOS Explore. https://www.ultraleap.com/product/stratos-explore/ [Online; accessed 25-August-2022].
  63. Distilling the underlying dimensions of tactile melodies. In Proceedings of Eurohaptics, Vol. 2003. 111–120.
  64. Fingertip interaction metrics correlate with visual and haptic perception of real surfaces. In 2019 IEEE World Haptics Conference (WHC). IEEE, 395–400.
  65. Perception via the sense of touch. Tactile aids for the hearing impaired (1992), 1–36.
  66. Not just seeing, but also feeling art: Mid-air haptic experiences integrated in a multisensory art exhibition. International Journal of Human-Computer Studies 108 (2017), 1–14.
  67. Perception of ultrasonic haptic feedback on the hand: localisation and apparent motion. In Proceedings of the SIGCHI conference on human factors in computing systems. 1133–1142.
  68. An Exploration of Just Noticeable Differences in Mid-Air Haptics. In World Haptics: WHC.
  69. Perceived intensity model of dual-frequency superimposed vibration: Pythagorean sum. IEEE Transactions on Haptics 15, 2 (2022), 405–415.
  70. Emotional responses of tactile icons: Effects of amplitude, frequency, duration, and envelope. In 2015 IEEE World Haptics Conference (WHC). IEEE, 235–240.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 2 tweets with 1 like about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free