Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
119 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Chart4Blind: An Intelligent Interface for Chart Accessibility Conversion (2403.06693v2)

Published 11 Mar 2024 in cs.HC

Abstract: In a world driven by data visualization, ensuring the inclusive accessibility of charts for Blind and Visually Impaired (BVI) individuals remains a significant challenge. Charts are usually presented as raster graphics without textual and visual metadata needed for an equivalent exploration experience for BVI people. Additionally, converting these charts into accessible formats requires considerable effort from sighted individuals. Digitizing charts with metadata extraction is just one aspect of the issue; transforming it into accessible modalities, such as tactile graphics, presents another difficulty. To address these disparities, we propose Chart4Blind, an intelligent user interface that converts bitmap image representations of line charts into universally accessible formats. Chart4Blind achieves this transformation by generating Scalable Vector Graphics (SVG), Comma-Separated Values (CSV), and alternative text exports, all comply with established accessibility standards. Through interviews and a formal user study, we demonstrate that even inexperienced sighted users can make charts accessible in an average of 4 minutes using Chart4Blind, achieving a System Usability Scale rating of 90%. In comparison to existing approaches, Chart4Blind provides a comprehensive solution, generating end-to-end accessible SVGs suitable for assistive technologies such as embossed prints (papers and laser cut), 2D tactile displays, and screen readers. For additional information, including open-source codes and demos, please visit our project page https://moured.github.io/chart4blind/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (71)
  1. SeeChart: Enabling Accessible Visualizations Through Interactive Natural Language Interface For People with Visual Impairments. In Proceedings of the 28th International Conference on Intelligent User Interfaces. 46–64.
  2. Helmut Alt and Michael Godau. 1995. Computing the Fréchet distance between two polygonal curves. International Journal of Computational Geometry & Applications 5, 01n02 (1995), 75–91.
  3. Kerstin Altmanninger and Wolfram Wöß. 2006. Dynamically generated scalable vector graphics (SVG) for barrier-free web-applications. In Computers Helping People with Special Needs: 10th International Conference, ICCHP 2006, Linz, Austria, July 11-13, 2006. Proceedings 10. Springer, 128–135.
  4. Development of Tactile Graph Generation Software Using the R Statistics Software Environment. In Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (Rochester, New York, USA) (ASSETS ’14). Association for Computing Machinery, New York, NY, USA, 251–252.
  5. Filip Bajić and Josip Job. 2023. Review of chart image detection and classification. International Journal on Document Analysis and Recognition (IJDAR) (2023), 1–22.
  6. Chart-text: A fully automated chart image descriptor. arXiv preprint arXiv:1812.10636 (2018).
  7. Safwane Benbba. 2021. Comparison of D3. js and Chart. js as visualisation tools. B.S. thesis.
  8. WebInSight: Making Web Images Accessible. In Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Portland, Oregon, USA) (Assets ’06). Association for Computing Machinery, New York, NY, USA, 181–188.
  9. Olli: An extensible visualization library for screen reader accessibility. IEEE VIS Posters 6 (2022).
  10. Line Harp: Importance-Driven Sonification for Dense Line Charts. arXiv preprint arXiv:2307.16589 (2023).
  11. Technology Developments in Touch-Based Accessible Graphics: A Systematic Review of Research 2010-2020. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 278, 15 pages.
  12. Optical character recognition systems. Springer.
  13. Masked-attention Mask Transformer for Universal Image Segmentation. CVPR.
  14. ChartReader: A Unified Framework for Chart Derendering and Comprehension without Heuristic Rules. arXiv preprint arXiv:2304.02173 (2023).
  15. Visualizing for the non-visual: Enabling the visually impaired to use visualization. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 249–260.
  16. Software Freedom Conservancy. 2023. Inkscape: Open Source Scalable Vector Graphics Editor. Retrieved January 18, 2024 from https://inkscape.org
  17. World Wide Web Consortium et al. 1999. Web content accessibility guidelines 1.0. (1999).
  18. Making accessible PDF documents. In Proceedings of the 11th ACM symposium on Document engineering. 275–276.
  19. Polly Edman. 1992. Tactile graphics. American Foundation for the Blind.
  20. SVGPlott: an accessible tool to generate highly adaptable, accessible audio-tactile charts for and from blind and visually impaired people. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments. 186–195.
  21. Christin Engel and Gerhard Weber. 2017. Improve the accessibility of tactile charts. In Human-Computer Interaction-INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25–29, 2017, Proceedings, Part I 16. Springer, 187–195.
  22. Christin Engel and Gerhard Weber. 2018. A user study to evaluate tactile charts with blind and visually impaired people. In Computers Helping People with Special Needs: 16th International Conference, ICCHP 2018, Linz, Austria, July 11-13, 2018, Proceedings, Part II 16. Springer, 177–184.
  23. Automatic Chart Understanding: A Review. IEEE Access 11 (2023), 76202–76221.
  24. Scalable vector graphics (SVG) 1.0 specification. iuniverse Bloomington.
  25. The Document Foundation. 2020. LibreOffice Draw. Retrieved January 18, 2024 from https://www.libreoffice.org/discover/draw/
  26. The Document Foundation. 2023. LibreOffice. Retrieved January 18, 2024 from https://www.libreoffice.org
  27. Gillian Gale. 2005. Guidelines on Conveying Visual Information. Round Table on Information Access for People with Print Disabilities Inc. Available from http://printdisability. org/guidelines/guidelines-on-conveying-visual-information-2005 (2005).
  28. A Jonathan R Godfrey and M Theodor Loots. 2014. Statistical software (R, SAS, SPSS, and Minitab) for blind students and practitioners. Journal of Statistical Software 58 (2014), 1–25.
  29. Cagatay Goncu and Kim Marriott. 2008. Tactile Chart Generation Tool. In Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Halifax, Nova Scotia, Canada) (Assets ’08). Association for Computing Machinery, New York, NY, USA, 255–256.
  30. LineEX: Data Extraction From Scientific Line Charts. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 6213–6221.
  31. The sonification handbook. Vol. 1. Logos Verlag Berlin.
  32. Infosonics: Accessible infographics for people who are blind using sonification and voice. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–13.
  33. Joseph A Huwaldt and S Steinhorst. 2023. Plot digitizer. Retrieved January 18, 2024 from http://plotdigitizer.sourceforge.net
  34. Web Accessibility Initiative. 2023. W3C. Retrieved January 18, 2024 from https://www.w3.org/WAI/tutorials/images/
  35. Automated Tactile Graphics Translation: In the Field. In Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (Tempe, Arizona, USA) (Assets ’07). Association for Computing Machinery, New York, NY, USA, 75–82.
  36. Usability evaluation in industry. CRC Press.
  37. ChartSense: Interactive Data Extraction from Chart Images. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 6706–6717.
  38. Chart-to-Text: A Large-Scale Benchmark for Chart Summarization. arXiv:2203.06486 [cs.CL]
  39. Anthony Kay. 2007. Tesseract: an open-source optical character recognition engine. Linux Journal 2007, 159 (2007), 2.
  40. Stephen E. Krufka and Kenneth E. Barner. 2005. Automatic Production of Tactile Graphics from Scalable Vector Graphics. In Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Baltimore, MD, USA) (Assets ’05). Association for Computing Machinery, New York, NY, USA, 166–172.
  41. LineFormer: Rethinking Line Chart Data Extraction as Instance Segmentation. arXiv:2305.01837 [cs.CV]
  42. D.J. Leiner. 2019. SoSci Survey – the Solution for Professional Online Questionnaires. Retrieved October 6, 2023 from https://www.soscisurvey.de/en/index
  43. Editing spatial layouts through tactile templates for people with visual impairments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.
  44. Alan Lundgard and Arvind Satyanarayan. 2021. Accessible visualization via natural language descriptions: A four-level model of semantic content. IEEE transactions on visualization and computer graphics 28 (2021), 1073–1083.
  45. Alan Lundgard and Arvind Satyanarayan. 2022. Accessible Visualization via Natural Language Descriptions: A Four-Level Model of Semantic Content. IEEE Transactions on Visualization and Computer Graphics 28, 1 (2022), 1073–1083.
  46. ChartDetective: Easy and Accurate Interactive Data Extraction from Complex Vector Charts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (Hamburg, Germany) (CHI ’23). Association for Computing Machinery, New York, NY, USA, Article 147, 17 pages.
  47. ChartDetective: Easy and Accurate Interactive Data Extraction from Complex Vector Charts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–17.
  48. Accessible Document Layout: An Interface for 2D Tactile Displays. In Proceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments. 265–271.
  49. Line Graphics Digitization: A Step Towards Full Automation. In International Conference on Document Analysis and Recognition. Springer, 438–453.
  50. H Nagao and S Hatanaka. 2005. Braille Books and Translation of Illustration by Using PCs. Dokusho Kobo, Tokyo (2005).
  51. Optical character recognition: an illustrated guide to the frontier. In Document Recognition and Retrieval VII, Daniel P. Lopresti and Jiangying Zhou (Eds.), Vol. 3967. International Society for Optics and Photonics, SPIE, 58 – 69.
  52. Braille Authority of North America. 2010. Guidelines and Standards for Tactile Graphics. Retrieved January 17, 2024 from https://www.brailleauthority.org/tg/web-manual/index.html
  53. Round Table on Information Access for People with Print Disabilities. 2022. Guidelines for producing accessible graphics / Round Table on Information Access for People with Print Disabilities Inc. (2022). Retrieved January 18, 2024 from https://printdisability.org/guidelines/graphics-2022/
  54. Production of accessible tactile graphics. In Computers Helping People with Special Needs: 14th International Conference, ICCHP 2014, Paris, France, July 9-11, 2014, Proceedings, Part II 14. Springer, 26–33.
  55. Ankit Rohatgi. 2014. WebPlotDigitizer user manual version 3.4. (2014), 1–18. Retrieved January 18, 2024 from https://automeris.io/WebPlotDigitizer/userManual.pdf
  56. Study of additive manufacturing techniques to obtain tactile graphics. In IOP Conference Series: Materials Science and Engineering. IOP Publishing, 012117.
  57. VoxLens: Making Online Data Visualizations Accessible with an Interactive JavaScript Plug-In. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 478, 19 pages.
  58. Linda Sheppard and Frances K Aldrich. 2001. Tactile graphics in school education: perspectives from teachers. British Journal of Visual Impairment 19, 3 (2001), 93–97.
  59. Ben Shneiderman. 1996. The eyes have it: A task by data type taxonomy for information visualizations. In Proceedings 1996 IEEE symposium on visual languages. IEEE, 336–343.
  60. Towards accessible chart visualizations for the non-visuals: Research, applications and gaps. Computer Science Review 48 (2023), 100555.
  61. Linespace: A Sensemaking Platform for the Blind. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI ’16). Association for Computing Machinery, New York, NY, USA, 2175–2185.
  62. VisText: A Benchmark for Semantically Rich Chart Captioning. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Toronto, Canada, 7268–7298.
  63. Petroc Taylor. 2023. Amount of data created, consumed, and stored 2010-2020, with forecasts to 2025. Retrieved January 18, 2024 from https://www.statista.com/statistics/871513/worldwide-data-created/
  64. Chart Reader: Accessible Visualization Experiences Designed with Screen Reader Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.
  65. B. Tummers. 2006. DataThief III. Retrieved January 18, 2024 from https://datathief.org/
  66. Russ Unger and Carolyn Chandler. 2012. A Project Guide to UX Design: For user experience designers in the field or in the making. New Riders.
  67. Shai Vaingast. 2014. im2graph. Retrieved January 18, 2024 from https://www.im2graph.co.il/
  68. Development of software for automatic creation of embossed graphs: Comparison of non-visual data presentation methods and development up-to-date. In Computers Helping People with Special Needs: 13th International Conference, ICCHP 2012, Linz, Austria, July 11-13, 2012, Proceedings, Part I 13. Springer, 174–181.
  69. Incidental scene text understanding: Recent progresses on icdar 2015 robust reading competition challenge 4. arXiv preprint arXiv:1511.09207 (2015).
  70. Reviving Static Charts into Live Charts. arXiv preprint arXiv:2309.02967 (2023).
  71. Hong Zou and Jutta Treviranus. 2015. ChartMaster: A tool for interacting with stock market charts using a screen reader. In Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. 107–116.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Omar Moured (10 papers)
  2. Morris Baumgarten-Egemole (1 paper)
  3. Alina Roitberg (36 papers)
  4. Thorsten Schwarz (6 papers)
  5. Rainer Stiefelhagen (155 papers)
  6. Karin Muller (4 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets