Towards Standards-Compliant Assistive Technology Product Specifications via LLMs (2404.03122v1)
Abstract: In the rapidly evolving field of assistive technology (AT), ensuring that products meet national and international standards is essential for user safety, efficacy, and accessibility. In this vision paper, we introduce CompliAT, a pioneering framework designed to streamline the compliance process of AT product specifications with these standards through the innovative use of LLMs. CompliAT addresses three critical tasks: checking terminology consistency, classifying products according to standards, and tracing key product specifications to standard requirements. We tackle the challenge of terminology consistency to ensure that the language used in product specifications aligns with relevant standards, reducing misunderstandings and non-compliance risks. We propose a novel approach for product classification, leveraging a retrieval-augmented generation model to accurately categorize AT products aligning to international standards, despite the sparse availability of training data. Finally, CompliAT implements a traceability and compliance mechanism from key product specifications to standard requirements, ensuring all aspects of an AT product are thoroughly vetted against the corresponding standards. By semi-automating these processes, CompliAT aims to significantly reduce the time and effort required for AT product standards compliance and uphold quality and safety standards. We outline our planned implementation and evaluation plan for CompliAT.
- R. A. Cooper, “Harmonization of assistive technology standards,” in Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 6, 1998.
- International Organization for Standardization, “ISO Standard 9999:2022, Assistive products Classification and terminology,” https://www.iso.org/standard/79495.html, 2022.
- N. Layton, “Barriers and facilitators to community mobility for assistive technology users,” Rehabilitation Research and Practice, 2012.
- C. A. Unsworth, J. Chua, P. Gudimetla, and A. Naweed, “Powered mobility aid access on public transport: A validation study of compliance with disability standards,” Journal of Transport & Health, vol. 22, 2021.
- N. Layton, N. Brusco, L. Callaway, L. Henley, and R. H. Wang, “It is time for nationally equitable access to assistive technology and home modifications in australia: An equity benchmarking study,” Australian Journal of Social Issues, 2023.
- International Organization for Standardization, “ISO 8549-1:2020 Prosthetics and orthotics – Vocabulary – Part 1: General terms for external limb prostheses and external orthoses,” https://www.iso.org/standard/79495.html, 2020.
- ——, “ISO 10328:2016 –Prosthetics – Structural testing of lower-limb prostheses Requirements and test methods,” https://www.iso.org/standard/70205.html, 2016.
- N. Layton, A. Spann, M. Khan, S. Contepomi, E. J. Hoogerwerf, D. Bell, and L. de Witte, “Guidelines for assistive technology service provision–a scoping review,” Disability and Rehabilitation: Assistive Technology, 2024.
- S. Bauer and L.-J. Elsaesser, “Integrating medical, assistive, and universally designed products and technologies: assistive technology device classification (atdc),” Disability and Rehabilitation: Assistive Technology, vol. 7, 2012.
- M. Sabetzadeh and C. Arora, “Practical guidelines for the selection and evaluation of NLP techniques in RE,” arXiv preprint arXiv:2401.01508, 2024.
- C. Arora, M. Sabetzadeh, L. Briand, and F. Zimmer, “Improving requirements glossary construction via clustering: approach and industrial case studies,” in Proceedings of the 8th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM’14), 2014.
- P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W.-t. Yih, T. Rocktäschel et al., “Retrieval-augmented generation for knowledge-intensive nlp tasks,” Advances in Neural Information Processing Systems, vol. 33, pp. 9459–9474, 2020.
- D. Hobson, R. A. Cooper, and M. Ferguson-Pell, “Standards for assistive technology,” in An introduction to rehabilitation engineering. CRC Press, 2006, pp. 103–126.
- I. T. Bougie, “Iso 9999 assistive products for persons with disability—classification and terminology,” The engineering handbook of smart technology for aging, disability and independence, pp. 117–126, 2008.
- T. Bernd, D. Van Der Pijl, and L. De Witte, “Existing models and instruments for the selection of assistive technology in rehabilitation practice,” Scandinavian Journal of Occupational Therapy, vol. 16, 2009.
- S. M. Bauer, L.-J. Elsaesser, and S. Arthanat, “Assistive technology device classification based upon the world health organization’s, international classification of functioning, disability and health (icf),” Disability and Rehabilitation: Assistive Technology, vol. 6, 2011.
- E. Sadeghi-Demneh, S. Forghany, P. Onmanee, U. Trinler, M. P. Dillon, and R. Baker, “The influence of standards and clinical guidelines on prosthetic and orthotic service quality: A scoping review,” Disability and Rehabilitation, vol. 40, no. 20, pp. 2458–2465, 2018.
- L.-J. Elsaesser, S. Bauer, E. Steel, E. Friesen, T. Inoue, and L.-J. Elsaesser, “The value of vocabulary standards towards improving access to assistive technology,” Global perspectives on AT, 2019.
- L.-J. Elsaesser, N. Layton, M. Scherer, and S. Bauer, “Standard terminology is critical to advancing rehabilitation and assistive technology: a call to action,” Disability and Rehabilitation: Assistive Technology, vol. 17, 2022.
- O. Akhigbe, D. Amyot, and G. Richards, “A systematic literature mapping of goal and non-goal modelling methods for legal and regulatory compliance,” Requirements Engineering, vol. 24, pp. 459–481, 2019.
- A. M. Mustapha, O. Arogundade, S. Misra, R. Damasevicius, and R. Maskeliunas, “A systematic literature review on compliance requirements management of business processes,” International Journal of System Assurance Engineering and Management, vol. 11, 2020.
- S. Abualhaija, M. Ceci, and L. Briand, “Legal requirements analysis,” arXiv preprint arXiv:2311.13871, 2023.
- N. Kiyavitskaya, N. Zeni, T. D. Breaux, A. I. Antón, J. R. Cordy, L. Mich, and J. Mylopoulos, “Automating the extraction of rights and obligations for regulatory compliance,” in 27th International Conference on Conceptual Modeling, 2008.
- O. Turetken, A. Elgammal, W.-J. van den Heuvel, and M. P. Papazoglou, “Capturing compliance requirements: A pattern-based approach,” IEEE software, vol. 29, no. 3, pp. 28–36, 2012.
- G. Soltana, N. Sannier, M. Sabetzadeh, and L. C. Briand, “Model-based simulation of legal policies: Framework, tool support, and validation,” Software & Systems Modeling, vol. 17, pp. 851–883, 2018.
- A. Elgammal, O. Turetken, W.-J. van den Heuvel, and M. Papazoglou, “Formalizing and appling compliance patterns for business process compliance,” Software & Systems Modeling, vol. 15, pp. 119–146, 2016.
- E. Francesconi and G. Governatori, “Patterns for legal compliance checking in a decidable framework of linked open data,” Artificial Intelligence and Law, vol. 31, no. 3, pp. 445–464, 2023.
- J. Cleland-Huang, A. Czauderna, M. Gibiec, and J. Emenecker, “A machine learning approach for tracing regulatory codes to product specific requirements,” in Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering-Volume 1, 2010, pp. 155–164.
- J. Guo, M. Gibiec, and J. Cleland-Huang, “Tackling the term-mismatch problem in automated trace retrieval,” Empirical Software Engineering, vol. 22, pp. 1103–1142, 2017.
- S. Abualhaija, C. Arora, A. Sleimi, and L. C. Briand, “Automated question answering for improved understanding of compliance requirements: A multi-document study,” in 2022 IEEE 30th International Requirements Engineering Conference (RE). IEEE, 2022, pp. 39–50.
- C. Arora, J. Grundy, and M. Abdelrazek, “Advancing requirements engineering through generative ai: Assessing the role of LLMs,” arXiv preprint arXiv:2310.13976, 2023.