A Survey on Human-AI Teaming with Large Pre-Trained Models (2403.04931v2)
Abstract: In the rapidly evolving landscape of AI, the collaboration between human intelligence and AI systems, known as Human-AI (HAI) Teaming, has emerged as a cornerstone for advancing problem-solving and decision-making processes. The advent of Large Pre-trained Models (LPtM) has significantly transformed this landscape, offering unprecedented capabilities by leveraging vast amounts of data to understand and predict complex patterns. This paper surveys the pivotal integration of LPtMs with HAI, emphasizing how these models enhance collaborative intelligence beyond traditional approaches. It examines the potential of LPtMs in augmenting human capabilities, discussing this collaboration for AI model improvements, effective teaming, ethical considerations, and their broad applied implications in various sectors. Through this exploration, the study sheds light on the transformative impact of LPtM-enhanced HAI Teaming, providing insights for future research, policy development, and strategic implementations aimed at harnessing the full potential of this collaboration for research and societal benefit.
- Towards human-bot collaborative software architecting with ChatGPT. In Proceedings of the 27th International Conference on Evaluation and Assessment in Software Engineering, pages 279–285, 2023.
- Playing repeated games with large language models. arXiv preprint arXiv:2305.16867, 2023.
- Human-AI collaboration in a cooperative game setting: Measuring social perception and outcomes. Proceedings of the ACM on Human-Computer Interaction, 4:1–20, 10 2020.
- Explainable artificial intelligence for autonomous driving: A comprehensive overview and field guide for future research directions. arXiv preprint arXiv:2112.11561, 12 2021.
- Human-AI collaborative bayesian optimisation. Advances in Neural Information Processing Systems, 35:16233–16245, 2022.
- Beyond accuracy: The role of mental models in human-AI team performance. In Proceedings of the AAAI conference on human computation and crowdsourcing, pages 2–11, 2019.
- Does the whole exceed its parts? the effect of AI explanations on complementary team performance. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pages 1–16, 2021.
- Deriving machine attention from human rationales. In Ellen Riloff, David Chiang, Julia Hockenmaier, and Jun’ichi Tsujii, editors, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 1903–1913, Brussels, Belgium, October-November 2018. Association for Computational Linguistics.
- Semantic photo manipulation with a generative image prior. ACM Trans. Graph., 38(4), jul 2019.
- A group fairness lens for large language models. arXiv preprint arXiv:2312.15478, 2023.
- Human-AI teaming: leveraging transactive memory and speaking up for enhanced team effectiveness. Frontiers in Psychology, 14, 2023.
- How should the advent of large language models affect the practice of science? arXiv preprint arXiv:2312.03759, 2023.
- A leap of faith: Is there a formula for “trustworthy” AI? The Hastings Center Report, 51:17–22, 2021.
- Language models are few-shot learners. In Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS’20, Red Hook, NY, USA, 2020. Curran Associates Inc.
- Yang Li Bryan Wang, Gang Li. Enabling conversational interaction with mobile UI using large language models. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, Hamburg, Germany, 2023. ACM, New York, NY, USA. Accessed: 2023-11-28.
- A survey on active learning and human-in-the-loop deep learning for medical image analysis. Medical Image Analysis, 71:102062, jul 2021.
- Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the 2019 chi conference on human factors in computing systems, pages 1–14, 2019.
- An agile new research framework for hybrid human-AI teaming: Trust, transparency, and transferability. ACM Transactions on Interactive Intelligent Systems (TiiS), 12(3):1–36, 2022.
- Artificial intelligence and the ‘good society’: the US, EU, and UK approach. Science and engineering ethics, 24:505–528, 2018.
- I spy a metaphor: Large language models and diffusion models co-create visual metaphors. arXiv preprint arXiv:2305.14724, 2023.
- AI challenges in human-robot cognitive teaming. arXiv preprint arXiv:1707.04775, 2017.
- A survey on evaluation of large language models. arXiv preprint arXiv:2307.03109, 2023.
- VideoLLM: Modeling video sequence with large language models. arXiv preprint arXiv:2305.13292, 2023.
- Assessing the impact of prompting methods on chatgpt’s mathematical capabilities. arXiv preprint arXiv:2312.15006, 2024.
- Teachable conversational agents for crowdwork: Effects on performance and trust. Proceedings of the ACM on Human-Computer Interaction, 6:1–21, 2022.
- Can large language models be an alternative to human evaluations? arXiv preprint arXiv:2305.01937, 2023.
- Impact of accountability, training, and human factors on the use of artificial intelligence in healthcare: Exploring the perceptions of healthcare practitioners in the US. Human Factors in Healthcare, 2:100021, 2022.
- AI-employee collaboration and business performance: Integrating knowledge-based view, socio-technical systems and organisational socialisation framework. Journal of Business Research, 144:31–49, 2022.
- Deep reinforcement learning from human preferences. In Isabelle Guyon, Ulrike von Luxburg, Samy Bengio, Hanna M. Wallach, Rob Fergus, S. V. N. Vishwanathan, and Roman Garnett, editors, Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, December 4-9, 2017, Long Beach, CA, USA, pages 4299–4307, 2017.
- All that’s’ human’is not gold: Evaluating human evaluation of generated text. arXiv preprint arXiv:2107.00061, 2021.
- A multimodal approach to assessing user experiences with agent helpers. ACM Transactions on Interactive Intelligent Systems, 2016.
- The Sciences in Enlightened Europe. University of Chicago Press, 1999.
- A survey of algorithmic methods for competency self-assessments in human-autonomy teaming. ACM Computing Surveys, 08 2023.
- Designing for hybrid intelligence: A taxonomy and survey of crowd-machine interaction. Applied Sciences, 13, 2023.
- Drive as you speak: Enabling human-like interaction with large language models in autonomous vehicles. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops, pages 902–909, January 2024.
- ChatGPT and the rise of large language models: the new AI-driven infodemic threat in public health. Frontiers in Public Health, 11:1166120, 2023.
- Does chatGPT alter job seekers’ identity? an experimental study. Proceedings of the 57th Hawaii International Conference on System Sciences, 2024.
- Semire Dikli. Automated essay scoring. Turkish Online Journal of Distance Education, 7(1):49–62, 2006.
- HACO: A framework for developing human-AI teaming. In Proceedings of the 13th Innovations in Software Engineering Conference on Formerly Known as India Software Engineering Conference, ISEC 2020, New York, NY, USA, 2020. Association for Computing Machinery.
- Jill watson doesn’t care if you’re pregnant: Grounding AI ethics in empirical studies. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society, pages 88–94, 2018.
- GPTs are GPTs: An early look at the labor market impact potential of large language models. arXiv preprint arXiv:2303.10130, 2023.
- Andy Extance. ChatGPT has entered the classroom: how LLMs could transform education. Nature, 2023.
- Trust engineering for human-AI teams. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 63:322 – 326, 2019.
- Human-AI collaboration for UX evaluation: Effects of explanation and synchronization. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW1):1–32, 2022.
- Modeling and guiding the creation of ethical human-ai team. In Proceedings of the 2021 AAAI/ACM Conference on AI, Ethics, and Society, 2021.
- Kevin Frans. AI charades: Language models as interactive game environments. In 2021 IEEE Conference on Games (CoG), pages 1–2. IEEE, 2021.
- Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111:8410 – 8415, 2014.
- Compensating for sensing failures via delegation in human-AI hybrid systems. Sensors, 23(7):3409, 2023.
- "I wouldn’t say offensive but…": Disability-centered perspectives on large language models. In FAccT ’23: Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, page 205–216, New York, NY, USA, 2023. Association for Computing Machinery.
- Bias and fairness in large language models: A survey. arXiv preprint arXiv:2309.00770, 2023.
- AI-powered service robotics for independent shopping experiences by elderly and disabled people. Applied Sciences, 11(19):9007, September 2021.
- Explaining and harnessing adversarial examples. In International Conference on Learning Representations, 2015.
- Hmiway-env: A framework for simulating behaviors and preferences to support human-AI teaming in driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022.
- The principles and limits of algorithm-in-the-loop decision making. Proc. ACM Hum.-Comput. Interact., 3(CSCW), nov 2019.
- Crowd-AI camera sensing in the real world. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2(3), sep 2018.
- From chatGPT to threatGPT: Impact of generative AI in cybersecurity and privacy. IEEE Access, 2023.
- Regulating chatGPT and other large generative AI models. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, pages 1112–1123, 2023.
- Stefan Harrer. Attention is not all you need: the complicated case of ethically using large language models in healthcare and medicine. EBioMedicine, 90, 2023.
- The positive aspects of mursion when teaching higher education students. Quarterly Review of Distance Education, 20(4):71–100, 2019.
- Adapt and overcome: Perceptions of adaptive autonomous agents for human-AI teaming. Computers in Human Behavior, 138:107451, 2023.
- Exploring the responses of large language models to beginner programmers’ help requests. In Proceedings of the 2023 ACM Conference on International Computing Education Research - Volume 1, ICER ’23, page 93–105, New York, NY, USA, 2023. Association for Computing Machinery.
- Human-AI collaboration: The effect of AI delegation on human task performance and task satisfaction. In Proceedings of the 28th International Conference on Intelligent User Interfaces, IUI ’23, page 453–463, New York, NY, USA, 2023. Association for Computing Machinery.
- Human–machine teaming is key to AI adoption: clinicians’ experiences with a deployed machine learning system. NPJ digital medicine, 5(1):97, 2022.
- Exploring trust in human-AI collaboration in the context of multiplayer online games. systems. Human–AI Teaming: Synergy, Decision-Making and Interdependency, 2023.
- Language instructed reinforcement learning for human-AI coordination. arXiv preprint arXiv:2304.07297, 2023.
- Bias assessment and mitigation in LLM-based code generation. arXiv preprint arXiv:2309.14345, 2023.
- Reward learning from human preferences and demonstrations in atari. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS’18, page 8022–8034, Red Hook, NY, USA, 2018. Curran Associates Inc.
- Ashesh Jain. ChatGPT meets video security: A new era of intelligent surveillance, 2023.
- Visual prompt tuning. In European Conference on Computer Vision (ECCV), 2022.
- The global landscape of AI ethics guidelines. Nature machine intelligence, 1(9):389–399, 2019.
- Assessing the accuracy and reliability of AI-generated medical responses: An evaluation of the chat-GPT model. Research Square, 2023.
- No AI is an island: the case for teaming intelligence. AI magazine, 40(1):16–28, 2019.
- Reinforcement learning: A survey. Journal of artificial intelligence research, 4:237–285, 1996.
- Secure, privacy-preserving and federated machine learning in medical imaging. Nature Machine Intelligence, 2(6):305–311, 2020.
- CAAF: A cognitive affective agent programming framework. Engineering Psychology and Cognitive Ergonomics, 10906:317–330, 2016.
- Adaptive learning system for higher learning. In 2017 8th international conference on information technology (ICIT), pages 960–970. IEEE, 2017.
- An AI-based visual aid with integrated reading assistant for the completely blind. IEEE Transactions on Human-Machine Systems, 50(6):507–517, 2020.
- State of the practice of computer security incident response teams (CSIRTs). Technical Report CMU/SEI-2003-TR-001, Carnegie Mellon University, Software Engineering Institute’s Digital Library, Oct 2003. Accessed: 2024-Feb-13.
- "help me help the AI": Understanding how explainability can support human-ai interaction. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pages 1–17, 2023.
- Segment anything. arXiv preprint arXiv:2304.02643, 2023.
- Bias out-of-the-box: An empirical analysis of intersectional occupational biases in popular generative language models. Advances in neural information processing systems, 34:2611–2624, 2021.
- Ethical considerations in working with chatGPT on a questionnaire about the future of work with chatGPT. AI and Ethics (Online), 2023.
- Gender bias and stereotypes in large language models. In Proceedings of The ACM Collective Intelligence Conference, CI ’23, page 12–24, New York, NY, USA, 2023. Association for Computing Machinery.
- Enhancing the effectiveness of work groups and teams. psychological science in the public interest. Psychological Science in the Public Interest, 2006.
- A deep learning based model to assist blind people in their navigation. Journal of Information Technology Education: Innovations in Practice, 21:095–114, 2022.
- Performance of chatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLoS digital health, 2(2):e0000198, 2023.
- RLAIF: Scaling reinforcement learning from human feedback with AI feedback, 2023.
- Artificial cognition for social human–robot interaction: An implementation. Artificial Intelligence, 247:45–69, 2017.
- Ethical machines: The human-centric use of artificial intelligence. IScience, 24(3), 2021.
- Human-in-the-loop debugging deep text classifiers. arXiv preprint arXiv:2010.04987, abs/2010.04987, 2020.
- Drivingdiffusion: Layout-guided multi-view driving scene video generation with latent diffusion model. arXiv preprint arXiv:2310.07771, 2023.
- A survey on fairness in large language models. arXiv preprint arXiv:2308.10149, 2023.
- Tag-based annotation creates better avatars. arXiv preprint arXiv:2302.07354, 2023.
- Do humans and machines have the same eyes? human-machine perceptual differences on image classification. arXiv preprint arXiv:2304.08733, 2023.
- A rationale-centric framework for human-in-the-loop machine learning. In Annual Meeting of the Association for Computational Linguistics, 2022.
- Readingquizmaker: A human-NLP collaborative system that supports instructors to design high-quality reading quiz questions. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pages 1–18, 2023.
- Human-machine collaboration for automated driving using an intelligent two-phase haptic interface. Advanced Intelligent Systems, page 2000229, 02 2021.
- Trust and human-machine teaming: A qualitative study. In Artificial intelligence for the internet of everything, pages 101–116. Elsevier, 2019.
- Translating radiology reports into plain language using chatGPT and GPT-4 with prompt learning: Promising results, limitations, and potential. arXiv preprint arXiv:2303.09038, 2023.
- A review on human–AI interaction in machine learning and insights for medical applications. International Journal of Environmental Research and Public Health, 18, 2021.
- Large language models and eu data protection: Mapping (some) of the problems. https://digi-con.org/large-language-models-and-eu-data-protection-mapping-some-of-the-problems/, 2023. Accessed: 2024-02-28.
- International evaluation of an AI system for breast cancer screening. Nature, 577(7788):89–94, 2020.
- Who/what is my teammate? team composition considerations in human–AI teaming. IEEE Transactions on Human-Machine Systems, 51(4):288–299, 2021.
- Complex problem solving through human-ai collaboration: Literature review on research contexts. In Proceedings of the Annual Hawaii International Conference on System Sciences, 2022.
- Towards human-AI-collaboration in brainstorming: Empirical insights into the perception of working with a generative ai. In 31st European Conference on Information Systems (ECIS), 2023.
- ChatGPT and large language models in academia: opportunities and challenges. BioData Mining, 16(1):20, 2023.
- Henny Admoni Michelle Zhao, Reid Simmons. The role of adaptation in collective human–AI teaming. Topics in Cognitive Science, 2022.
- Human-AI collaboration for ux evaluation: Effects of explanation and synchronization. arXiv.org, 2023. Accessed: 2023-11-28.
- Large language models as general pattern machines. arXiv preprint arXiv:2307.04721, 2023.
- The ethics of algorithms: Mapping the debate. Big Data and Society, 2016.
- Evaluating the impact of human explanation strategies on human-AI visual decision-making. Proc. ACM Hum.-Comput. Interact., 7(CSCW1), apr 2023.
- Decision making strategies and team efficacy in human-AI teams. Proceedings of the ACM on Human-Computer Interaction,, 2023.
- Webgpt: Browser-assisted question-answering with human feedback. arXiv preprint arXiv:2112.09332, 2021.
- Using perceptual and cognitive explanations for enhanced human-agent team performance. Lecture Notes in Computer Science, 10011:204–214, 2018.
- Tag-based annotation for avatar face creation. arXiv preprint arXiv:2308.12642, 2023.
- Human-robot mutual adaptation in collaborative tasks: Models and experiments. The International Journal of Robotics Research, 36:618–634, 2017.
- Real-time execution of large-scale language models on mobile, 2020.
- Hyacinth S Nwana. Intelligent tutoring systems: an overview. Artificial Intelligence Review, 4(4):251–277, 1990.
- Likelihood-based mitigation of evaluation bias in large language models. arXiv preprint arXiv:2402.15987, 2024.
- OpenAI. Chatgpt-4. https://openai.com/chatgpt, 2023.
- Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730–27744, 2022.
- AI for accessibility: Virtual assistant for hearing impaired. In 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), pages 1–7, 2020.
- Subharun Pal. The future of large language models: A futuristic dissection on AI and human interaction. IJFMR-International Journal For Multidisciplinary Research, 5(3), 2023.
- VLAAD: Vision and language assistant for autonomous driving. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops, pages 980–987, January 2024.
- Ancilia: Scalable intelligent video surveillance for the artificial intelligence of things. arXiv preprint arXiv:2301.03561, 2023.
- Ethics in human–AI teaming: principles and perspectives. AI and Ethics, pages 1–19, 2022.
- Active pairwise distance learning for efficient labeling of large datasets by human experts. Applied Intelligence, 53:24689 – 24708, 2023.
- UX research on conversational human-AI interaction: A literature review of the ACM digital library. arXiv preprint arXiv, 2023. Accessed: 2023-11-28.
- Learning transferable visual models from natural language supervision. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 8748–8763. PMLR, 18–24 Jul 2021.
- Direct preference optimization: Your language model is secretly a reward model. arXiv preprint arXiv:2305.18290, 2023.
- Supporting human-AI collaboration in auditing LLM with LLMs. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society, pages 913–926, 2023.
- Rowena Rodrigues. Legal and human rights issues of ai: Gaps, challenges and vulnerabilities. Journal of Responsible Technology, 2020.
- Artificial Intelligence: A Modern Approach. Prentice Hall, 2021.
- Situation awareness in team performance: Implications for measurement and training. Human Factors, 37, 2017.
- A survey on cyber security meets artificial intelligence: AI–driven cyber security. Journal of Cognitive Human-Computer Interaction, 2(2):50–55, 2022.
- Glorin Sebastian. Privacy and data protection in chatgpt and other AI chatbots: Strategies for securing user information. Available at SSRN 4454761, 2023.
- Burr Settles. Active Learning Literature Survey. Department of Computer Sciences, University of Wisconsin-Madison, 2009.
- What should you know? a human-in-the-loop approach to unknown unknowns characterization in image recognition. In Proceedings of the ACM Web Conference 2022, WWW ’22, page 882–892, New York, NY, USA, 2022. Association for Computing Machinery.
- Human-AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support. Nature Machine Intelligence, 5(1):46–57, 2023.
- Sabina Leonelli Silvia Milano, Joshua A. McGrane. Large language models challenge the future of higher education. Nature Machine Intelligence, 2023.
- Playing games with AIs: the limits of gpt-3 and similar large language models. Minds and Machines, 32(2):341–364, 2022.
- Artificial intelligence for human flourishing – beyond principles for machine learning. Journal of Business Research, 2021.
- Policy gradient methods for reinforcement learning with function approximation. Advances in neural information processing systems, 12, 1999.
- Nintendo Switch. Mariokart 8 deluxe, 2017. Video game.
- A survey of mental modeling techniques in human–robot teaming. Current Robotics Reports, 1, 12 2020.
- Breaking barriers to creative expression: Co-designing and implementing an accessible text-to-image interface. arXiv preprint arXiv:2309.02402, 2023.
- Ekenobi ThankGod Chinonso. The impact of chatGPT on privacy and data protection laws. Available at SSRN: https://ssrn.com/abstract=4556181, 2023.
- ChatGPT, bard, and large language models for biomedical research: opportunities and pitfalls. Annals of Biomedical Engineering, 51(12):2647–2651, 2023.
- Level generation through large language models. In Proceedings of the 18th International Conference on the Foundations of Digital Games, pages 1–8, 2023.
- LLaMA: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023.
- Does human collaboration enhance the accuracy of identifying LLM-generated deepfake texts? In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, pages 163–174, 2023.
- Privacy preserving large language models: ChatGPT case study based vision and framework. arXiv preprint arXiv:2310.12523, 2023.
- Six challenges for human-AI co-learning. In Adaptive Instructional Systems: First International Conference, AIS 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Orlando, FL, USA, July 26–31, 2019, Proceedings 21, pages 572–589. Springer, 2019.
- Kurt VanLehn. The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational psychologist, 46(4):197–221, 2011.
- Generating role-playing game quests with GPT language models. IEEE Transactions on Games, 2022.
- Prevalence and prevention of large language model use in crowd work. arXiv preprint arXiv:2310.15683, abs/2310.15683, 2023.
- Generative ai and the workforce: What are the risks? Available at SSRN, 2023.
- Dylan Walsh. Legal issues presented by generative AI. https://mitsloan.mit.edu/ideas-made-to-matter/legal-issues-presented-generative-ai, 2023. Accessed: 2024-02-28.
- Human-AI collaboration in data science: Exploring data scientists’ perceptions of automated AI. Proceedings of the ACM on human-computer interaction, 3(CSCW):1–24, 2019.
- Is chatGPT a good teacher coach? measuring zero-shot performance for scoring and providing actionable insights on classroom instruction. In 18th Workshop on Innovative Use of NLP for Building Educational Applications, June 2023.
- Yifei Wang. The large language model (LLM) paradox: Job creation and loss in the age of advanced AI. TechRxiv Preprint, 2023. Available at TechRxiv: [URL].
- Chain of thought prompting elicits reasoning in large language models. arXiv preprint arXiv:2201.11903, 2022.
- Zero-shot information extraction via chatting with ChatGPT. arXiv preprint arXiv:2302.10205, 2023.
- Perfection not required? human-AI partnerships in code translation. In 26th International Conference on Intelligent User Interfaces, IUI ’21, page 402–412, New York, NY, USA, 2021. Association for Computing Machinery.
- AI enabled sign language recognition and vr space bidirectional communication using triboelectric smart glove. Nature Communications, 12:5378, 09 2021.
- On the road with GPT-4V(ision): Early explorations of visual-language model on autonomous driving. arXiv preprint arXiv:2311.05332, 2023.
- The effectiveness of intelligent tutoring on training in a video game. In 2013 IEEE International Games Innovation Conference (IGIC), pages 267–274. IEEE, 2013.
- The role and limits of principles in ai ethics: Towards a focus on tensions. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, pages 195–200, 2019.
- How knowledge workers think generative AI will (not) transform their industries. arXiv preprint arXiv:2310.06778, 2023.
- AI chains: Transparent and controllable human-AI interaction by chaining large language model prompts. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI ’22, New York, NY, USA, 2022. Association for Computing Machinery.
- Ai chains: Transparent and controllable human-AI interaction by chaining large language model prompts. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, 2021.
- Exploring large language models for communication games: An empirical study on werewolf. arXiv preprint arXiv:2309.04658, 2023.
- Human-centric autonomous systems with LLMs for user command reasoning. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops, pages 988–994, January 2024.
- Beyond labels: Empowering human annotators with natural language explanations through a novel active-learning architecture. In Houda Bouamor, Juan Pino, and Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, pages 11629–11643, Singapore, December 2023. Association for Computational Linguistics.
- Local privacy protection classification based on human-centric computing. Human-centric Computing and Information Sciences, 9:1–14, 2019.
- Distilling and retrieving generalizable knowledge for robot manipulation via language corrections. ArXiv, abs/2311.10678, 2023.
- Investigating AI teammate communication strategies and their impact in human-ai teams for effective teamwork. Proceedings of the ACM on Human-Computer Interaction, 7:1–31, 2023.
- "An ideal human" expectations of AI teammates in human-AI teaming. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3):1–25, 2021.
- Towards trustworthy human-AI teaming under uncertainty. In IJCAI 2019 workshop on explainable AI (XAI), 2019.
- Fine-tuning language models from human preferences. arXiv preprint arXiv:1909.08593, 2019.
- Vanshika Vats (5 papers)
- Marzia Binta Nizam (3 papers)
- Minghao Liu (44 papers)
- Ziyuan Wang (33 papers)
- Richard Ho (5 papers)
- Mohnish Sai Prasad (1 paper)
- Vincent Titterton (1 paper)
- Sai Venkat Malreddy (1 paper)
- Riya Aggarwal (2 papers)
- Yanwen Xu (1 paper)
- Lei Ding (58 papers)
- Jay Mehta (1 paper)
- Nathan Grinnell (1 paper)
- Li Liu (311 papers)
- Sijia Zhong (3 papers)
- Devanathan Nallur Gandamani (1 paper)
- Xinyi Tang (7 papers)
- Rohan Ghosalkar (1 paper)
- Celeste Shen (1 paper)
- Rachel Shen (1 paper)