Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
173 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Observations on LLMs for Telecom Domain: Capabilities and Limitations (2305.13102v1)

Published 22 May 2023 in cs.HC, cs.AI, cs.CL, cs.LG, and cs.IR

Abstract: The landscape for building conversational interfaces (chatbots) has witnessed a paradigm shift with recent developments in generative AI based LLMs, such as ChatGPT by OpenAI (GPT3.5 and GPT4), Google's Bard, LLM Meta AI (LLaMA), among others. In this paper, we analyze capabilities and limitations of incorporating such models in conversational interfaces for the telecommunication domain, specifically for enterprise wireless products and services. Using Cradlepoint's publicly available data for our experiments, we present a comparative analysis of the responses from such models for multiple use-cases including domain adaptation for terminology and product taxonomy, context continuity, robustness to input perturbations and errors. We believe this evaluation would provide useful insights to data scientists engaged in building customized conversational interfaces for domain-specific requirements.

Citations (16)

Summary

We haven't generated a summary for this paper yet.