2000 character limit reached
Comparative Analysis of Named Entity Recognition in the Dungeons and Dragons Domain
Published 29 Sep 2023 in cs.CL and cs.LG | (2309.17171v1)
Abstract: Many NLP tasks, although well-resolved for general English, face challenges in specific domains like fantasy literature. This is evident in Named Entity Recognition (NER), which detects and categorizes entities in text. We analyzed 10 NER models on 7 Dungeons and Dragons (D&D) adventure books to assess domain-specific performance. Using open-source LLMs, we annotated named entities in these books and evaluated each model's precision. Our findings indicate that, without modifications, Flair, Trankit, and Spacy outperform others in identifying named entities in the D&D context.
- Contextual string embeddings for sequence labeling. In COLING 2018, 27th International Conference on Computational Linguistics, pages 1638–1649.
- The Wild Beyond the Witchlight. Wizards of the Coast.
- Lost mine of phandelver. Wizards of the Coast.
- Jean Baptiste. 2022. roberta-large-ner-english: model fine-tuned from roberta-large for ner task. https://huggingface.co/Jean-Baptiste/roberta-large-ner-english. (Accessed on 05/10/2023).
- Hoard of the Dragon Queen. Wizards of the Coast.
- Rise of Tiamat. Wizards of the Coast.
- M Benesty. 2019. Ner algo benchmark: spacy, flair, m-bert and camembert on anonymizing french commercial legal cases. Towar. Data Sci.
- Automated deidentification of radiology reports combining transformer and “hide in plain sight” rule-based methods. Journal of the American Medical Informatics Association, 30(2):318–328.
- Electra: Pre-training text encoders as discriminators rather than generators. In International Conference on Learning Representations.
- Unsupervised cross-lingual representation learning at scale. arXiv preprint arXiv:1911.02116.
- Databricks. 2023. Dolly: The first open source, commercially viable instruction-tuned llm. Databricks Blog.
- Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
- Xinyang Geng and Hao Liu. 2023. Openllama: An open reproduction of llama.
- Gary Gygax and Dave Arneson. 1974. dungeons & dragons, volume 19. Tactical Studies Rules Lake Geneva, WI.
- Matthew Honnibal and Ines Montani. 2017. spacy 2: Natural language understanding with bloom embeddings, convolutional neural networks and incremental parsing. To appear.
- Transformer-based artificial neural networks for the conversion between chemical notations. Scientific Reports, 11(1):1–10.
- Chinese named entity recognition: The state of the art. Neurocomputing, 473:37–53.
- Behrang Mohit. 2014. Named entity recognition. Natural language processing of semitic languages, pages 221–245.
- Named entity recognition (ner) in nlp techniques, tools accuracy and performance. Pakistan Journal of Multidisciplinary Research, 2(2):293–308.
- Trankit: A light-weight transformer-based toolkit for multilingual natural language processing. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics.
- Akila Peiris and Nisansa de Silva. 2022. Synthesis and evaluation of a domain-specific large data set for dungeons & dragons. arXiv preprint arXiv:2212.09080.
- Akila Peiris and Nisansa de Silva. 2023. SHADE: semantic hypernym annotator for Domain-Specific entities - DnD domain use case. In 2023 IEEE 17th International Conference on Industrial and Information Systems (ICIIS), page 6, Peradeniya, Sri Lanka.
- Candlekeep Mysteries. Wizards of the Coast.
- Tomb of Annihilation. Wizards of the Coast.
- Curse of Strahd. Wizards of the Coast.
- Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint arXiv:2211.05100.
- Controlling neural networks with rule representations. Advances in Neural Information Processing Systems, 34:11196–11207.
- Named entity recognition approaches and their comparison for custom ner model. Science & Technology Libraries, 39(3):324–337.
- Nisansa de Silva and Dejing Dou. 2021. Semantic oppositeness assisted deep contextual modeling for automatic rumor detection in social networks. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 405–415, Online. Association for Computational Linguistics.
- Discovering inconsistencies in pubmed abstracts through ontology-based information extraction. In Proceedings of the 8th ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics, pages 362–371.
- Portuguese named entity recognition using bert-crf. arXiv preprint arXiv:1909.10649.
- Synergistic union of word2vec and lexicon for domain specific semantic similarity. In 2017 IEEE international conference on industrial and information systems (ICIIS), pages 1–6. IEEE.
- WikiNEuRal: Combined neural and knowledge-based silver data creation for multilingual NER. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 2521–2533.
- George R Terrell and David W Scott. 1992. Variable kernel density estimation. The Annals of Statistics, pages 1236–1265.
- Erik F. Tjong Kim Sang and Fien De Meulder. 2003. Introduction to the CoNLL-2003 shared task: Language-independent named entity recognition. In Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003, pages 142–147.
- Enhanced named entity recognition with semantic dependency. In PRICAI 2021: Trends in Artificial Intelligence: 18th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2021, Hanoi, Vietnam, November 8–12, 2021, Proceedings, Part II 18, pages 287–298. Springer.
- Ralph Weischedel et al. 2013. Ontonotes release 5.0 ldc2013t19. Web Download.
- Adapt-and-distill: Developing small, fast and effective pretrained language models for domains. arXiv preprint arXiv:2106.13474.
- José P Zagal and Sebastian Deterding. 2018. Definitions of “role-playing games”. In Role-Playing Game Studies, pages 19–51. Routledge.
- An ai dungeon master’s guide: Learning to converse and guide with intents and theory-of-mind in dungeons and dragons. arXiv preprint arXiv:2212.10060.
Paper Prompts
Sign up for free to create and run prompts on this paper.