SpannerLib: Embedding Declarative Information Extraction in an Imperative Workflow
Abstract: Document spanners have been proposed as a formal framework for declarative Information Extraction (IE) from text, following IE products from the industry and academia. Over the past decade, the framework has been studied thoroughly in terms of expressive power, complexity, and the ability to naturally combine text analysis with relational querying. This demonstration presents SpannerLib a library for embedding document spanners in Python code. SpannerLib facilitates the development of IE programs by providing an implementation of Spannerlog (Datalog-based documentspanners) that interacts with the Python code in two directions: rules can be embedded inside Python, and they can invoke custom Python code (e.g., calls to ML-based NLP models) via user-defined functions. The demonstration scenarios showcase IE programs, with increasing levels of complexity, within Jupyter Notebook.
- SystemT: Declarative Text Understanding for Enterprise. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 3 (Industry Papers). Association for Computational Linguistics, New Orleans - Louisiana, 76–83. https://doi.org/10.18653/v1/N18-3010
- A Natural Language Processing System for National COVID-19 Surveillance in the US Department of Veterans Affairs. In Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020.
- Language Models are Few-Shot Learners. In Proceedings NIPS ’20. Article 159, 25 pages.
- Document Spanners: A Formal Approach to Information Extraction. J. ACM 62, 2 (2015), 12.
- Datalog and Recursive Query Processing. Found. Trends Databases 5, 2 (2013), 105–195.
- spaCy: Industrial-strength Natural Language Processing in Python. (2020). https://doi.org/10.5281/zenodo.1212303
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks. In Proceedings of NIPS’ 20. Article 793, 16 pages.
- Incorporating information extraction in the relational database model (WebDB). Association for Computing Machinery, 1–7.
- Optimizing recursive queries with monotonic aggregates in DeALS. In ICDE. IEEE Computer Society, 867–878.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
