Dataset Mention Extraction in Scientific Articles Using Bi-LSTM-CRF Model
Abstract: Datasets are critical for scientific research, playing an important role in replication, reproducibility, and efficiency. Researchers have recently shown that datasets are becoming more important for science to function properly, even serving as artifacts of study themselves. However, citing datasets is not a common or standard practice in spite of recent efforts by data repositories and funding agencies. This greatly affects our ability to track their usage and importance. A potential solution to this problem is to automatically extract dataset mentions from scientific articles. In this work, we propose to achieve such extraction by using a neural network based on a Bi-LSTM-CRF architecture. Our method achieves F1 = 0.885 in social science articles released as part of the Rich Context Dataset. We discuss the limitations of the current datasets and propose modifications to the model to be done in the future.
- Coleridge Initiative (2019). Rich context competition.
- A semi-automatic approach for detecting dataset references in social science texts. Information Services & Use, 36(3-4):171–187.
- Identifying and Improving Dataset References in Social Sciences Full Texts. arXiv:1603.01774 [cs].
- Speech recognition with deep recurrent neural networks. In Acoustics, speech and signal processing (icassp), 2013 ieee international conference on, pages 6645–6649. IEEE.
- Long short-term memory. Neural computation, 9(8):1735–1780.
- Exploring the limits of language modeling. arXiv preprint arXiv:1602.02410.
- Conditional random fields: Probabilistic models for segmenting and labeling sequence data.
- A Dataset Search Engine for the Research Document Corpus. In 2012 IEEE 28th International Conference on Data Engineering, pages 1237–1240, Arlington, VA, USA. IEEE.
- On the difficulty of training recurrent neural networks. In International Conference on Machine Learning, pages 1310–1318.
- Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pages 1532–1543.
- Learning character-level representations for part-of-speech tagging. In Xing, E. P. and Jebara, T., editors, Proceedings of the 31st International Conference on Machine Learning, volume 32 of Proceedings of Machine Learning Research, pages 1818–1826, Bejing, China. PMLR.
- Data Extract: Mining Context from the Web for Dataset Extraction. International Journal of Machine Learning and Computing, pages 219–223.
- Introduction to the conll-2003 shared task: Language-independent named entity recognition. In Proceedings of the seventh conference on Natural language learning at HLT-NAACL 2003-Volume 4, pages 142–147. Association for Computational Linguistics.
- Assigning credit to scientific datasets using article citation networks. Journal of Informetrics, 14(2):101013.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
