Temporal Information Extraction by Predicting Relative Time-lines (1808.09401v2)
Abstract: The current leading paradigm for temporal information extraction from text consists of three phases: (1) recognition of events and temporal expressions, (2) recognition of temporal relations among them, and (3) time-line construction from the temporal relations. In contrast to the first two phases, the last phase, time-line construction, received little attention and is the focus of this work. In this paper, we propose a new method to construct a linear time-line from a set of (extracted) temporal relations. But more importantly, we propose a novel paradigm in which we directly predict start and end-points for events from the text, constituting a time-line without going through the intermediate step of prediction of temporal relations as in earlier work. Within this paradigm, we propose two models that predict in linear complexity, and a new training loss using TimeML-style annotations, yielding promising results.
- James F Allen. 1990. Maintaining knowledge about temporal intervals. Readings in Qualitative Reasoning about Physical Systems, pages 361–372.
- Steven Bethard. 2013. ClearTK-TimeML: A minimalist approach to tempeval 2013. In Proceedings of SemEval, volume 2, pages 10–14. ACL.
- Timelines from text: Identification of syntactic temporal relations. In Proceedings of ICSC, pages 11–18.
- Semeval-2016 task 12: Clinical tempeval. In Proceedings of SemEval, pages 1052–1062. ACL.
- SemEval-2017 Task 12: Clinical TempEval. In Proceedings of SemEval, pages 565–572. ACL.
- An annotation framework for dense event ordering. In Proceedings of ACL, pages 501–506. ACL.
- Dense event ordering with a multi-pass architecture. Transactions of the Association for Computational Linguistics, 2:273–284.
- Nathanael Chambers and Dan Jurafsky. 2008. Jointly combining implicit constraints improves temporal ordering. In Proceedings of EMNLP, pages 698–706. ACL.
- Fei Cheng and Yusuke Miyao. 2017. Classifying temporal relations by bidirectional LSTM over dependency paths. In Proceedings of ACL, volume 2, pages 1–6. ACL.
- Pascal Denis and Philippe Muller. 2011. Predicting globally-coherent temporal structures from texts via endpoint inference and graph decomposition. In Proceedings of IJCAI, pages 1788–1793.
- Leon RA Derczynski. 2017. Automatically Ordering Events and Times in Text, volume 677. Springer.
- Neural temporal relation extraction. In Proceedings of EACL, volume 2, pages 746–751.
- Joint inference for event timeline construction. In Proceedings of EMNLP-CoNLL, pages 677–687. ACL.
- Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation, 9(8):1735–1780.
- Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
- Stacking approach to temporal relation classification. Journal of Natural Language Processing, 22(3):171–196.
- Artuur Leeuwenberg and Marie-Francine Moens. 2017. Structured learning for temporal relation extraction from clinical records. In Proceedings of EACL, volume 1, pages 1150–1158. ACL.
- Multilayered temporal modeling for the clinical domain. Journal of the American Medical Informatics Association, 23(2):387–395.
- Machine learning of temporal relations. In Proceedings of COLING-ACL, pages 753–760. ACL.
- Paramita Mirza and Sara Tonelli. 2016. CATENA : Causal and temporal relation extraction from natural language texts. Proceedings of COLING, pages 64–75.
- Nelson Morgan and Hervé Bourlard. 1990. Generalization and parameter estimation in feedforward nets: Some experiments. In Advances in Neural Information Processing Systems.
- A structured learning approach to temporal relation extraction. Proceedings of EMNLP, pages 1038–1048.
- A multi-axis annotation scheme for event temporal relations. In Proceedings of ACL, pages 1318–1328. ACL.
- The TIMEBANK Corpus. Natural Language Processing and Information Systems, 4592:647–656.
- Temporal anchoring of events for the timebank corpus. Proceedings of ACL, pages 2195–2204.
- Event time extraction with a decision tree of neural classifiers. Transactions of the Association for Computational Linguistics, 6:77–89.
- Neural architecture for temporal relation extraction: A Bi-LSTM approach for detecting narrative containers. In Proceedings of ACL, pages 224–230.
- Feature-rich part-of-speech tagging with a cyclic dependency network. In Proceedings of NAACL-HLT, pages 173–180. ACL.
- Naushad UzZaman and James F. Allen. 2011. Temporal evaluation. In Proceedings of ACL, HLT ’11, pages 351–356, Stroudsburg, PA, USA. ACL.
- Semeval-2013 task 1: Tempeval-3: Evaluating time expressions, events, and temporal relations. Second joint conference on lexical and computational semantics (* SEM), 2:1–9.
- Constraint propagation algorithms for temporal reasoning: A revised report. In Readings in Qualitative Reasoning about Physical Systems, pages 373–381. Elsevier.
- Jointly identifying temporal relations with markov logic. In Proceedings of ACL-IJCNLP, pages 405–413. ACL.