MathWriting: A Dataset For Handwritten Mathematical Expression Recognition
Abstract: Recognition of handwritten mathematical expressions allows to transfer scientific notes into their digital form. It facilitates the sharing, searching, and preservation of scientific information. We introduce MathWriting, the largest online handwritten mathematical expression dataset to date. It consists of 230k human-written samples and an additional 400k synthetic ones}. This dataset can also be used in its rendered form for offline HME recognition. One MathWriting sample consists of a formula written on a touch screen and a corresponding LaTeX expression. We also provide a normalized version of LaTeX expression to simplify the recognition task and enhance the result quality. We provide baseline performance of standard models like OCR and CTC Transformer as well as Vision-LLMs like PaLI on the dataset. The dataset together with an example colab is accessible on Github.
- Aida calculus math handwriting recognition dataset. https://www.kaggle.com/datasets/aidapearson/ocr-data.
- Detexify data. https://github.com/kirel/detexify-data.
- Exploring length generalization in large language models, 2022.
- Fast multi-language lstm-based online handwriting recognition, 2020.
- Pali: A jointly-scaled multilingual language-image model, 2023.
- Image-to-markup generation with coarse-to-fine attention, 2017.
- Representing online handwriting for recognition in large vision-language models, 2024.
- Google Cloud. Detect handwriting in image, 2023. URL https://cloud.google.com/document-ai/docs/enterprise-document-ocr#ocr_add_ons.
- Connectionist temporal classification: Labelling unsegmented sequence data with recurrent neural networks. In Proceedings of the 23rd International Conference on Machine Learning, ICML ’06, pp. 369–376, New York, NY, USA, 2006. Association for Computing Machinery. ISBN 1595933832. doi: 10.1145/1143844.1143891. URL https://doi.org/10.1145/1143844.1143891.
- IAM-OnDB-an on-line english sentence database acquired from handwritten text on a whiteboard. In ICDAR’05. IEEE, 2005.
- Evaluating sequence-to-sequence models for handwritten text recognition, 2019.
- On the relation between position information and sentence length in neural machine translation. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pp. 328–338, Hong Kong, China, November 2019. Association for Computational Linguistics. doi: 10.18653/v1/K19-1031. URL https://aclanthology.org/K19-1031.
- DSS: Synthesizing Long Digital Ink Using Data Augmentation, Style Encoding and Split Generation, pp. 217–235. Springer Nature Switzerland, 2023. ISBN 9783031416859. doi: 10.1007/978-3-031-41685-9_14. URL http://dx.doi.org/10.1007/978-3-031-41685-9_14.
- Sequence length is a domain: Length-based overfitting in transformer models. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2021a. doi: 10.18653/v1/2021.emnlp-main.650. URL http://dx.doi.org/10.18653/v1/2021.emnlp-main.650.
- Sequence length is a domain: Length-based overfitting in transformer models. pp. 8246–8257, 01 2021b. doi: 10.18653/v1/2021.emnlp-main.650.
- ICDAR 2023 CROHME: Competition on Recognition of Handwritten Mathematical Expressions, pp. 553–565. 08 2023. ISBN 978-3-031-41678-1. doi: 10.1007/978-3-031-41679-8_33.
- Syntax-aware network for handwritten mathematical expression recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 4553–4562, 2022.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.