Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
125 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Attention based End to end network for Offline Writer Identification on Word level data (2404.07602v1)

Published 11 Apr 2024 in cs.CV and cs.LG

Abstract: Writer identification due to its widespread application in various fields has gained popularity over the years. In scenarios where optimum handwriting samples are available, whether they be in the form of a single line, a sentence, or an entire page, writer identification algorithms have demonstrated noteworthy levels of accuracy. However, in scenarios where only a limited number of handwritten samples are available, particularly in the form of word images, there is a significant scope for improvement. In this paper, we propose a writer identification system based on an attention-driven Convolutional Neural Network (CNN). The system is trained utilizing image segments, known as fragments, extracted from word images, employing a pyramid-based strategy. This methodology enables the system to capture a comprehensive representation of the data, encompassing both fine-grained details and coarse features across various levels of abstraction. These extracted fragments serve as the training data for the convolutional network, enabling it to learn a more robust representation compared to traditional convolution-based networks trained on word images. Additionally, the paper explores the integration of an attention mechanism to enhance the representational power of the learned features. The efficacy of the proposed algorithm is evaluated on three benchmark databases, demonstrating its proficiency in writer identification tasks, particularly in scenarios with limited access to handwriting data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (58)
  1. W. Chi, J. Wang, and M. Q.-H. Meng, “A gait recognition method for human following in service robots,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 48, no. 9, pp. 1429–1440, 2018.
  2. R. Fernandez-de Sevilla, F. Alonso-Fernandez, J. Fierrez, and J. Ortega-Garcia, “Forensic writer identification using allographic features,” in 2010 12th International Conference on Frontiers in Handwriting Recognition, 2010, pp. 308–313.
  3. M. Bulacu, R. van Koert, L. Schomaker, and T. van der Zant, “Layout analysis of handwritten historical documents for searching the archive of the cabinet of the dutch queen,” in Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), vol. 1, 2007, pp. 357–361.
  4. S. He, P. Sammara, J. Burgers, and L. Schomaker, “Towards style-based dating of historical documents,” in 2014 14th International Conference on Frontiers in Handwriting Recognition, 2014, pp. 265–270.
  5. M. Faundez-Zanuy, J. Fierrez, M. Ferrer, M. Diaz, R. Tolosana, and R. Plamondon, “Handwriting biometrics: Applications and future trends in e-security and e-health,” Cognitive Computation, vol. 12, 09 2020.
  6. A. Rehman, S. Naz, M. I. Razzak, and I. A. Hameed, “Automatic visual features for writer identification: A deep learning approach,” IEEE Access, vol. 7, pp. 17 149–17 157, 2019.
  7. H. Said, T. Tan, and K. Baker, “Personal identification based on handwriting,” Pattern Recognition, vol. 33, no. 1, pp. 149–160, 2000.
  8. B. Helli and M. E. Moghaddam, “A text-independent persian writer identification based on feature relation graph (frg),” Pattern Recogn., vol. 43, no. 6, p. 2199–2209, jun 2010.
  9. Z. He, X. You, and Y. Y. Tang, “Writer identification using global wavelet-based features,” Neurocomput., vol. 71, no. 10–12, p. 1832–1841, jun 2008.
  10. C. Shen, X.-G. Ruan, and T.-L. Mao, “Writer identification using gabor wavelet,” in Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527), vol. 3, 2002, pp. 2061–2064 vol.3.
  11. D. Bertolini, L. Soares de Oliveira, E. Justino, and R. Sabourin, “Texture-based descriptors for writer identification and verification,” Expert Systems with Applications, vol. 40, p. 2069–2080, 05 2013.
  12. Y. Hannad, I. Siddiqi, and Y. Elkettani, “Writer identification using texture descriptors of handwritten fragments,” Expert Systems with Applications, vol. 47, pp. 14–22, 11 2016.
  13. D. Chawki and S.-M. Labiba, “A texture based approach for arabic writer identification and verification,” in 2010 International Conference on Machine and Web Intelligence, 2010, pp. 115–120.
  14. A. J. Newell and L. D. Griffin, “Writer identification using oriented basic image features and the delta encoding,” Pattern Recogn., vol. 47, no. 6, p. 2255–2265, Jun. 2014.
  15. G. Abdeljalil, C. Djeddi, I. Siddiqi, and S. Al-Maadeed, “Writer identification on historical documents using oriented basic image features,” in 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR).   IEEE, 2018, pp. 369–373.
  16. L. Schomaker, K. Franke, and M. Bulacu, “Using codebooks of fragmented connected-component contours in forensic and historic writer identification,” Pattern Recognition Letters, vol. 28, pp. 719–727, 04 2007.
  17. L. Schomaker and M. Bulacu, “Automatic writer identification using connected-component contours and edge-based features of uppercase western script,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 787–798, 2004.
  18. M. Khemakhem and M. Kheakhem, “A model-based approach to offline text-independent arabic writer identification and verification,” Pattern Recognition, vol. 48, 10 2014.
  19. A. Bensefia, T. Paquet, and L. Heutte, “A writer identification and verification system,” Pattern Recognition Letters, vol. 26, pp. 2080–2092, 10 2005.
  20. I. Siddiqi and N. Vincent, “Text independent writer recognition using redundant writing patterns with contour-based orientation and curvature features,” Pattern Recognition, vol. 43, pp. 3853–3865, 11 2010.
  21. G. Ghiasi and R. Safabakhsh, “Offline text-independent writer identification using codebook and efficient code extraction methods,” Image and Vision Computing, vol. 31, p. 379–391, 05 2013.
  22. L. Schomaker, M. Wiering, and H. Sheng, “Junction detection in handwritten documents and its application to writer identification,” Pattern Recognition, vol. 48, 06 2015.
  23. R. Jain and D. Doermann, “Offline writer identification using k-adjacent segments,” in 2011 International Conference on Document Analysis and Recognition, 2011, pp. 769–773.
  24. Y. Tangl, X. Wu, and W. Bu, “Offline text-independent writer identification using stroke fragment and contour based features,” Proceedings of 2013 International Conference on Biometrics, pp. 1–6, 01 2013.
  25. E. Khalifa, S. A. Al-Maadeed, M. A. Tahir, A. Bouridane, and A. Jamshed, “Off-line writer identification using an ensemble of grapheme codebook features,” Pattern Recognit. Lett., vol. 59, pp. 18–25, 2015.
  26. S. Fiel and R. Sablatnig, “Writer identification and retrieval using a convolutional neural network,” in International Conference on Computer Analysis of Images and Patterns.   Springer, 2015, pp. 26–37.
  27. V. Christlein, D. Bernecker, A. Maier, and E. Angelopoulou, “Offline writer identification using convolutional neural network activation features,” in German Conference on Pattern Recognition.   Springer, 2015, pp. 540–552.
  28. V. Christlein, M. Gropp, S. Fiel, and A. Maier, “Unsupervised feature learning for writer identification and writer retrieval,” in 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), vol. 1.   IEEE, 2017, pp. 991–997.
  29. V. Christlein, D. Bernecker, F. Hnig, A. Maier, and E. Angelopoulou, “Writer identification using gmm supervectors and exemplar-svms,” Pattern Recogn., vol. 63, no. C, p. 258–267, Mar. 2017.
  30. S. Chen, Y. Wang, C.-T. Lin, W. Ding, and Z. Cao, “Semi-supervised feature learning for improving writer identification,” Information Sciences, vol. 482, pp. 156–170, 2019.
  31. A. Sulaiman, K. Omar, M. F. Nasrudin, and A. Arram, “Length independent writer identification based on the fusion of deep and hand-crafted descriptors,” IEEE Access, vol. 7, pp. 91 772–91 784, 2019.
  32. A. Semma, Y. Hannad, I. Siddiqi, S. Lazrak, and Y. Elkettani, “Feature learning and encoding for multi-script writer identification,” International Journal on Document Analysis and Recognition (IJDAR), 02 2022.
  33. W. Yang, L. Jin, and M. Liu, “Deepwriterid: An end-to-end online text-independent writer identification system,” IEEE Intelligent Systems, vol. 31, no. 2, pp. 45–53, 2016.
  34. L. Xing and Y. Qiao, “Deepwriter: A multi-stream deep cnn for text-independent writer identification,” in 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR), 2016, pp. 584–589.
  35. H. Sheng and L. Schomaker, “Deep adaptive learning for writer identification based on single handwritten word images,” Pattern Recognition, vol. 88, 11 2018.
  36. S. He and L. Schomaker, “Fragnet: Writer identification using deep fragment networks,” IEEE Transactions on Information Forensics and Security, vol. 15, pp. 3013–3022, 2020.
  37. S. He and L. Schomaker, “Gr-rnn: Global-context residual recurrent neural networks for writer identification,” Pattern Recognit., vol. 117, p. 107975, 2021.
  38. M. A. Shaikh, T. Duan, M. Chauhan, and S. N. Srihari, “Attention based writer independent verification,” in 2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR), 2020, pp. 373–379.
  39. Z. Chen, H.-X. Yu, A. Wu, and W.-S. Zheng, “Letter-Level Online Writer Identification,” International Journal of Computer Vision, vol. 129, 05 2021.
  40. P. Zhang, “Rstc: A new residual swin transformer for offline word-level writer identification,” IEEE Access, vol. 10, pp. 57 452–57 460, 2022.
  41. D. G. Lowe, “Distinctive image features from scale-invariant keypoints,” Int. J. Comput. Vision, vol. 60, no. 2, p. 91–110, Nov. 2004.
  42. S. Ruder, “An overview of multi-task learning in deep neural networks,” arXiv preprint arXiv:1706.05098, 2017.
  43. M. Javidi and M. Jampour, “A deep learning framework for text-independent writer identification,” Engineering Applications of Artificial Intelligence, vol. 95, p. 103912, 09 2020.
  44. A. Semma, Y. Hannad, I. Siddiqi, C. Djeddi, and M. E. Y. El Kettani, “Writer identification using deep learning with fast keypoints and harris corner detector,” Expert Systems with Applications, vol. 184, p. 115473, 2021.
  45. H. Nguyen, C. Nguyen, T. Ino, B. Indurkhya, and M. Nakagawa, “Text-independent writer identification using convolutional neural network,” Pattern Recognition Letters, vol. 121, 07 2018.
  46. A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint arXiv:1704.04861, 2017.
  47. L. Fei-Fei, R. Fergus, and P. Perona, “One-shot learning of object categories,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 594–611, 2006.
  48. B. Lake, R. Salakhutdinov, J. Gross, and J. Tenenbaum, “One shot learning of simple visual concepts,” in Proceedings of the 33rd Annual Conference of the Cognitive Science Society, 2011.
  49. B. M. Lake, R. Salakhutdinov, and J. B. Tenenbaum, “Human-level concept learning through probabilistic program induction,” Science, vol. 350, no. 6266, pp. 1332–1338, 2015.
  50. H. Zhang, I. Goodfellow, D. Metaxas, and A. Odena, “Self-attention generative adversarial networks,” in International conference on machine learning.   PMLR, 2019, pp. 7354–7363.
  51. C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2818–2826.
  52. U.-V. Marti and H. Bunke, “The iam-database: An english sentence database for offline handwriting recognition,” International Journal on Document Analysis and Recognition, vol. 5, pp. 39–46, 11 2002.
  53. F. Kleber, S. Fiel, M. Diem, and R. Sablatnig, “Cvl-database: An off-line database for writer retrieval, writer identification and word spotting,” in 2013 12th International Conference on Document Analysis and Recognition, 2013, pp. 560–564.
  54. X. Wu, Y. Tang, and W. Bu, “Offline text-independent writer identification based on scale invariant feature transform,” IEEE Transactions on Information Forensics and Security, vol. 9, no. 3, pp. 526–536, 2014.
  55. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980, 2014.
  56. A. Brink, J. Smit, M. Bulacu, and L. Schomaker, “Writer identification using directional ink-trace width measurements,” Pattern Recognition, vol. 45, pp. 162–171, 01 2012.
  57. H. Sheng and L. Schomaker, “Beyond ocr: Multi-faceted understanding of handwritten document characteristics,” Pattern Recognition, vol. 63, pp. 321–333, 03 2017.
  58. H. Sheng and L. Schomaker, “Writer identification using curvature-free features,” Pattern Recognition, vol. 63, p. 451–464, 09 2016.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets