Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
41 tokens/sec
GPT-4o
59 tokens/sec
Gemini 2.5 Pro Pro
41 tokens/sec
o3 Pro
7 tokens/sec
GPT-4.1 Pro
50 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Comprehensive Survey on AI-based Methods for Patents (2404.08668v2)

Published 2 Apr 2024 in cs.IR and cs.AI

Abstract: Recent advancements in AI and machine learning have demonstrated transformative capabilities across diverse domains. This progress extends to the field of patent analysis and innovation, where AI-based tools present opportunities to streamline and enhance important tasks in the patent cycle such as classification, retrieval, and valuation prediction. This not only accelerates the efficiency of patent researchers and applicants but also opens new avenues for technological innovation and discovery. Our survey provides a comprehensive summary of recent AI tools in patent analysis from more than 40 papers from 26 venues between 2017 and 2023. Unlike existing surveys, we include methods that work for patent image and text data. Furthermore, we introduce a novel taxonomy for the categorization based on the tasks in the patent life cycle as well as the specifics of the AI methods. This interdisciplinary survey aims to serve as a resource for researchers and practitioners who are working at the intersection of AI and patent analysis as well as the patent offices that are aiming to build efficient patent systems.

PDF HTML Abstract
Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Bookmark Chat Bubble Oval Streamline Icon: https://streamlinehq.com Chat (Pro)
Definition Search Book Streamline Icon: https://streamlinehq.com
References (60)
  1. Linguistically informed masking for representation learning in the patent domain. arXiv preprint arXiv:2106.05768, 2021.
  2. L. Aristodemou. Identifying valuable patents: A deep learning approach. PhD thesis, 2021.
  3. Scibert: A pretrained language model for scientific text. In EMNLP, 2019.
  4. Classifying patent applications with ensemble methods. ALTA Workshop, 2018.
  5. A deep learning based method for extracting semantic information from patent documents. Scientometrics, 125:289–312, 2020.
  6. Establish a patent risk prediction model for emerging technologies using deep learning and data augmentation. Advanced Engineering Informatics, 52:101509, 2022.
  7. Learning phrase representations using rnn encoder-decoder for statistical machine translation. ACL, 2014.
  8. Deep learning for patent landscaping using transformer and graph embedding. Technological Forecasting and Social Change, 175, 2022.
  9. P. Chung and S. Y. Sohn. Early detection of valuable patents using a deep learning model: Case of semiconductor industry. Technological Forecasting and Social Change, 158:120146, 2020.
  10. Arcface: Additive angular margin loss for deep face recognition. In CVPR, 2019.
  11. Bert: Pre-training of deep bidirectional transformers for language understanding. NAACL-HLT, 2019.
  12. Predicting patent quality based on machine learning approach. IEEE Trans Eng Manag, 2022.
  13. Eurostat, O. Oslo Manual: Guidelines for Collecting and Interpreting Innovation Data. OECD, Paris, 2005. A joint publication of OECD and Eurostat.
  14. Classification of visualization types and perspectives in patents. In TPDL, 2023.
  15. Unveiling the inventive process from patents by extracting problems, solutions and advantages with natural language processing. Expert Systems with Applications, 229:120499, 2023.
  16. A. Graves and J. Schmidhuber. Framewise phoneme classification with bidirectional lstm and other neural network architectures. Neural networks, 18(5-6):602–610, 2005.
  17. Automated patent classification using word embedding. In ICMLA. IEEE, 2017.
  18. Opennre: An open and extensible toolkit for neural relation extraction. In EMNLP, 2019.
  19. Patent image retrieval using cross-entropy-based metric learning. In IW-FCV, 2023.
  20. K. Higuchi and K. Yanai. Patent image retrieval using transformer-based deep metric learning. WPI, 74:102217, 2023.
  21. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural computation, 9(8):1735–1780, 1997.
  22. Deep learning, text, and patent valuation. Text, and Patent Valuation, 2020.
  23. Bidirectional lstm-crf models for sequence tagging. arXiv preprint arXiv:1508.01991, 2015.
  24. An explainable ai (xai) model for text-based patent novelty analysis. Expert Systems with Applications, 2023.
  25. Deriving design feature vectors for patent images using convolutional neural networks. Journal of Mechanical Design, 143(6):061405, 2021.
  26. Bag of tricks for efficient text classification. In EACL, 2017.
  27. An ensemble framework for patent classification. WPI, 75:102233, 2023.
  28. Automated single-label patent classification using ensemble classifiers. In ICMLC, 2022.
  29. Patent prior art search using deep learning language model. In IDEAS, 2020.
  30. X. Krant. Text-based Patent-Quality Prediction Using Multi-Section Attention. PhD thesis, 2023.
  31. Patents images retrieval and convolutional neural network training dataset quality improvement. In ITSMSSM, 2017.
  32. A survey on deep learning for patent analysis. WPI, 65:102035, 2021.
  33. Deeppatent: Large scale patent drawing recognition and retrieval. In WACV, 2022.
  34. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11):2278–2324, 1998.
  35. J.-S. Lee. Patent transformer: A framework for personalized patent claim generation. In CEUR Workshop Proceedings, volume 2598. CEUR-WS, 2020.
  36. J.-S. Lee. Evaluating generative patent language models. WPI, 72, 2023.
  37. J.-S. Lee and J. Hsiang. Patent claim generation by fine-tuning openai gpt-2. WPI, 62:101983, 2020.
  38. J.-S. Lee and J. Hsiang. Patent classification grawe-tuning bert language model. WPI, 61:101965, 2020.
  39. A deep learning-based early patent quality recognition model. In ICNC-FSKD, 2022.
  40. Patent quality valuation with deep learning models. In DASFAA, 2018.
  41. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692, 2019.
  42. Efficient estimation of word representations in vector space. In ICLR, 2013.
  43. Representation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018.
  44. A multimodal approach for semantic patent image retrieval. In PatentSemTech, 2021.
  45. Language models are unsupervised multitask learners. OpenAI blog, 1:9, 2019.
  46. N. Reimers and I. Gurevych. Sentence-bert: Sentence embeddings using siamese bert-networks. EMNLP, 2019.
  47. Patentmatch: A dataset for matching patent claims & prior art. In PatentSemTech@SIGIR, 2021.
  48. J. Risch and R. Krestel. Learning patent speak: Investigating domain-specific word embeddings. In ICDIM, 2018.
  49. J. Risch and R. Krestel. Domain-specific word embeddings for patent classification. Data Technologies and Applications, 53(1), 2019.
  50. Patentnet: multi-label classification of patent documents using deep learning based language understanding. Scientometrics, pages 1–25, 2022.
  51. Artificial intelligence for patent prior art searching. WPI, 2021.
  52. An lstm approach to patent classification based on fixed hierarchy vectors. In SDM, 2018.
  53. Enhancing patent retrieval using text and knowledge graph embeddings: a technical note. Journal of Engineering Design, 33:670–683, 2022.
  54. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In ICLR, 2015.
  55. M. Sofean. Deep learning based pipeline with multichannel inputs for patent classification. WPI, 66:102060, 2021.
  56. Machine learning methods for results merging in patent retrieval. Data Technologies and Applications, 2023.
  57. Patent value analysis using deep learning models—the case of iot technology mining for the manufacturing industry. IEEE-TEM, 68(5):1334–1346, 2019.
  58. Xlnet: Generalized autoregressive pretraining for language understanding. NeurIPS, 2019.
  59. Identifying patent classification codes associated with specific search keywords using machine learning. WPI, 71:102153, 2022.
  60. Event-based dynamic graph representation learning for patent application trend prediction. IEEE TKDE, 2023.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Homaira Huda Shomee (1 paper)
  2. Zhu Wang (72 papers)
  3. Sathya N. Ravi (21 papers)
  4. Sourav Medya (36 papers)
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets