A Unified Industrial Large Knowledge Model Framework in Industry 4.0 and Smart Manufacturing (2312.14428v3)
Abstract: The recent emergence of LLMs demonstrates the potential for artificial general intelligence, revealing new opportunities in Industry 4.0 and smart manufacturing. However, a notable gap exists in applying these LLMs in industry, primarily due to their training on general knowledge rather than domain-specific knowledge. Such specialized domain knowledge is vital for effectively addressing the complex needs of industrial applications. To bridge this gap, this paper proposes a unified industrial large knowledge model (ILKM) framework, emphasizing its potential to revolutionize future industries. In addition, ILKMs and LLMs are compared from eight perspectives. Finally, the "6S Principle" is proposed as the guideline for ILKM development, and several potential opportunities are highlighted for ILKM deployment in Industry 4.0 and smart manufacturing.
- Prompting is programming: A query language for large language models. Proceedings of the ACM on Programming Languages, 7(PLDI):1946–1969, 2023.
- Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901, 2020.
- Evaluating large language models trained on code. arXiv preprint arXiv:2107.03374, 2021.
- Deep reinforcement learning from human preferences. Advances in neural information processing systems, 30, 2017.
- Industry 4.0. Business & information systems engineering, 6:239–242, 2014.
- A cyber-physical systems architecture for industry 4.0-based manufacturing systems. Manufacturing letters, 3:18–23, 2015.
- Industrial artificial intelligence for industry 4.0-based manufacturing systems. Manufacturing letters, 18:20–23, 2018.
- Gshard: Scaling giant models with conditional computation and automatic sharding. arXiv preprint arXiv:2006.16668, 2020.
- V. Liu and L. B. Chilton. Design guidelines for prompt engineering text-to-image generative models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pages 1–23, 2022.
- Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730–27744, 2022.
- A survey of the advancing use and development of machine learning in smart manufacturing. Journal of manufacturing systems, 48:170–179, 2018.
- Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538, 2017.
- Industrial internet of things: Challenges, opportunities, and directions. IEEE transactions on industrial informatics, 14(11):4724–4734, 2018.
- Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023.
- Big data opportunities: System health monitoring and management. IEEE Access, 7:68853–68867, 2019.
- Attention is all you need. Advances in neural information processing systems, 30, 2017.
- Deep learning for smart manufacturing: Methods and applications. Journal of manufacturing systems, 48:144–156, 2018.
- Empower large language model to perform better on industrial domain-specific question answering. arXiv preprint arXiv:2305.11541, 2023.
- A prompt pattern catalog to enhance prompt engineering with chatgpt. arXiv preprint arXiv:2302.11382, 2023.
- A survey of large language models. arXiv preprint arXiv:2303.18223, 2023.
- Fine-tuning language models from human preferences. arXiv preprint arXiv:1909.08593, 2019.
Sponsor
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.