The outcomes of generative AI are exactly the Nash equilibria of a non-potential game (2401.12321v2)

Abstract: In this article we show that the asymptotic outcomes of both shallow and deep neural networks such as those used in BloombergGPT to generate economic time series are exactly the Nash equilibria of a non-potential game. We then design and analyze deep neural network algorithms that converge to these equilibria. The methodology is extended to federated deep neural networks between clusters of regional servers and on-device clients. Finally, the variational inequalities behind LLMs including encoder-decoder related transformers are established.