Exact Parameter Count of GPT-4
Determine the exact number of parameters in GPT-4 to enable precise comparisons of model scale against other large language models and to contextualize performance differences observed on the Japanese financial benchmark.
References
Although the number of parameters in GPT-4 has not been determined, it is estimated to be more than 500 billion.
— Construction of a Japanese Financial Benchmark for Large Language Models
(2403.15062 - Hirano, 22 Mar 2024) in Discussion (Section 5)