Exact Parameter Count of GPT-4
Determine the exact number of parameters in GPT-4 to enable precise comparisons of model scale against other large language models and to contextualize performance differences observed on the Japanese financial benchmark.
Sponsor
References
Although the number of parameters in GPT-4 has not been determined, it is estimated to be more than 500 billion.
— Construction of a Japanese Financial Benchmark for Large Language Models
(2403.15062 - Hirano, 22 Mar 2024) in Discussion (Section 5)