Looks like GPT-4 finished training in August 2022, this aligns with the Morgan Stanley report that GPT-4 was already complete and GPT-5 is in progress with up to 25k GPUs

0