Musings on AI provides insights on the optimal GPU instance selection on AWS for machine learning engineers. If you are performing High Performance jobs like Drug Discovery or High Precision jobs, the P Instance Family is suggested, while the G Instance Family is recommended for other tasks.
The article also emphasizes not to select the GPU based solely on price. Results of a conducted experiment showed that using a g5.xlarge machine could save 20% of the budget compared to a g4dn.2xlarge machine. Moreover, the g5 family offers benefits such as supporting all precision formats due to the modern NVIDIA Ampere Architecture.