Computation used to train notable artificial intelligence systems

Computation is measured in total petaFLOP, which is 10¹⁵ floating-point operations.

Note: Computation is estimated based on published results in the AI literature and comes with some uncertainty. The authors expect most of these estimates to be correct within a factor of 2, and a factor of5 for recent models for which relevant numbers were not disclosed, such as GPT-4.