Computation used to train notable artificial intelligence systems

Computation is measured in total petaFLOP, which is 10¹⁵ floating-point operations.

Publication dateJul 2, 1950Apr 19, 1965Dec 27, 1978Sep 4, 1992May 14, 2006Jan 21, 2020Trainingcompute(petaFLOP)TheseusTheseusPerceptron Mark IPerceptron Mark INeocognitronNeocognitronBack-propagationBack-propagationSystem 11System 11Decision tree (classification)Decision tree (classification)MitosisMitosisGNMTGNMTObjectNetObjectNetTask domainDrawingDrivingGamesLanguageMultimodalOtherSpeechVisionOther

Source: Epoch (2023)

Note: Computation is estimated based on published results in the AI literature and comes with some uncertainty. The authors expect most of these estimates to be correct within a factor of 2, and a factor of5 for recent models for which relevant numbers were not disclosed, such as GPT-4.

Jul 2, 1950
May 10, 2023