Note: A research collective is a group of AI researchers who are not organized under an academic or industry affiliation; e.g., EleutherAI. Computation is estimated based on published results in the AIliterature and comes with some uncertainty. The authors expect most of these estimates to be correct within a factor of 2, and a factor of 5 for recent models for which relevant numbers were not disclosed,such as GPT-4.