38:
196:
202:
94:
474:
151:
Figure 1: Summary of the compute growth trends we found for overall notable models (top left), frontier models (top right), top language models (bottom left) and top models within leading companies (bottom right). All point to a recent trend of 4-5x/year
243:– You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
64:
60:
68:
56:
52:
48:
42:
77:
105:
313:
385:
349:
516:
This file contains additional information, probably added from the digital camera or scanner used to create or digitize it.
473:
468:
37:
148:
405:
333:
369:
297:
519:
If the file has been modified from its original state, some details may not fully reflect the modified file.
212:
505:
209:
484:
113:
149:
https://epochai.org/blog/training-compute-of-frontier-ai-models-grows-by-4-5x-per-year
100:
161:
491:
Uploaded a work by Epoch AI from https://epochai.org/blog with UploadWizard
441:
Click on a date/time to view the file as it appeared at that time.
88:
171:
82:(SVG file, nominally 801 × 724 pixels, file size: 589 KB)
138:
Trends in AI training FLOP over time (2010-2025).svg
132:
112:
Commons is a freely licensed media file repository.
281:Trends in AI training FLOP over time (2010-2025)
386:Creative Commons Attribution 4.0 International
93:
195:
8:
250:https://creativecommons.org/licenses/by/4.0
226:– to copy, distribute and transmit the work
41:Size of this PNG preview of this SVG file:
521:
443:
277:
531:
523:
503:
419:
403:
383:
367:
347:
331:
311:
295:
292:
273:
266:
7:
501:The following page uses this file:
432:
201:
514:
286:
280:
217:
192:
142:
125:
75:
285:
256:Creative Commons Attribution 4.0
271:
237:Under the following conditions:
208:This file is licensed under the
200:
194:
92:
21:
268:
143:
14:
267:
26:
1:
213:Attribution 4.0 International
31:
293:Items portrayed in this file
553:
433:
16:
469:23:10, 24 September 2024
270:
172:https://epochai.org/blog
99:This is a file from the
490:
177:
167:
160:
157:
135:
103:. Information from its
106:description page there
506:Large language model
65:2,266 × 2,048 pixels
61:1,133 × 1,024 pixels
232:– to adapt the work
47:Other resolutions:
314:Neural scaling law
540:
539:
494:
370:copyright license
279:
185:
184:
121:
120:
101:Wikimedia Commons
544:
522:
481:
334:copyright status
263:
260:
257:
254:
251:
210:Creative Commons
204:
203:
198:
197:
163:
147:
139:
133:
117:
96:
95:
89:
83:
72:
69:801 × 724 pixels
57:850 × 768 pixels
53:531 × 480 pixels
49:266 × 240 pixels
43:663 × 599 pixels
552:
551:
547:
546:
545:
543:
542:
541:
510:
495:
487:
479:
435:
434:
431:
430:
429:
428:
427:
426:
425:
424:
422:
412:
411:
410:
408:
397:
396:
395:
394:
393:
392:
391:
390:
388:
376:
375:
374:
372:
361:
360:
359:
358:
357:
356:
355:
354:
352:
340:
339:
338:
336:
325:
324:
323:
322:
321:
320:
319:
318:
316:
304:
303:
302:
300:
284:
283:
282:
265:
264:
261:
258:
255:
252:
249:
248:
216:
205:
191:
186:
153:
137:
130:
123:
122:
111:
110:
109:is shown below.
85:
81:
74:
73:
46:
12:
11:
5:
550:
548:
538:
537:
534:
530:
529:
526:
513:
509:
508:
499:
498:
493:
492:
489:
485:
482:
476:
471:
466:
462:
461:
458:
455:
452:
449:
446:
439:
438:
423:
420:
418:
417:
416:
415:
414:
413:
409:
404:
402:
401:
400:
399:
398:
389:
384:
382:
381:
380:
379:
378:
377:
373:
368:
366:
365:
364:
363:
362:
353:
348:
346:
345:
344:
343:
342:
341:
337:
332:
330:
329:
328:
327:
326:
317:
312:
310:
309:
308:
307:
306:
305:
301:
296:
294:
291:
290:
289:
288:
287:
276:
275:
272:
269:
247:
246:
245:
244:
235:
234:
233:
227:
220:You are free:
207:
206:
193:
190:
187:
183:
182:
179:
175:
174:
169:
165:
164:
159:
155:
154:
140:
131:
129:
126:
124:
119:
118:
97:
87:
86:
40:
36:
35:
34:
29:
24:
19:
13:
10:
9:
6:
4:
3:
2:
549:
535:
532:
527:
524:
520:
517:
511:
507:
504:
502:
496:
488:
486:Cosmia Nebula
483:
477:
475:
472:
470:
467:
464:
463:
459:
456:
453:
450:
447:
445:
444:
442:
436:
421:image/svg+xml
407:
387:
371:
351:
335:
315:
299:
242:
239:
238:
236:
231:
228:
225:
222:
221:
219:
218:
214:
211:
199:
188:
180:
176:
173:
170:
166:
156:
150:
146:
141:
134:
127:
115:
108:
107:
102:
98:
91:
90:
84:
79:
78:Original file
70:
66:
62:
58:
54:
50:
44:
39:
33:
30:
28:
25:
23:
20:
18:
15:
518:
515:
500:
440:
437:File history
240:
229:
223:
144:
114:You can help
104:
76:
22:File history
350:copyrighted
241:attribution
162:28 May 2024
136:Description
497:File usage
478:801 × 724
454:Dimensions
406:media type
253:CC BY 4.0
27:File usage
451:Thumbnail
448:Date/Time
189:Licensing
145:English:
512:Metadata
480:(589 KB)
274:Captions
230:to remix
224:to share
215:license.
181:Epoch AI
32:Metadata
465:current
460:Comment
298:depicts
278:English
152:growth.
128:Summary
80:
533:Height
178:Author
168:Source
525:Width
457:User
262:true
259:true
158:Date
17:File
536:724
528:801
67:|
63:|
59:|
55:|
51:|
45:.
116:.
71:.
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.
.svg){kind=link}