263:
43:
269:
189:
274:
91:
721:
750:
691:
145:
An illustration of multiple attention heads, each having its own criteria of relevance of other tokens for one of the tokens within the scope of a context window. (For the purpose of illustration, the context window consists of only one
315:– You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
214:
for more information. If an SVG form of this image is available, please upload it and afterwards replace this template with
799:
211:
57:
53:
47:
102:
70:
636:
532:
496:
842:
This file contains additional information, probably added from the digital camera or scanner used to create or digitize it.
322:
444:
620:
586:
480:
452:
437:
424:
749:
744:
720:
715:
231:
217:
552:
516:
397:
380:
205:
284:
845:
If the file has been modified from its original state, some details may not fully reflect the modified file.
760:
731:
701:
459:
321:– If you remix, transform, or build upon the material, you must distribute your contributions under the
781:
281:
175:
110:
690:
685:
61:
42:
201:
230:
It is recommended to name the SVG file “Multiple attention heads.svg”—then the template
97:
256:
I, the copyright holder of this work, hereby publish it under the following license:
155:
235:
809:
829:
658:
Click on a date/time to view the file as it appeared at that time.
819:
183:
85:
533:
Creative
Commons Attribution-ShareAlike 4.0 International
460:
https://commons.wikimedia.org/User:DancingPhilosopher
129:
109:
Commons is a freely licensed media file repository.
75:(870 × 1,280 pixels, file size: 269 KB, MIME type:
332:https://creativecommons.org/licenses/by-sa/4.0
90:
338:Creative Commons Attribution-Share Alike 4.0
262:
8:
364:An illustration of multiple attention heads
298:– to copy, distribute and transmit the work
847:
660:
360:
792:The following other wikis use this file:
285:Attribution-Share Alike 4.0 International
210:. This has several advantages; see
857:
849:
779:
634:
618:
600:
584:
566:
550:
530:
514:
494:
478:
411:
395:
378:
375:
356:
349:
7:
777:The following page uses this file:
767:Uploaded own work with UploadWizard
649:
273:
268:
840:
369:
363:
259:
255:
194:
139:
122:
68:
368:
708:omitted the (in-picture) caption
354:
309:Under the following conditions:
280:This file is licensed under the
272:
267:
261:
187:
89:
31:
21:
351:
140:
14:
350:
26:
1:
637:original creation by uploader
36:
806:Usage on en.wikiversity.org
376:Items portrayed in this file
135:Multiple attention heads.png
826:Usage on kaa.wikipedia.org
796:Usage on ckb.wikipedia.org
879:
816:Usage on hu.wikipedia.org
323:same or compatible license
198:image could be re-created
650:
212:Commons:Media for cleanup
165:
16:
353:
289:
232:Vector version available
218:vector version available
96:This is a file from the
766:
737:
707:
171:
161:
154:
151:
132:
100:. Information from its
103:description page there
46:Size of this preview:
851:Horizontal resolution
810:Large language models
782:Large language model
716:12:48, 1 August 2023
686:13:23, 1 August 2023
238:) does not need the
859:Vertical resolution
745:22:35, 29 July 2023
304:– to adapt the work
52:Other resolutions:
820:Nagy nyelvi modell
800:مۆدێلی زمانی گەورە
762:DancingPhilosopher
733:DancingPhilosopher
703:DancingPhilosopher
445:DancingPhilosopher
438:Wikimedia username
431:DancingPhilosopher
425:author name string
176:DancingPhilosopher
62:870 × 1,280 pixels
866:
865:
788:Global file usage
770:
517:copyright license
362:
247:
246:
181:
180:
118:
117:
98:Wikimedia Commons
32:Global file usage
870:
848:
830:Úlken til modeli
757:
728:
698:
481:copyright status
462:
457:
447:
442:
432:
429:
345:
342:
339:
336:
333:
325:as the original.
282:Creative Commons
276:
275:
271:
270:
265:
264:
225:
191:
190:
184:
167:
157:
144:
136:
130:
114:
93:
92:
86:
80:
78:
65:
58:326 × 480 pixels
54:163 × 240 pixels
48:407 × 599 pixels
878:
877:
873:
872:
871:
869:
868:
867:
836:
786:
771:
763:
755:
734:
726:
704:
696:
652:
651:
648:
647:
646:
645:
644:
643:
642:
641:
639:
627:
626:
625:
623:
612:
611:
610:
609:
608:
607:
606:
605:
603:
593:
592:
591:
589:
578:
577:
576:
575:
574:
573:
572:
571:
569:
559:
558:
557:
555:
544:
543:
542:
541:
540:
539:
538:
537:
535:
523:
522:
521:
519:
508:
507:
506:
505:
504:
503:
502:
501:
499:
487:
486:
485:
483:
472:
471:
470:
469:
468:
467:
466:
465:
464:
463:
458:
455:
449:
448:
443:
440:
434:
433:
430:
427:
418:
417:
416:
414:
404:
403:
402:
400:
389:
388:
387:
386:
385:
383:
367:
366:
365:
348:
347:
346:
343:
340:
337:
334:
331:
330:
288:
277:
258:
257:
252:
243:
215:
202:vector graphics
188:
182:
147:
134:
127:
120:
119:
108:
107:
106:is shown below.
82:
76:
74:
67:
66:
51:
12:
11:
5:
876:
874:
864:
863:
860:
856:
855:
852:
839:
835:
834:
833:
832:
824:
823:
822:
814:
813:
812:
804:
803:
802:
790:
789:
785:
784:
775:
774:
769:
768:
765:
761:
758:
752:
747:
742:
739:
738:
736:
732:
729:
723:
718:
713:
710:
709:
706:
702:
699:
693:
688:
683:
679:
678:
675:
672:
669:
666:
663:
656:
655:
640:
635:
633:
632:
631:
630:
629:
628:
624:
621:source of file
619:
617:
616:
615:
614:
613:
604:
601:
599:
598:
597:
596:
595:
594:
590:
585:
583:
582:
581:
580:
579:
570:
567:
565:
564:
563:
562:
561:
560:
556:
551:
549:
548:
547:
546:
545:
536:
531:
529:
528:
527:
526:
525:
524:
520:
515:
513:
512:
511:
510:
509:
500:
495:
493:
492:
491:
490:
489:
488:
484:
479:
477:
476:
475:
474:
473:
451:
450:
436:
435:
423:
422:
421:
420:
419:
415:
412:
410:
409:
408:
407:
406:
405:
401:
396:
394:
393:
392:
391:
390:
384:
379:
377:
374:
373:
372:
371:
370:
359:
358:
355:
352:
329:
328:
327:
326:
316:
307:
306:
305:
299:
292:You are free:
279:
278:
260:
254:
253:
251:
248:
245:
244:
240:new image name
222:new image name
192:
179:
178:
173:
169:
168:
163:
159:
158:
153:
149:
148:
137:
128:
126:
123:
121:
116:
115:
94:
84:
83:
45:
41:
40:
39:
34:
29:
24:
19:
13:
10:
9:
6:
4:
3:
2:
875:
861:
858:
853:
850:
846:
843:
837:
831:
828:
827:
825:
821:
818:
817:
815:
811:
808:
807:
805:
801:
798:
797:
795:
794:
793:
787:
783:
780:
778:
772:
764:
759:
753:
751:
748:
746:
743:
741:
740:
735:
730:
724:
722:
719:
717:
714:
712:
711:
705:
700:
694:
692:
689:
687:
684:
681:
680:
676:
673:
670:
667:
664:
662:
661:
659:
653:
638:
622:
588:
554:
534:
518:
498:
482:
461:
454:
446:
439:
426:
399:
382:
335:CC BY-SA 4.0
324:
320:
317:
314:
311:
310:
308:
303:
300:
297:
294:
293:
291:
290:
286:
283:
266:
249:
241:
237:
233:
229:
228:
223:
219:
213:
209:
207:
203:
197:
193:
186:
185:
177:
174:
170:
164:
160:
150:
143:
138:
131:
124:
112:
105:
104:
99:
95:
88:
87:
81:
72:
71:Original file
63:
59:
55:
49:
44:
38:
35:
33:
30:
28:
25:
23:
20:
18:
15:
844:
841:
791:
776:
754:855 × 1,280
725:870 × 1,280
695:870 × 1,280
657:
654:File history
568:29 July 2023
318:
312:
301:
295:
239:
227:
221:
199:
196:
156:29 July 2023
141:
111:You can help
101:
69:
22:File history
497:copyrighted
319:share alike
313:attribution
133:Description
773:File usage
671:Dimensions
587:media type
413:some value
242:parameter.
146:sentence.)
27:File usage
862:47.24 dpc
854:47.24 dpc
668:Thumbnail
665:Date/Time
602:image/png
553:inception
250:Licensing
142:English:
77:image/png
838:Metadata
756:(510 KB)
727:(365 KB)
697:(269 KB)
357:Captions
302:to remix
296:to share
287:license.
166:Own work
37:Metadata
682:current
677:Comment
398:creator
381:depicts
361:English
125:Summary
73:
204:as an
200:using
172:Author
162:Source
195:This
674:User
344:true
341:true
234:(or
208:file
152:Date
17:File
453:URL
236:Vva
206:SVG
456::
441::
428::
224:}}
216:{{
60:|
56:|
50:.
226:.
220:|
113:.
79:)
64:.
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.
