Knowledge (XXG)

Degree of parallelism

Source đź“ť

891: 913: 39:
A program running on a parallel computer may utilize different numbers of processors at different times. For each time period, the number of processors used to execute a program is defined as the degree of parallelism. The plot of the DOP as a function of time for a given program is called the
217: 307: 159: 108: 53: 954: 288: 555: 578: 467: 573: 550: 118: 84: 152: 983: 973: 545: 360: 652: 515: 21: 876: 710: 328: 248: 978: 947: 895: 841: 301: 145: 820: 615: 500: 462: 312: 202: 29: 836: 815: 760: 647: 637: 610: 472: 790: 416: 355: 268: 705: 851: 846: 296: 24:
can be or are being simultaneously executed by a computer. It is used as an indicator of the complexity of
940: 590: 522: 426: 318: 273: 380: 682: 642: 595: 585: 323: 243: 182: 622: 510: 505: 495: 482: 278: 73:
Deprettere, Ed F.; Takala, Jarmo; Leupers, Rainer; Bhattacharyya, Shuvra S., eds. (13 October 2018).
785: 740: 566: 561: 540: 406: 810: 659: 632: 457: 421: 411: 212: 192: 187: 168: 33: 370: 856: 532: 490: 385: 114: 80: 924: 920: 866: 665: 600: 447: 263: 258: 253: 222: 730: 670: 605: 452: 442: 375: 207: 197: 365: 861: 677: 334: 227: 967: 750: 627: 350: 74: 871: 745: 720: 25: 912: 795: 775: 700: 800: 780: 755: 390: 770: 765: 137: 110:
An Algorithm for Off-Line Detection of Phases in Execution Profiles
805: 735: 725: 141: 715: 692: 28:, and is especially useful for describing the performance of 928: 107:
Wagner, Thomas D.; Carlson, Brian M. (20 April 1994).
829: 691: 531: 481: 435: 399: 343: 287: 236: 175: 79:. Springer International Publishing. p. 552. 948: 153: 8: 20:(DOP) is a metric which indicates how many 955: 941: 160: 146: 138: 54:Optical Multi-Tree with Shuffle Exchange 65: 76:Handbook of Signal Processing Systems 7: 909: 907: 927:. You can help Knowledge (XXG) by 14: 911: 890: 889: 361:Analysis of parallel algorithms 1: 308:Simultaneous and heterogenous 896:Category: Parallel computing 1000: 906: 203:High-performance computing 885: 837:Automatic parallelization 473:Application checkpointing 852:Embarrassingly parallel 847:Deterministic algorithm 984:Computer science stubs 974:Instruction processing 567:Associative processing 523:Non-blocking algorithm 329:Clustered multi-thread 683:Hardware acceleration 596:Superscalar processor 586:Dataflow architecture 183:Distributed computing 18:degree of parallelism 562:Pipelined processing 511:Explicit parallelism 506:Implicit parallelism 496:Dataflow programming 786:Parallel Extensions 591:Pipelined processor 42:parallelism profile 979:Parallel computing 660:Massively parallel 638:distributed shared 458:Cache invalidation 422:Instruction window 213:Manycore processor 193:Massively parallel 188:Parallel computing 169:Parallel computing 936: 935: 904: 903: 857:Parallel slowdown 491:Stream processing 381:Karp–Flatt metric 30:parallel programs 991: 957: 950: 943: 921:computer science 915: 908: 893: 892: 867:Software lockout 666:Computer cluster 601:Vector processor 556:Array processing 541:Flynn's taxonomy 448:Memory coherence 223:Computer network 162: 155: 148: 139: 132: 131: 129: 127: 104: 98: 97: 95: 93: 70: 999: 998: 994: 993: 992: 990: 989: 988: 964: 963: 962: 961: 905: 900: 881: 825: 731:Coarray Fortran 687: 671:Beowulf cluster 527: 477: 468:Synchronization 453:Cache coherence 443:Multiprocessing 431: 395: 376:Cost efficiency 371:Gustafson's law 339: 283: 232: 208:Multiprocessing 198:Cloud computing 171: 166: 136: 135: 125: 123: 121: 106: 105: 101: 91: 89: 87: 72: 71: 67: 62: 50: 34:multi-processor 12: 11: 5: 997: 995: 987: 986: 981: 976: 966: 965: 960: 959: 952: 945: 937: 934: 933: 916: 902: 901: 899: 898: 886: 883: 882: 880: 879: 874: 869: 864: 862:Race condition 859: 854: 849: 844: 839: 833: 831: 827: 826: 824: 823: 818: 813: 808: 803: 798: 793: 788: 783: 778: 773: 768: 763: 758: 753: 748: 743: 738: 733: 728: 723: 718: 713: 708: 703: 697: 695: 689: 688: 686: 685: 680: 675: 674: 673: 663: 657: 656: 655: 650: 645: 640: 635: 630: 620: 619: 618: 613: 606:Multiprocessor 603: 598: 593: 588: 583: 582: 581: 576: 571: 570: 569: 564: 559: 548: 537: 535: 529: 528: 526: 525: 520: 519: 518: 513: 508: 498: 493: 487: 485: 479: 478: 476: 475: 470: 465: 460: 455: 450: 445: 439: 437: 433: 432: 430: 429: 424: 419: 414: 409: 403: 401: 397: 396: 394: 393: 388: 383: 378: 373: 368: 363: 358: 353: 347: 345: 341: 340: 338: 337: 335:Hardware scout 332: 326: 321: 316: 310: 305: 299: 293: 291: 289:Multithreading 285: 284: 282: 281: 276: 271: 266: 261: 256: 251: 246: 240: 238: 234: 233: 231: 230: 228:Systolic array 225: 220: 215: 210: 205: 200: 195: 190: 185: 179: 177: 173: 172: 167: 165: 164: 157: 150: 142: 134: 133: 119: 99: 85: 64: 63: 61: 58: 57: 56: 49: 46: 13: 10: 9: 6: 4: 3: 2: 996: 985: 982: 980: 977: 975: 972: 971: 969: 958: 953: 951: 946: 944: 939: 938: 932: 930: 926: 923:article is a 922: 917: 914: 910: 897: 888: 887: 884: 878: 875: 873: 870: 868: 865: 863: 860: 858: 855: 853: 850: 848: 845: 843: 840: 838: 835: 834: 832: 828: 822: 819: 817: 814: 812: 809: 807: 804: 802: 799: 797: 794: 792: 789: 787: 784: 782: 779: 777: 774: 772: 769: 767: 764: 762: 759: 757: 754: 752: 751:Global Arrays 749: 747: 744: 742: 739: 737: 734: 732: 729: 727: 724: 722: 719: 717: 714: 712: 709: 707: 704: 702: 699: 698: 696: 694: 690: 684: 681: 679: 678:Grid computer 676: 672: 669: 668: 667: 664: 661: 658: 654: 651: 649: 646: 644: 641: 639: 636: 634: 631: 629: 626: 625: 624: 621: 617: 614: 612: 609: 608: 607: 604: 602: 599: 597: 594: 592: 589: 587: 584: 580: 577: 575: 572: 568: 565: 563: 560: 557: 554: 553: 552: 549: 547: 544: 543: 542: 539: 538: 536: 534: 530: 524: 521: 517: 514: 512: 509: 507: 504: 503: 502: 499: 497: 494: 492: 489: 488: 486: 484: 480: 474: 471: 469: 466: 464: 461: 459: 456: 454: 451: 449: 446: 444: 441: 440: 438: 434: 428: 425: 423: 420: 418: 415: 413: 410: 408: 405: 404: 402: 398: 392: 389: 387: 384: 382: 379: 377: 374: 372: 369: 367: 364: 362: 359: 357: 354: 352: 349: 348: 346: 342: 336: 333: 330: 327: 325: 322: 320: 317: 314: 311: 309: 306: 303: 300: 298: 295: 294: 292: 290: 286: 280: 277: 275: 272: 270: 267: 265: 262: 260: 257: 255: 252: 250: 247: 245: 242: 241: 239: 235: 229: 226: 224: 221: 219: 216: 214: 211: 209: 206: 204: 201: 199: 196: 194: 191: 189: 186: 184: 181: 180: 178: 174: 170: 163: 158: 156: 151: 149: 144: 143: 140: 122: 120:9783540580218 116: 112: 111: 103: 100: 88: 86:9783319917344 82: 78: 77: 69: 66: 59: 55: 52: 51: 47: 45: 43: 37: 35: 31: 27: 23: 19: 929:expanding it 918: 436:Coordination 366:Amdahl's law 302:Simultaneous 124:. Retrieved 109: 102: 90:. Retrieved 75: 68: 41: 38: 17: 15: 872:Scalability 633:distributed 516:Concurrency 483:Programming 324:Cooperative 313:Speculative 249:Instruction 968:Categories 877:Starvation 616:asymmetric 351:PRAM model 319:Preemptive 60:References 26:algorithms 22:operations 611:symmetric 356:PEM model 36:systems. 842:Deadlock 830:Problems 796:pthreads 776:OpenHMPP 701:Ateji PX 662:computer 533:Hardware 400:Elements 386:Slowdown 297:Temporal 279:Pipeline 126:12 April 92:12 April 48:See also 801:RaftLib 781:OpenACC 756:GPUOpen 746:C++ AMP 721:Charm++ 463:Barrier 407:Process 391:Speedup 176:General 894:  771:OpenCL 766:OpenMP 711:Chapel 628:shared 623:Memory 558:(SIMT) 501:Models 412:Thread 344:Theory 315:(SpMT) 269:Memory 254:Thread 237:Levels 117:  83:  919:This 741:Dryad 706:Boost 427:Array 417:Fiber 331:(CMT) 304:(SMT) 218:GPGPU 925:stub 806:ROCm 736:CUDA 726:Cilk 693:APIs 653:COMA 648:NUMA 579:MIMD 574:MISD 551:SIMD 546:SISD 274:Loop 264:Data 259:Task 128:2023 115:ISBN 94:2023 81:ISBN 32:and 16:The 821:ZPL 816:TBB 811:UPC 791:PVM 761:MPI 716:HPX 643:UMA 244:Bit 970:: 113:. 44:. 956:e 949:t 942:v 931:. 161:e 154:t 147:v 130:. 96:.

Index

operations
algorithms
parallel programs
multi-processor
Optical Multi-Tree with Shuffle Exchange
Handbook of Signal Processing Systems
ISBN
9783319917344
An Algorithm for Off-Line Detection of Phases in Execution Profiles
ISBN
9783540580218
v
t
e
Parallel computing
Distributed computing
Parallel computing
Massively parallel
Cloud computing
High-performance computing
Multiprocessing
Manycore processor
GPGPU
Computer network
Systolic array
Bit
Instruction
Thread
Task
Data

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑