55:, which helps the brain identify what you are viewing. The brain then combines all of these into the field of view that is then seen and comprehended. This is a continual and seamless operation. For example, if one is standing between two different groups of people who are simultaneously carrying on two different conversations, one may be able to pick up only some information of both conversations at the same time. Parallel processing has been linked, by some experimental psychologists, to the
245:
269:. This test consisted of a table, half coated in a checkerboard pattern, and the other half a clear plexiglass sheet, revealing a second checkerboard platform about a foot below. Although the plexiglass was safe to climb on, the infants refused to cross over due to the perception of a visual cliff. This test proved that most infants already have a good sense of depth. This phenomenon is similar to how adults perceive heights.
79:. According to Rumelhart, the PDP model represents information processing as interactions between elements called units, with the interactions being either excitatory or inhibitory in nature. Parallel Distributed Processing Models are neurally inspired, emulating the organisational structure of nervous systems of living organisms. A general mathematical framework is provided for them.
253:
respective gangs. Rumelhart considered each category as a 'unit' and an individual has connections with each unit. For instance, if more information is sought on an individual named Ralph, that name unit is activiated, revealing connections to the other properties of Ralph such as his marital status or age group.
225:
The patterns of connectivity are modified using experience. The modifications can be of three types: First, the development of new connections. Second, the loss of existing connection. Last, the modification of strengths of connections that already exist. The first two can be considered as special
120:
In case of serial processing, the elements are searched one after the other in a serial order to find the target. When the target is found, the search terminates. Alternatively, it continues to the end to ensure that the target is not present. This results in reduced accuracy and increased time for
179:
An output function maps the current state of activation to an output signal. The units interact with their neighbouring units by transmitting signals. The strengths of these signals are determined by their degree of activation. This in turn affects the degree to which they affect their neighbours.
281:
can be used by a single eye with hints from the environment. These hints include relative height, relative size, linear perspective, lights and shadows, and relative motion. Each hint helps to establish small facts about a scene that work together to form a perception of depth. Binocular cues and
265:, humans use both eyes to see three dimensional objects. This sense is present at birth in humans and some animals, such as cats, dogs, owls, and monkeys. Animals with wider-set eyes have a harder time establishing depth, such as horses and cows. A special depth test was used on infants, named
252:
An example of the PDP model is illustrated in
Rumelhart's book 'Parallel Distributed Processing' of individuals who live in the same neighborhood and are part of different gangs. Other information is also included, such as their names, age group, marital status, and occupations within their
188:
The pattern of connectivity determines how the system will react to an arbitrary input. The total pattern of connectivity is represented by specifying the weights for every connection. A positive weight represents an excitatory input and a negative weight represents an inhibitory input.
111:
In contrast to parallel processing, serial processing involves sequential processing of information, without any overlap of processing times. The distinction between these two processing models is most observed during visual stimuli is targeted and processed (also called visual search).
124:
On the other hand, in the case of parallel processing, all objects are processed simultaneously but the completion times may vary. This may or may not reduce the accuracy, but the time courses are similar irrespective of the size of the display.
226:
cases of the last one. When the strength of a connection is changed from zero to a positive or negative one, it is like forming a new connection. When the strength of a connection is changed to zero, it is like losing an existing connection.
59:(resulting from the stroop test where there is a mismatch between the name of a color and the color that the word is written in). In the stroop effect, an inability to attend to all stimuli is seen through people's selective attention.
301:. All parts of the brain cannot process at full capacity in a parallel method. Attention controls the allocation of resources to the tasks. To work efficiently, attention must be guided from object to object.
276:
are made by humans' two eyes, which are subconsciously compared to calculate distance. This idea of two separate images is used by 3-D and VR filmmakers to give two dimensional footage the element of depth.
102:
of connection strengths and activation level of other units. A set of response units is activated by the propagation of activation patterns. The connection weights are eventually adjusted using learning.
327:
This stage occurs instantaneously and uses parallel processing. In this step, all the basic features of a display are picked up simultaneously, even if attention is being paid to a specific object.
308:
in parallel processing, meaning that parallel processing is obstructed by serial processing in between. However, there is evidence for coexistence of serial and parallel processes.
241:
over the space of input patterns. This means that at any given point, there is a possibility that any of the possible set of input patterns is impinging on the input units.
558:
Cohen, Jonathan D.; Dunbar, Kevin; McClelland, James L. (1990). "On the control of automatic processes: A parallel distributed processing account of the Stroop effect".
1072:
82:
Parallel processing models assume that information is represented in the brain using patterns of activation. Information processing encompasses the interactions of
320:
by Anne
Treisman is one of the theories that integrates serial and parallel processing while taking into account attentional resources. It consists of two stages-
290:
Limitations of parallel processing have been brought up in several analytical studies. The main limitations highlighted include capacity limits of the brain,
144:
These units may include abstract elements such as features, shapes and words, and are generally categorised into three types: input, output and hidden units.
128:
However, there are concerns about the efficiency of parallel processing models in case of complex tasks which are discussed ahead in this article.
298:
1048:
1013:
543:
436:
1210:
692:
656:
95:
171:
of N real numbers, over the set of processing units. It is this pattern that captures what the system is representing at any time.
793:"Serial vs. Parallel Processing: Sometimes They Look like Tweedledum and Tweedledee but they can (and Should) be Distinguished"
594:
317:
201:
is produced for each type of input using rules that take the output vector and combine it with the connectivity
367:
352:
651:. James L. McClelland, San Diego. PDP Research Group University of California. Cambridge, Mass.: MIT Press.
31:
to simultaneously process incoming stimuli of differing quality. Parallel processing is associated with the
1237:
99:
392:
LaBerge, David; Samuels, S.Jay (1974). "Toward a theory of automatic information processing in reading".
765:
237:
149:
167:
This is a representation of the state of the system. The pattern of activation is represented using a
72:
526:
Baghdadi, Golnaz; Towhidkhah, Farzad; Rajabi, Mojdeh, eds. (2021), "Chapter 7 – Assessment methods",
294:
rate interferences, limited processing capabilities, and information limitations in visual searches.
202:
505:
On the
Control of Automatic Processes: A Parallel Distributed Processing Model of the Stroop Effect
76:
1115:
1066:
924:
820:
745:
716:
Holyoak, Keith J. (1987). Rumelhart, David E.; McClelland, James L.; Group, PDP Research (eds.).
622:
485:
362:
91:
1206:
1172:
1154:
1107:
1054:
1044:
1019:
1009:
981:
963:
916:
877:
859:
812:
753:
737:
698:
688:
662:
652:
614:
575:
539:
477:
469:
432:
409:
372:
291:
1198:
1162:
1146:
1099:
971:
955:
908:
867:
851:
804:
729:
606:
567:
531:
508:
461:
401:
273:
262:
40:
244:
777:
168:
68:
840:"Information-limited parallel processing in difficult heterogeneous covert visual search"
792:
1167:
976:
872:
808:
535:
278:
648:
Parallel distributed processing : explorations in the microstructure of cognition
205:. In the case of a more complex pattern connectivity, the rules are more complex too.
1231:
1202:
626:
405:
357:
347:
56:
32:
1190:
1119:
824:
489:
1150:
266:
1087:
1135:"Brain Mechanisms of Serial and Parallel Processing during Dual-Task Performance"
1103:
733:
71:
proposed the model of parallel distributed processing (PDP) in hopes of studying
685:
Parallel distributed processing: explorations in the microstructure of cognition
297:
There are processing limits to the brain in the execution of complex tasks like
1134:
571:
217:
of impinging units combined and the current state of activation for that unit.
1058:
1023:
610:
334:
20:
1158:
1111:
967:
920:
863:
816:
741:
618:
473:
413:
333:
This step is more time-consuming and uses serial processing. It leads to the
702:
666:
1176:
985:
881:
757:
481:
595:"Précis of Semantic Cognition: A Parallel Distributed Processing Approach"
579:
136:
There are eight major aspects of a parallel distributed processing model:
646:
48:
504:
959:
928:
749:
717:
512:
87:
1038:
1003:
839:
683:
Rumelhart, David E.; McClelland, James L.; PDP Research Group (1986).
282:
monocular cues are used constantly and subconsciously to sense depth.
943:
896:
855:
452:
Wässle, Heinz (2004). "Parallel processing in the mammalian retina".
83:
52:
912:
844:
Journal of
Experimental Psychology: Human Perception and Performance
465:
213:
A new state of activation is produced for every unit by joining the
895:
Snodgrass, Joan Gay; Townsend, James T.; Ashby, F. Gregory (1985).
507:(Report). Fort Belvoir, VA: Defense Technical Information Center.
44:
36:
28:
98:. Every individual unit's activation level is updated using a
51:. These are individually analyzed and then compared to stored
35:
in that the brain divides what it sees into four components:
503:
Cohen, J. D.; Dunbar, K.; McClelland, J. L. (16 June 1988).
944:"Stereopsis in animals: evolution, function and mechanisms"
897:"Stochastic Modeling of Elementary Psychological Processes"
248:
An example of a parallel distributed processing (PDP) model
838:
Dosher, Barbara Anne; Han, Songmei; Lu, Zhong-Lin (2010).
593:
Rogers, Timothy T.; McClelland, James L. (December 2008).
304:
These limits to attentional resources sometimes lead to
158:
The hidden units function entirely inside the system.
942:Nityananda, Vivek; Read, Jenny C. A. (2017-07-15).
234:In PDP models, the environment is represented as a
1133:Sigman, Mariano; Dehaene, Stanislas (2008-07-23).
132:Aspects of a parallel distributed processing model
1040:Cognitive psychology : a student's handbook
155:The output units send signals out of the system.
148:Input units receive signals from either sensory
272:Certain cues help establish depth perception.
8:
1071:: CS1 maint: multiple names: authors list (
1191:"Features and Objects in Visual Processing"
1092:Current Directions in Psychological Science
1088:"The Parallel Guidance of Visual Attention"
1166:
975:
871:
243:
152:or other parts of the processing system.
384:
90:-like connections. These can be either
1064:
773:
763:
528:Neurocognitive Mechanisms of Attention
1002:Myers, David G. (16 September 2021).
997:
995:
678:
676:
429:Parallel models of associative memory
7:
640:
638:
636:
530:, Academic Press, pp. 203–250,
1195:Foundations of Cognitive Psychology
791:Townsend, James T. (January 1990).
718:"A Connectionist View of Cognition"
901:The American Journal of Psychology
809:10.1111/j.1467-9280.1990.tb00067.x
536:10.1016/B978-0-323-90935-8.00005-6
14:
1086:Wolfe, Jeremy M. (August 1992).
948:Journal of Experimental Biology
687:. Cambridge, Mass.: MIT Press.
67:In 1990, American Psychologist
1203:10.7551/mitpress/3080.003.0025
1151:10.1523/JNEUROSCI.0948-08.2008
1008:. Macmillan Higher Education.
431:. New York: Psychology Press.
337:of whole objects and patterns.
1:
1037:W., Eysenck, Michael (2020).
599:Behavioral and Brain Sciences
107:Serial vs parallel processing
1104:10.1111/1467-8721.ep10769733
734:10.1126/science.236.4804.992
645:Rumelhart, David E. (1986).
406:10.1016/0010-0285(74)90015-2
230:Environmental representation
121:displays with more objects.
454:Nature Reviews Neuroscience
400:(2). Elsevier BV: 293–323.
1254:
572:10.1037/0033-295x.97.3.332
318:feature integration theory
312:Feature integration theory
611:10.1017/S0140525X0800589X
427:Hinton, Geoffrey (2014).
16:Brain processing function
368:Multiple object tracking
353:Neural network (biology)
331:Integration of features-
1197:, The MIT Press, 2002,
1139:Journal of Neuroscience
325:Detection of features-
249:
86:-like units linked by
27:is the ability of the
797:Psychological Science
247:
184:Connectivity patterns
1043:. Psychology Press.
1005:Exploring Psychology
560:Psychological Review
394:Cognitive Psychology
77:computer simulations
774:|editor3-last=
238:stochastic function
25:parallel processing
960:10.1242/jeb.143883
776:has generic name (
513:10.21236/ada218914
363:Human multitasking
306:serial bottlenecks
299:object recognition
250:
1145:(30): 7585–7598.
1050:978-1-138-48221-0
1015:978-1-319-42980-5
954:(14): 2502–2512.
728:(4804): 992–996.
545:978-0-323-90935-8
438:978-1-315-80799-7
373:Parallel thinking
292:attentional blink
1245:
1222:
1221:
1220:
1219:
1187:
1181:
1180:
1170:
1130:
1124:
1123:
1083:
1077:
1076:
1070:
1062:
1034:
1028:
1027:
999:
990:
989:
979:
939:
933:
932:
892:
886:
885:
875:
856:10.1037/a0020366
850:(5): 1128–1144.
835:
829:
828:
788:
782:
781:
775:
771:
769:
761:
713:
707:
706:
680:
671:
670:
642:
631:
630:
590:
584:
583:
555:
549:
548:
523:
517:
516:
500:
494:
493:
449:
443:
442:
424:
418:
417:
389:
267:The Visual Cliff
193:Propagation rule
175:Output functions
163:Activation state
140:Processing units
73:neural processes
1253:
1252:
1248:
1247:
1246:
1244:
1243:
1242:
1228:
1227:
1226:
1225:
1217:
1215:
1213:
1189:
1188:
1184:
1132:
1131:
1127:
1085:
1084:
1080:
1063:
1051:
1036:
1035:
1031:
1016:
1001:
1000:
993:
941:
940:
936:
913:10.2307/1422636
894:
893:
889:
837:
836:
832:
790:
789:
785:
772:
762:
715:
714:
710:
695:
682:
681:
674:
659:
644:
643:
634:
592:
591:
587:
557:
556:
552:
546:
525:
524:
520:
502:
501:
497:
466:10.1038/nrn1497
460:(10): 747–757.
451:
450:
446:
439:
426:
425:
421:
391:
390:
386:
381:
344:
314:
288:
259:
232:
223:
211:
209:Activation rule
195:
186:
177:
165:
142:
134:
118:
109:
69:David Rumelhart
65:
17:
12:
11:
5:
1251:
1249:
1241:
1240:
1230:
1229:
1224:
1223:
1211:
1182:
1125:
1098:(4): 124–128.
1078:
1049:
1029:
1014:
991:
934:
887:
830:
783:
708:
693:
672:
657:
632:
605:(6): 689–714.
585:
566:(3): 332–361.
550:
544:
518:
495:
444:
437:
419:
383:
382:
380:
377:
376:
375:
370:
365:
360:
355:
350:
343:
340:
339:
338:
328:
313:
310:
287:
284:
279:Monocular cues
274:Binocular cues
258:
255:
231:
228:
222:
219:
210:
207:
194:
191:
185:
182:
176:
173:
164:
161:
160:
159:
156:
153:
141:
138:
133:
130:
117:
114:
108:
105:
64:
61:
15:
13:
10:
9:
6:
4:
3:
2:
1250:
1239:
1238:Neural coding
1236:
1235:
1233:
1214:
1212:9780262278263
1208:
1204:
1200:
1196:
1192:
1186:
1183:
1178:
1174:
1169:
1164:
1160:
1156:
1152:
1148:
1144:
1140:
1136:
1129:
1126:
1121:
1117:
1113:
1109:
1105:
1101:
1097:
1093:
1089:
1082:
1079:
1074:
1068:
1060:
1056:
1052:
1046:
1042:
1041:
1033:
1030:
1025:
1021:
1017:
1011:
1007:
1006:
998:
996:
992:
987:
983:
978:
973:
969:
965:
961:
957:
953:
949:
945:
938:
935:
930:
926:
922:
918:
914:
910:
906:
902:
898:
891:
888:
883:
879:
874:
869:
865:
861:
857:
853:
849:
845:
841:
834:
831:
826:
822:
818:
814:
810:
806:
802:
798:
794:
787:
784:
779:
767:
759:
755:
751:
747:
743:
739:
735:
731:
727:
723:
719:
712:
709:
704:
700:
696:
694:0-262-18120-7
690:
686:
679:
677:
673:
668:
664:
660:
658:0-262-18120-7
654:
650:
649:
641:
639:
637:
633:
628:
624:
620:
616:
612:
608:
604:
600:
596:
589:
586:
581:
577:
573:
569:
565:
561:
554:
551:
547:
541:
537:
533:
529:
522:
519:
514:
510:
506:
499:
496:
491:
487:
483:
479:
475:
471:
467:
463:
459:
455:
448:
445:
440:
434:
430:
423:
420:
415:
411:
407:
403:
399:
395:
388:
385:
378:
374:
371:
369:
366:
364:
361:
359:
358:Connectionism
356:
354:
351:
349:
348:Visual system
346:
345:
341:
336:
332:
329:
326:
323:
322:
321:
319:
311:
309:
307:
302:
300:
295:
293:
285:
283:
280:
275:
270:
268:
264:
256:
254:
246:
242:
240:
239:
236:time-varying
229:
227:
221:Learning rule
220:
218:
216:
208:
206:
204:
200:
192:
190:
183:
181:
174:
172:
170:
162:
157:
154:
151:
147:
146:
145:
139:
137:
131:
129:
126:
122:
116:Visual search
115:
113:
106:
104:
101:
97:
93:
89:
85:
80:
78:
74:
70:
62:
60:
58:
57:stroop effect
54:
50:
46:
42:
38:
34:
33:visual system
30:
26:
22:
1216:, retrieved
1194:
1185:
1142:
1138:
1128:
1095:
1091:
1081:
1039:
1032:
1004:
951:
947:
937:
904:
900:
890:
847:
843:
833:
803:(1): 46–54.
800:
796:
786:
766:cite journal
725:
721:
711:
684:
647:
602:
598:
588:
563:
559:
553:
527:
521:
498:
457:
453:
447:
428:
422:
397:
393:
387:
330:
324:
315:
305:
303:
296:
289:
271:
260:
251:
235:
233:
224:
214:
212:
198:
196:
187:
178:
166:
143:
135:
127:
123:
119:
110:
81:
66:
24:
18:
286:Limitations
1218:2022-02-16
1059:1150999656
1024:1273977481
907:(3): 480.
379:References
335:perception
215:net inputs
96:inhibitory
92:excitatory
63:Background
21:psychology
1159:0270-6474
1112:0963-7214
1067:cite book
968:0022-0949
921:0002-9556
864:1939-1277
817:0956-7976
742:0036-8075
627:145402215
619:0140-525X
474:1471-003X
414:0010-0285
261:To sense
199:net input
1232:Category
1177:18650336
1120:15808488
986:28724702
882:20873936
825:51773777
758:17812774
703:12837549
667:12837549
490:10518721
482:15378035
342:See also
203:matrices
100:function
75:through
53:memories
1168:6670853
977:5536890
929:1422636
873:3929106
750:1699673
722:Science
580:2200075
150:stimuli
88:synapse
1209:
1175:
1165:
1157:
1118:
1110:
1057:
1047:
1022:
1012:
984:
974:
966:
927:
919:
880:
870:
862:
823:
815:
756:
748:
740:
701:
691:
665:
655:
625:
617:
578:
542:
488:
480:
472:
435:
412:
169:vector
84:neuron
47:, and
41:motion
1116:S2CID
925:JSTOR
821:S2CID
746:JSTOR
623:S2CID
486:S2CID
263:depth
257:Depth
49:depth
45:shape
37:color
29:brain
1207:ISBN
1173:PMID
1155:ISSN
1108:ISSN
1073:link
1055:OCLC
1045:ISBN
1020:OCLC
1010:ISBN
982:PMID
964:ISSN
917:ISSN
878:PMID
860:ISSN
813:ISSN
778:help
754:PMID
738:ISSN
699:OCLC
689:ISBN
663:OCLC
653:ISBN
615:ISSN
576:PMID
540:ISBN
478:PMID
470:ISSN
433:ISBN
410:ISSN
316:The
1199:doi
1163:PMC
1147:doi
1100:doi
972:PMC
956:doi
952:220
909:doi
868:PMC
852:doi
805:doi
730:doi
726:236
607:doi
568:doi
532:doi
509:doi
462:doi
402:doi
94:or
19:In
1234::
1205:,
1193:,
1171:.
1161:.
1153:.
1143:28
1141:.
1137:.
1114:.
1106:.
1094:.
1090:.
1069:}}
1065:{{
1053:.
1018:.
994:^
980:.
970:.
962:.
950:.
946:.
923:.
915:.
905:98
903:.
899:.
876:.
866:.
858:.
848:36
846:.
842:.
819:.
811:.
799:.
795:.
770::
768:}}
764:{{
752:.
744:.
736:.
724:.
720:.
697:.
675:^
661:.
635:^
621:.
613:.
603:31
601:.
597:.
574:.
564:97
562:.
538:,
484:.
476:.
468:.
456:.
408:.
396:.
197:A
43:,
39:,
23:,
1201::
1179:.
1149::
1122:.
1102::
1096:1
1075:)
1061:.
1026:.
988:.
958::
931:.
911::
884:.
854::
827:.
807::
801:1
780:)
760:.
732::
705:.
669:.
629:.
609::
582:.
570::
534::
515:.
511::
492:.
464::
458:5
441:.
416:.
404::
398:6
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.
