1468:
223:
about the internal validity of web-based experiments. These methods control for differences in response times, address issues of selective attrition, concentration, and distraction, minimize subject concern about compensation, improve subject confidence that they have a real human partner in the experiment, and ensure that subjects have an appropriate understanding of the instructions and the decision problems in the experiment.
1456:
222:
Experimental protocols have been suggested to prevent or control difficulties associated with web-based experimentation. Methods like sequential subject matching, background timing and mouse use tracking, and instantaneous compensation through PayPal have the potential to address many of the concerns
300:
As more experiments have been conducted in economics, questions about appropriate methodology and study organization has been raised. Jerome
Hergueux and Nicolas Jacquemet developed an "online laboratory" to compare social preferences and risk aversion online and in person. They administered a risk
226:
Scholars have also formulated techniques to decrease or account for drop-outs, including the high-hurdle technique (motivationally adverse information is clustered at the beginning of the study), the seriousness check (requesting participant's probability estimate that they'll complete the study),
209:
Studies have been conducted to test the internal validity of web-based experiments, comparing across experimental conditions (online and offline) and successfully replicating findings. For example, Schoeffler et al. (2013) compared laboratory- and web-based results (62 and 1,168 subjects) of an
260:
are effective in educating jurors about unreliable expert evidence. Rather than sensitizing jurors to flaws in the other expert's testimony, the researchers found that jurors became more skeptical of all expert testimony. In her experiment, this led to more guilty verdicts. Levett and Kovera's
137:
and generalizability for the study. For instance, in web-based experiments there is less reliance on data gathered from populations of
Western undergraduate students who are often used as the default research subjects in social science disciplines. Because participants remain in their homes or
309:
An online field experiment conducted on 61 million
Facebook users tested whether receiving information about voting, polling places, and the voting behavior of one's friends led individuals to seek out political information, influenced political self-expression, and changed real-world voting
291:
Salganik, Dodds, and Watts conducted an experiment to measure social influence, specifically in the popularity rating of songs. Their use of the
Internet allowed them to collect over 14,000 participants and examine the relationship between individual and collective behavior.
322:, including studies of online communities and social networks, have used natural and field experiments to understand the effects of informal rewards in peer production on Knowledge (XXG), as well as the impact of early recognition and support on future successes on
240:
A wide range of psychology experiments are conducted on the web. The Web
Experiment List provides a way to recruit participants and archives past experiments (over 700 and growing). A good resource for designing a web experiment is the free
210:
auditory experiment and found no significant differences. A paired experiment in behavioral economics split into online and traditional lab environments produced substantively similar results. Uncompensated and unsupervised subjects on
412:
Reips, U.-D. & Krantz, J. H. (2010). Conducting true experiments on the Web. In S. Gosling & J. Johnson, Advanced
Internet Methods in the Behavioral Sciences (pp. 193-216). Washington, DC: American Psychological
402:
Reips, U.-D. (2007). The methodology of
Internet-based experiments. In A. Joinson, K. McKenna, T. Postmes, & U.-D. Reips (Eds.), The Oxford Handbook of Internet Psychology (pp. 373-390). Oxford: Oxford University
301:
aversion assessment, Public good game, a Trust game, a
Dictator game, and an Ultimatum game to groups both online and in a lab as a way of assessing the internal validity of web-based experimentation in economics.
166:. Online natural and field experiments may also face challenges generalizing findings beyond the online context in which they were conducted. Some potential difficulties faced by web-based experiments include:
245:
tool, which "dynamically creates the customized Web pages needed for the experimental procedure" and is remarkably easy to use. Web experiments have been used to validate results from laboratory research and
176:
Shorter decision times of online participants triggering instinctive and emotional reasoning processes rather than cognitive and rational ones, which could cause subjects to make more pro-social decisions on
78:. This form of experimental setup has become increasingly popular because researchers can cheaply collect large amounts of data from a wider range of locations and people. A web-based experiment is a type of
288:
are currently conducting a number of studies online to explore sound perception. Sound experiments over the web are particularly difficult due to lack of control over sound reproduction equipment.
256:
using web experiments is rising. For example, a number of psychology and law researchers have used the web to collect data. Lora Levett and
Margaret Bull Kovera examined whether opposing
250:
and to conduct new experiments that are only feasible if done online. Further, the materials created for web experiments can be used in a traditional laboratory setting if later desired.
101:
Natural experiments, conducted after a large-scale event which was prohibitively difficult or impossible to control, collect as many variables as possible then draw correlations.
1376:
82:. Web based experiments have become significantly more widespread since the COVID-19 pandemic, as researchers have been unable to conduct lab-based experiments.
334:, and Knowledge (XXG). Another experiment looked at the effect on edit rates of introducing a program of intelligent task assignment on Knowledge (XXG).
919:
Reips, U.-D. (1996, October). Experimenting on the World WideWeb. Paper presented at the 1996 Society for
Computers in Psychology conference, Chicago.
265:
of a trial, which participants then read before making their decision. This type of stimulus has been criticized by some researchers as lacking
1344:
1369:
929:
1312:
1204:
994:
966:"An Experiment About Estimating the Number of Instruments in Polyphonic Music: A Comparison Between Internet and Laboratory Results"
780:
Hoffman, M., & Morgan, J. (2011). Who’s Naughty? Who’s Nice? Social Preferences in Online Industries. UC Berkeley Working Paper.
104:
Field experiments, observed in a natural setting where less controls can be applied, have the advantage of better external validity.
186:
Variance in the data due to network connection speed and reliability, browser and computer types, screen size and resolution, etc.
90:
Experiments are an integral part of research, however, their integration with the Internet has been gradual. There are three main
1493:
1362:
227:
and the warm-up phase (placing consent forms or other pre-study materials first to winnow the samples before the study begins).
1498:
1187:
Zhu, Haiyi; Zhang, Amy; He, Jiping; Kraut, Robert E.; Kittur, Aniket (2013-01-01). "Effects of peer feedback on contribution".
1050:
Levett; Kovera (2008). "The Effectiveness of Opposing Expert Witnesses for Educating Jurors about Unreliable Expert Evidence".
610:; Dodds, P. S.; Watts, D. J. (2006). "Experimental Study of Inequality and Unpredictability in an Artificial Cultural Market".
943:
269:—that is, it does not closely approximate a real-life trial. Many recommend the use of video where possible. Researchers at
62:
are probably the disciplines that have used these experiments most widely, although a range of other disciplines including
183:
Subjects selectively dropping out of the experiment, especially if drop-out is correlated with the independent variable(s)
98:
Controlled experiments, done in a laboratory setting, attempt to control for all variables then test for a single effect.
1399:
858:
Shavit, T.; Sonsino, D.; Benzion, U. (2001). "A comparative study of lotteries-evaluation in class and on the Web".
253:
159:
50:
through which to target larger and more diverse samples with reduced administrative and financial costs" or "a
965:
496:
1338:
664:
Bond, R. M.; Fariss, C. J.; Jones, J. J.; Kramer, A. D. I.; Marlow, C.; Settle, J. E.; Fowler, J. H. (2012).
1440:
1385:
138:
offices while participating in the experiment, scholars have also argued that such experiments have greater
362:
70:
also use web-based experiments. Within psychology most web-based experiments are conducted in the areas of
79:
1430:
285:
151:
1467:
1241:
1133:
677:
619:
558:
180:
Significant distractions occurring during the course of the experiment unbeknownst to the researchers
71:
979:
Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing
885:
Eckel, C. C.; Wilson, R. K. (2006). "Internet cautions: Experimental games with Internet partners".
607:
270:
266:
195:
Subject concerns about compensation at the end of the experiment or anonymity of payment processing
139:
1425:
1415:
1318:
1210:
1075:
1000:
902:
840:
763:
643:
527:
385:
274:
116:
Web-based experiments are significantly less expensive, potentially allowing the researcher to:
1348:
1308:
1277:
1259:
1200:
1169:
1151:
1067:
990:
755:
703:
635:
586:
519:
464:
446:
163:
134:
75:
63:
318:
Web-based experiments have particular salience in studies of how online communities operate.
1420:
1300:
1267:
1249:
1192:
1159:
1141:
1059:
982:
894:
867:
832:
803:
745:
737:
693:
685:
627:
576:
566:
511:
454:
436:
377:
319:
262:
257:
203:
158:-based experiments, and may face greater difficulties coming up with procedures that ensure
59:
198:
The non-representative nature of the mostly English-speaking computer users who participate
1472:
750:
722:
823:
Kahneman, D. (2003). "Maps of bounded rationality: Psychology for behavioral economics".
214:
have been shown to replicate previous in-lab study results with comparable data quality.
1245:
1137:
681:
623:
562:
1460:
1272:
1229:
1164:
1121:
698:
665:
581:
546:
459:
424:
247:
173:
Experimental instructions ignored or read too carelessly, leading to lower quality data
1295:
Cosley, Dan; Frankowski, Dan; Terveen, Loren; Riedl, John (2007-01-01). "SuggestBot".
871:
808:
1487:
1228:
Rijt, Arnout van de; Kang, Soong Moon; Restivo, Michael; Patil, Akshay (2014-05-13).
767:
1214:
906:
844:
547:"Experimental evidence of massive-scale emotional contagion through social networks"
389:
1004:
647:
531:
17:
1322:
1079:
189:
Subjects taking the experiment less seriously and behaving with less risk-aversion
1146:
951:
323:
1297:
Proceedings of the 12th international conference on Intelligent user interfaces
836:
666:"A 61-million-person experiment in social influence and political mobilization"
515:
441:
1455:
1107:"Internet sound experiments | psychoacoustic tests University of Salford"
1063:
898:
741:
381:
327:
155:
91:
55:
39:
1263:
1155:
450:
170:
Difficulty verifying the identity of subjects participating in the experiment
1304:
1254:
1196:
1092:
986:
631:
571:
67:
1281:
1173:
1071:
791:
759:
707:
639:
590:
523:
468:
1354:
1189:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
331:
192:
Subjects not believing that they are interacting with real human partners
43:
689:
977:
Reinecke, Katharina; Gajos, Krzysztof Z. (2015-01-01). "LabintheWild".
120:
Reach more diverse samples, as well as rare or specific sub-populations
363:"Social preferences in the online laboratory: a randomized experiment"
242:
206:
experiments are just as affected by these problems, if not more so.
202:
In the face of these criticisms, some researchers have argued that
108:
The adaption of each type of experiment online faces some hurdles.
792:"Design and evaluation of an economic experiment via the Internet"
278:
126:
Recruit larger subject pools that provide higher statistical power
425:"No Participant Left Behind: Conducting Science During COVID-19"
1358:
211:
133:
These benefits have the potential to translate into greater
1341:, Ulf-Dietrich Reips and Ralph Lengler discuss experiences.
1122:"Experimental Study of Informal Rewards in Peer Production"
1106:
545:
Kramer, A. D. I.; Guillory, J. E.; Hancock, J. T. (2014).
981:. CSCW '15. New York, NY, USA: ACM. pp. 1364–1378.
1191:. CHI '13. New York, NY, USA: ACM. pp. 2253–2262.
1230:"Field experiments of success-breeds-success dynamics"
1018:
129:
Conduct cross-cultural social experiments in real time
1120:
Restivo, Michael; Rijt, Arnout van de (2012-03-29).
1408:
1392:
1299:. IUI '07. New York, NY, USA: ACM. pp. 32–41.
1036:
721:Henrich, J.; Heine, S. J.; Norenzayan, A. (2010).
423:Lourenco, Stella F.; Tasimi, Arber (2020-08-01).
46:. In such experiments, the Internet is either "a
1234:Proceedings of the National Academy of Sciences
796:Journal of Economic Behavior & Organization
551:Proceedings of the National Academy of Sciences
790:Anderhub, V.; Müller, R.; Schmidt, C. (2001).
54:of social science research in its own right."
1370:
930:"Virtual labs: Is there wisdom in the crowd?"
8:
497:"Standards for Internet-Based Experimenting"
1377:
1363:
1355:
1271:
1253:
1163:
1145:
807:
749:
697:
580:
570:
458:
440:
342:
150:Web-based experiments may have weaker
27:Experiment conducted over the Internet
7:
659:
657:
602:
600:
490:
488:
486:
484:
482:
480:
478:
361:Hergueux, J.; Jacquemet, N. (2014).
356:
354:
352:
350:
348:
346:
723:"The weirdest people in the world?"
25:
1466:
1454:
932:. New Scientist. 16 March 2007.
1351:through audio web experiments.
860:Journal of Economic Psychology
751:11858/00-001M-0000-0013-26A1-6
1:
872:10.1016/S0167-4870(01)00048-4
809:10.1016/s0167-2681(01)00195-0
730:Behavioral and Brain Sciences
1147:10.1371/journal.pone.0034358
825:The American Economic Review
495:Reips, Ulf-Dietrich (2002).
429:Trends in Cognitive Sciences
123:Run experiments more quickly
1400:Online qualitative research
273:are currently conducting a
42:that is conducted over the
1515:
964:Schoeffler et al. (2013).
837:10.1257/000282803322655392
516:10.1026/1618-3169.49.4.243
442:10.1016/j.tics.2020.05.003
254:Interdisciplinary research
146:Criticisms and limitations
1449:
1409:Specific research methods
1064:10.1007/s10979-007-9113-9
899:10.1007/s10683-006-4307-4
742:10.1017/s0140525x0999152x
382:10.1007/s10683-014-9400-5
92:categories of experiments
36:Internet-based experiment
305:Use in political science
261:research used a written
1494:Online research methods
1441:Online content analysis
1386:Online research methods
1339:The Web Experiment List
1305:10.1145/1216295.1216309
1255:10.1073/pnas.1316836111
1197:10.1145/2470654.2481311
987:10.1145/2675133.2675246
632:10.1126/science.1121066
572:10.1073/pnas.1320040111
504:Experimental Psychology
314:Use in internet studies
1499:Psychology experiments
1052:Law and Human Behavior
887:Experimental Economics
370:Experimental Economics
80:online research method
1436:Web-based experiments
1431:Online questionnaires
1094:Virginia vs. McNamara
286:University of Salford
281:of a criminal trial.
152:experimental controls
72:cognitive psychology
32:web-based experiment
1473:Internet portal
1246:2014PNAS..111.6934V
1138:2012PLoSO...734358R
944:"A Web of research"
690:10.1038/nature11421
682:2012Natur.489..295B
624:2006Sci...311..854S
563:2014PNAS..111.8788K
271:New York University
267:ecological validity
140:ecological validity
18:Web experiment list
1461:Society portal
1426:Online ethnography
1416:Online focus group
1037:"WEXTOR Webserver"
275:psychology and law
1481:
1480:
1349:public engagement
1240:(19): 6934–6939.
676:(7415): 295–298.
618:(5762): 854–856.
557:(24): 8788–8790.
236:Use in psychology
164:internal validity
135:external validity
76:social psychology
64:political science
16:(Redirected from
1506:
1471:
1470:
1459:
1458:
1421:Online interview
1379:
1372:
1365:
1356:
1327:
1326:
1292:
1286:
1285:
1275:
1257:
1225:
1219:
1218:
1184:
1178:
1177:
1167:
1149:
1117:
1111:
1110:
1103:
1097:
1090:
1084:
1083:
1047:
1041:
1040:
1033:
1027:
1026:
1015:
1009:
1008:
974:
968:
962:
956:
955:
950:. Archived from
940:
934:
933:
926:
920:
917:
911:
910:
882:
876:
875:
855:
849:
848:
831:(5): 1449–1475.
820:
814:
813:
811:
787:
781:
778:
772:
771:
753:
727:
718:
712:
711:
701:
661:
652:
651:
604:
595:
594:
584:
574:
542:
536:
535:
501:
492:
473:
472:
462:
444:
420:
414:
410:
404:
400:
394:
393:
367:
358:
320:Internet studies
296:Use in economics
277:study that uses
258:expert witnesses
204:brick-and-mortar
60:Internet studies
21:
1514:
1513:
1509:
1508:
1507:
1505:
1504:
1503:
1484:
1483:
1482:
1477:
1465:
1453:
1445:
1404:
1388:
1383:
1335:
1330:
1315:
1294:
1293:
1289:
1227:
1226:
1222:
1207:
1186:
1185:
1181:
1119:
1118:
1114:
1105:
1104:
1100:
1091:
1087:
1049:
1048:
1044:
1035:
1034:
1030:
1017:
1016:
1012:
997:
976:
975:
971:
963:
959:
942:
941:
937:
928:
927:
923:
918:
914:
884:
883:
879:
857:
856:
852:
822:
821:
817:
789:
788:
784:
779:
775:
725:
720:
719:
715:
663:
662:
655:
608:Salganik, M. J.
606:
605:
598:
544:
543:
539:
499:
494:
493:
476:
422:
421:
417:
411:
407:
401:
397:
365:
360:
359:
344:
340:
316:
307:
298:
284:Researchers at
238:
233:
220:
148:
114:
88:
28:
23:
22:
15:
12:
11:
5:
1512:
1510:
1502:
1501:
1496:
1486:
1485:
1479:
1478:
1476:
1475:
1463:
1450:
1447:
1446:
1444:
1443:
1438:
1433:
1428:
1423:
1418:
1412:
1410:
1406:
1405:
1403:
1402:
1396:
1394:
1390:
1389:
1384:
1382:
1381:
1374:
1367:
1359:
1353:
1352:
1342:
1334:
1333:External links
1331:
1329:
1328:
1314:978-1595934819
1313:
1287:
1220:
1205:
1179:
1112:
1098:
1085:
1042:
1028:
1010:
995:
969:
957:
954:on 2000-05-10.
935:
921:
912:
877:
866:(4): 483–491.
850:
815:
802:(2): 227–247.
782:
773:
736:(2–3): 61–83.
713:
653:
596:
537:
474:
435:(8): 583–584.
415:
405:
395:
376:(2): 251–283.
341:
339:
336:
315:
312:
306:
303:
297:
294:
248:field research
237:
234:
232:
229:
219:
216:
200:
199:
196:
193:
190:
187:
184:
181:
178:
174:
171:
147:
144:
131:
130:
127:
124:
121:
113:
110:
106:
105:
102:
99:
87:
84:
26:
24:
14:
13:
10:
9:
6:
4:
3:
2:
1511:
1500:
1497:
1495:
1492:
1491:
1489:
1474:
1469:
1464:
1462:
1457:
1452:
1451:
1448:
1442:
1439:
1437:
1434:
1432:
1429:
1427:
1424:
1422:
1419:
1417:
1414:
1413:
1411:
1407:
1401:
1398:
1397:
1395:
1391:
1387:
1380:
1375:
1373:
1368:
1366:
1361:
1360:
1357:
1350:
1346:
1343:
1340:
1337:
1336:
1332:
1324:
1320:
1316:
1310:
1306:
1302:
1298:
1291:
1288:
1283:
1279:
1274:
1269:
1265:
1261:
1256:
1251:
1247:
1243:
1239:
1235:
1231:
1224:
1221:
1216:
1212:
1208:
1206:9781450318990
1202:
1198:
1194:
1190:
1183:
1180:
1175:
1171:
1166:
1161:
1157:
1153:
1148:
1143:
1139:
1135:
1132:(3): e34358.
1131:
1127:
1123:
1116:
1113:
1108:
1102:
1099:
1096:
1095:
1089:
1086:
1081:
1077:
1073:
1069:
1065:
1061:
1058:(4): 363–74.
1057:
1053:
1046:
1043:
1038:
1032:
1029:
1024:
1020:
1014:
1011:
1006:
1002:
998:
996:9781450329224
992:
988:
984:
980:
973:
970:
967:
961:
958:
953:
949:
945:
939:
936:
931:
925:
922:
916:
913:
908:
904:
900:
896:
892:
888:
881:
878:
873:
869:
865:
861:
854:
851:
846:
842:
838:
834:
830:
826:
819:
816:
810:
805:
801:
797:
793:
786:
783:
777:
774:
769:
765:
761:
757:
752:
747:
743:
739:
735:
731:
724:
717:
714:
709:
705:
700:
695:
691:
687:
683:
679:
675:
671:
667:
660:
658:
654:
649:
645:
641:
637:
633:
629:
625:
621:
617:
613:
609:
603:
601:
597:
592:
588:
583:
578:
573:
568:
564:
560:
556:
552:
548:
541:
538:
533:
529:
525:
521:
517:
513:
510:(4): 243–56.
509:
505:
498:
491:
489:
487:
485:
483:
481:
479:
475:
470:
466:
461:
456:
452:
448:
443:
438:
434:
430:
426:
419:
416:
409:
406:
399:
396:
391:
387:
383:
379:
375:
371:
364:
357:
355:
353:
351:
349:
347:
343:
337:
335:
333:
329:
325:
321:
313:
311:
304:
302:
295:
293:
289:
287:
282:
280:
276:
272:
268:
264:
259:
255:
251:
249:
244:
235:
230:
228:
224:
218:Methodologies
217:
215:
213:
207:
205:
197:
194:
191:
188:
185:
182:
179:
175:
172:
169:
168:
167:
165:
161:
157:
153:
145:
143:
141:
136:
128:
125:
122:
119:
118:
117:
111:
109:
103:
100:
97:
96:
95:
93:
85:
83:
81:
77:
73:
69:
65:
61:
57:
53:
49:
45:
41:
37:
33:
19:
1435:
1296:
1290:
1237:
1233:
1223:
1188:
1182:
1129:
1125:
1115:
1101:
1093:
1088:
1055:
1051:
1045:
1031:
1022:
1013:
978:
972:
960:
952:the original
947:
938:
924:
915:
890:
886:
880:
863:
859:
853:
828:
824:
818:
799:
795:
785:
776:
733:
729:
716:
673:
669:
615:
611:
554:
550:
540:
507:
503:
432:
428:
418:
413:Association.
408:
398:
373:
369:
317:
308:
299:
290:
283:
252:
239:
225:
221:
212:LabintheWild
208:
201:
154:compared to
149:
132:
115:
107:
89:
86:Introduction
51:
47:
35:
31:
29:
1023:wexlist.net
948:www.apa.org
324:Kickstarter
160:reliability
1488:Categories
1393:Categories
338:References
328:Change.org
310:behavior.
263:transcript
156:laboratory
56:Psychology
40:experiment
1264:0027-8424
1156:1932-6203
893:: 53–66.
768:220918842
451:1364-6613
68:economics
1345:Tutorial
1282:24778230
1215:17167144
1174:22479610
1126:PLOS ONE
1072:17940854
907:30675518
845:15131441
760:20550733
708:22972300
640:16469928
591:24889601
524:12455331
469:32451239
390:14347177
332:Epinions
231:Examples
112:Benefits
44:Internet
1273:4024896
1242:Bibcode
1165:3315525
1134:Bibcode
1005:2739130
699:3834737
678:Bibcode
648:7310490
620:Bibcode
612:Science
582:4066473
559:Bibcode
532:2404134
460:7211671
177:average
1323:906034
1321:
1311:
1280:
1270:
1262:
1213:
1203:
1172:
1162:
1154:
1080:809273
1078:
1070:
1019:"Home"
1003:
993:
905:
843:
766:
758:
706:
696:
670:Nature
646:
638:
589:
579:
530:
522:
467:
457:
449:
403:Press.
388:
243:Wextor
48:medium
38:is an
1319:S2CID
1211:S2CID
1076:S2CID
1001:S2CID
903:S2CID
841:S2CID
764:S2CID
726:(PDF)
644:S2CID
528:S2CID
500:(PDF)
386:S2CID
366:(PDF)
279:video
52:field
1309:ISBN
1278:PMID
1260:ISSN
1201:ISBN
1170:PMID
1152:ISSN
1068:PMID
991:ISBN
756:PMID
704:PMID
636:PMID
587:PMID
520:PMID
465:PMID
447:ISSN
162:and
74:and
66:and
58:and
1347:on
1301:doi
1268:PMC
1250:doi
1238:111
1193:doi
1160:PMC
1142:doi
1060:doi
983:doi
895:doi
868:doi
833:doi
804:doi
746:hdl
738:doi
694:PMC
686:doi
674:489
628:doi
616:311
577:PMC
567:doi
555:111
512:doi
455:PMC
437:doi
378:doi
34:or
1490::
1317:.
1307:.
1276:.
1266:.
1258:.
1248:.
1236:.
1232:.
1209:.
1199:.
1168:.
1158:.
1150:.
1140:.
1128:.
1124:.
1074:.
1066:.
1056:32
1054:.
1021:.
999:.
989:.
946:.
901:.
889:.
864:22
862:.
839:.
829:93
827:.
800:46
798:.
794:.
762:.
754:.
744:.
734:33
732:.
728:.
702:.
692:.
684:.
672:.
668:.
656:^
642:.
634:.
626:.
614:.
599:^
585:.
575:.
565:.
553:.
549:.
526:.
518:.
508:49
506:.
502:.
477:^
463:.
453:.
445:.
433:24
431:.
427:.
384:.
374:18
372:.
368:.
345:^
330:,
326:,
142:.
94::
30:A
1378:e
1371:t
1364:v
1325:.
1303::
1284:.
1252::
1244::
1217:.
1195::
1176:.
1144::
1136::
1130:7
1109:.
1082:.
1062::
1039:.
1025:.
1007:.
985::
909:.
897::
891:9
874:.
870::
847:.
835::
812:.
806::
770:.
748::
740::
710:.
688::
680::
650:.
630::
622::
593:.
569::
561::
534:.
514::
471:.
439::
392:.
380::
20:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.