63:
The purpose of this page is to measure the efficacy of different user talk templates through randomized testing. This effort does not entail creating new categories of user warnings or to organize them more efficiently, but rather to improve on the quality of our current communication methods.
435:
Those pages each have lists and dates of all the templates tested including results if available. The following are tracking tables with start and end dates. For tests in projects other than
English Knowledge (XXG), please see
1604:
A "randomizer" that delivers all the templates in your test. This is the template that should be included in the configuration of whichever bot or tool you are testing with, and it randomly delivers one of the templates via a
1616:, usually the existing default template. Note that you should replicate the default in a new template rather than use the current template page, in order to avoid including old instances of the default in your experiment.
413:
419:
424:
67:
We're aiming to fine tune the template messages we send to editors, in order to encourage more good faith contributors and discourage outright vandals, spammers, and other bad faith contributors.
1600:
of any user talk template. Doing randomized experiments allows us to get hard data about what kinds of content are most successful at helping us achieve these goals. What you'll need is...
403:
344:
398:
352:
408:
356:
51:
This page is the tracking page for efforts on the
English Knowledge (XXG) to improve the quality of user talk warnings. Links to this project on other Wikipedias can be found on the
393:
388:
1626:
tracking template for all templates being tested. If you do not include a separate Z number in each template, you will lose track of your test cases once they are substituted.
429:
901:
Level 1-4 spam warnings, 4 total. 1 test template (personal + no directives) and 1 control; Welcomeg and welcomeanon, 1 test template (personal + no directives) and 1 control
362:
437:
1619:
A new version or versions of the template you want to test. Try to use a canonical name that matches the type, purpose, and level of the warning you're interested in.
1638:
We have so far used a mixed method of both quantitative measurement and qualitative assessment. If you'd like to help sort and analyze tests, please sign up above.
347:
new templates or assess the templates that are currently in the draft phase and suggest improvements in their content or structure. We aim to lessen the
17:
144:
1659:
1232:
1406:
Copyvio notifications, 6 total. 1 test template (personal + no directives) and 1 control; welcomelaws, 1 test (short) and 1 control.
268:
1643:
1275:
Image notifications about sourcing/licensing, 4 total. 2 test templates (directives, no directives) and 1 control.
1537:
Test edit warning, registered and unregistered, 2 total. 1 test template (personal + no directives) and 1 control
311:
248:
1630:
In some cases, such as for bots where all contribs are by one account, this method can be greatly simplified.
369:
1239:
1623:
613:
All level 1 warnings (except vandalism), 9 total. 1 test template (personal + no directives) and 1 control
264:
158:
84:
317:
302:
162:
34:
340:
Any effort to make templates more simple, friendly, and accessible is welcome. Specifically, you can:
1270:
308:
259:
1578:
1569:
1560:
1551:
1520:
1511:
1502:
1493:
1484:
1475:
1466:
1457:
1448:
1439:
1430:
1421:
1401:
1389:
1380:
1371:
1362:
1353:
1344:
1335:
1326:
1317:
1308:
1299:
1290:
1200:
1191:
1182:
1173:
1164:
1155:
1146:
1137:
1128:
1119:
1110:
1101:
1092:
1083:
1074:
1065:
1056:
177:
104:
1047:
1017:
1008:
999:
990:
980:
971:
962:
953:
944:
935:
926:
917:
886:
877:
868:
838:
829:
820:
811:
781:
772:
763:
754:
745:
736:
727:
718:
709:
700:
691:
682:
673:
664:
655:
646:
637:
628:
598:
589:
580:
550:
541:
532:
523:
514:
505:
496:
487:
52:
1613:
329:
284:
201:
124:
565:
Level 1 vandalism warning. 2 test templates (personal, personal + no directives) and 1 control
472:
Level 1 vandalism warning. 3 test templates (image/no image; teaching, personal) and 1 control
99:
79:
348:
1212:
154:
149:
853:
Level 1 vandalism warning. 2 test templates (personal + no directives, short) and 1 control
368:
Help us analyze our data. We're using mixed methods, with both quantitative statistics and
299:
182:
1606:
1217:
Newbie CSD tag removal warning, 1 test template (personal + no directives) and 1 control
796:
AfD and PROD notices, 2 total. 1 test template (personal + no directives) and 1 control
228:
218:
213:
129:
94:
23:
1653:
1244:
archiving of shared and dynamic IP talk pages regularly to remove irrelevant warnings
274:
223:
193:
187:
167:
114:
1032:
All issue-specific level 1 warnings, 9 total. 1 test template (short) and 1 control
294:
243:
109:
89:
1597:
324:
289:
279:
253:
134:
1532:
238:
233:
172:
139:
1259:
119:
1263:
75:
Sign up here if you'd like to stay notified about testing updates.
365:
which templates to test next and what changes should be made.
1596:
The following are the requirements to conduct comparative
351:
of warnings, but templates should still comply with the
42:
384:
Templates have been tested in the following places:
8:
18:Knowledge (XXG):WikiProject User warnings
442:
1642:Testing results from all projects are
196:(as one of the operators of XLinkBot)
145:User:The Blade of the Northern Lights
7:
31:
1260:List of all archived talk pages
318:02:49, 15 September 2012 (UTC)
1:
163:21:53, 25 October 2011 (UTC)
1676:
375:Recruit more participants.
32:
1660:WikiProject User warnings
303:19:49, 27 June 2012 (UTC)
249:User:Johannes Rohr (WMDE)
190:(forced by its operators)
1264:SharedIPArchiveBot's log
24:Knowledge (XXG):UWTEST
414:Articles for creation
464:Data (if available)
1240:Shared IP archiving
105:User:Philippe (WMF)
568:September 25, 2011
461:Tracking templates
370:qualitative coding
330:User:Rdicerb_(WMF)
125:User:Fluffernutter
85:User:Maryana (WMF)
1589:
1588:
1284:30 days (minimum)
1281:February 21, 2012
1278:December 21, 2011
1250:February 19, 2012
1247:December 19, 2011
1038:December 22, 2011
1035:November 22, 2011
907:December 17, 2011
904:November 17, 2011
619:November 19, 2011
449:Brief description
353:design guidelines
321:
100:User:Vitor Mazuco
80:User:Steven (WMF)
22:(Redirected from
1667:
1583:
1577:
1574:
1568:
1565:
1559:
1556:
1550:
1540:January 19, 2012
1525:
1519:
1516:
1510:
1507:
1501:
1498:
1492:
1489:
1483:
1480:
1474:
1471:
1465:
1462:
1456:
1453:
1447:
1444:
1438:
1435:
1429:
1426:
1420:
1412:January 31, 2012
1409:January 12, 2012
1394:
1388:
1385:
1379:
1376:
1370:
1367:
1361:
1358:
1352:
1349:
1343:
1340:
1334:
1331:
1325:
1322:
1316:
1313:
1307:
1304:
1298:
1295:
1289:
1220:November 3, 2011
1205:
1199:
1196:
1190:
1187:
1181:
1178:
1172:
1169:
1163:
1160:
1154:
1151:
1145:
1142:
1136:
1133:
1127:
1124:
1118:
1115:
1109:
1106:
1100:
1097:
1091:
1088:
1082:
1079:
1073:
1070:
1064:
1061:
1055:
1052:
1046:
1022:
1016:
1013:
1007:
1004:
998:
995:
989:
985:
979:
976:
970:
967:
961:
958:
952:
949:
943:
940:
934:
931:
925:
922:
916:
891:
885:
882:
876:
873:
867:
859:December 9, 2011
856:November 8, 2011
843:
837:
834:
828:
825:
819:
816:
810:
802:December 9, 2011
799:November 9, 2011
786:
780:
777:
771:
768:
762:
759:
753:
750:
744:
741:
735:
732:
726:
723:
717:
714:
708:
705:
699:
696:
690:
687:
681:
678:
672:
669:
663:
660:
654:
651:
645:
642:
636:
633:
627:
616:October 18, 2011
603:
597:
594:
588:
585:
579:
571:October 10, 2011
555:
549:
546:
540:
537:
531:
528:
522:
519:
513:
510:
504:
501:
495:
492:
486:
443:
357:usage and layout
316:
265:Martijn Hoekstra
210:
208:
204:
150:User:Writ Keeper
45:
27:
1675:
1674:
1670:
1669:
1668:
1666:
1665:
1664:
1650:
1649:
1636:
1607:parser function
1594:
1581:
1575:
1572:
1566:
1563:
1557:
1554:
1548:
1523:
1517:
1514:
1508:
1505:
1499:
1496:
1490:
1487:
1481:
1478:
1472:
1469:
1463:
1460:
1454:
1451:
1445:
1442:
1436:
1433:
1427:
1424:
1418:
1392:
1386:
1383:
1377:
1374:
1368:
1365:
1359:
1356:
1350:
1347:
1341:
1338:
1332:
1329:
1323:
1320:
1314:
1311:
1305:
1302:
1296:
1293:
1287:
1271:ImageTaggingBot
1223:January 3, 2012
1203:
1197:
1194:
1188:
1185:
1179:
1176:
1170:
1167:
1161:
1158:
1152:
1149:
1143:
1140:
1134:
1131:
1125:
1122:
1116:
1113:
1107:
1104:
1098:
1095:
1089:
1086:
1080:
1077:
1071:
1068:
1062:
1059:
1053:
1050:
1044:
1020:
1014:
1011:
1005:
1002:
996:
993:
987:
983:
977:
974:
968:
965:
959:
956:
950:
947:
941:
938:
932:
929:
923:
920:
914:
889:
883:
880:
874:
871:
865:
841:
835:
832:
826:
823:
817:
814:
808:
784:
778:
775:
769:
766:
760:
757:
751:
748:
742:
739:
733:
730:
724:
721:
715:
712:
706:
703:
697:
694:
688:
685:
679:
676:
670:
667:
661:
658:
652:
649:
643:
640:
634:
631:
625:
601:
595:
592:
586:
583:
577:
553:
547:
544:
538:
535:
529:
526:
520:
517:
511:
508:
502:
499:
493:
490:
484:
438:our hub on Meta
420:ImageTaggingBot
382:
359:best practices.
338:
285:User:Rcsprinter
206:
200:
199:
73:
61:
49:
48:
41:
37:
29:
28:
21:
20:
12:
11:
5:
1673:
1671:
1663:
1662:
1652:
1651:
1644:available here
1635:
1632:
1628:
1627:
1620:
1617:
1610:
1593:
1592:Testing method
1590:
1587:
1586:
1584:
1546:
1544:
1543:March 27, 2012
1541:
1538:
1535:
1529:
1528:
1526:
1416:
1413:
1410:
1407:
1404:
1402:CorenSearchBot
1398:
1397:
1395:
1285:
1282:
1279:
1276:
1273:
1267:
1266:
1257:
1254:
1251:
1248:
1245:
1242:
1236:
1235:
1230:
1227:
1224:
1221:
1218:
1215:
1209:
1208:
1206:
1042:
1039:
1036:
1033:
1030:
1029:Huggle short 2
1026:
1025:
1023:
911:
908:
905:
902:
899:
895:
894:
892:
863:
860:
857:
854:
851:
850:Huggle short 1
847:
846:
844:
806:
803:
800:
797:
794:
790:
789:
787:
623:
620:
617:
614:
611:
607:
606:
604:
575:
572:
569:
566:
563:
559:
558:
556:
482:
479:
478:August 5, 2011
476:
473:
470:
466:
465:
462:
459:
456:
453:
450:
447:
433:
432:
427:
425:CorenSearchBot
422:
417:
411:
406:
401:
396:
391:
381:
378:
377:
376:
373:
366:
360:
337:
334:
333:
332:
327:
322:
305:
297:
292:
287:
282:
277:
272:
262:
257:
251:
246:
241:
236:
231:
229:User:gwickwire
226:
221:
219:User:Recon Etc
216:
214:User:Racconish
211:
197:
191:
185:
180:
178:Hurricanefan25
175:
170:
165:
152:
147:
142:
137:
132:
130:User:Wikipelli
127:
122:
117:
112:
107:
102:
97:
95:User:EpochFail
92:
87:
82:
72:
69:
60:
57:
53:cross-wiki hub
47:
46:
38:
33:
30:
15:
14:
13:
10:
9:
6:
4:
3:
2:
1672:
1661:
1658:
1657:
1655:
1648:
1647:
1645:
1639:
1633:
1631:
1625:
1621:
1618:
1615:
1611:
1608:
1603:
1602:
1601:
1599:
1591:
1585:
1580:
1571:
1562:
1553:
1547:
1545:
1542:
1539:
1536:
1534:
1531:
1530:
1527:
1522:
1513:
1504:
1495:
1486:
1477:
1468:
1459:
1450:
1441:
1432:
1423:
1417:
1414:
1411:
1408:
1405:
1403:
1400:
1399:
1396:
1391:
1382:
1373:
1364:
1355:
1346:
1337:
1328:
1319:
1310:
1301:
1292:
1286:
1283:
1280:
1277:
1274:
1272:
1269:
1268:
1265:
1261:
1258:
1255:
1252:
1249:
1246:
1243:
1241:
1238:
1237:
1234:
1231:
1228:
1225:
1222:
1219:
1216:
1214:
1211:
1210:
1207:
1202:
1193:
1184:
1175:
1166:
1157:
1148:
1139:
1130:
1121:
1112:
1103:
1094:
1085:
1076:
1067:
1058:
1049:
1043:
1040:
1037:
1034:
1031:
1028:
1027:
1024:
1019:
1010:
1001:
992:
982:
973:
964:
955:
946:
937:
928:
919:
912:
909:
906:
903:
900:
897:
896:
893:
888:
879:
870:
864:
861:
858:
855:
852:
849:
848:
845:
840:
831:
822:
813:
807:
804:
801:
798:
795:
792:
791:
788:
783:
774:
765:
756:
747:
738:
729:
720:
711:
702:
693:
684:
675:
666:
657:
648:
639:
630:
624:
621:
618:
615:
612:
609:
608:
605:
600:
591:
582:
576:
573:
570:
567:
564:
561:
560:
557:
552:
543:
534:
525:
516:
507:
498:
489:
483:
480:
477:
475:July 19, 2011
474:
471:
468:
467:
463:
460:
457:
454:
451:
448:
445:
444:
441:
439:
431:
428:
426:
423:
421:
418:
415:
412:
410:
407:
405:
402:
400:
397:
395:
392:
390:
387:
386:
385:
379:
374:
371:
367:
364:
361:
358:
354:
350:
346:
343:
342:
341:
335:
331:
328:
326:
323:
319:
314:
313:
310:
306:
304:
301:
298:
296:
293:
291:
288:
286:
283:
281:
278:
276:
275:User:Gaijin42
273:
270:
266:
263:
261:
258:
256:(AFC related)
255:
252:
250:
247:
245:
242:
240:
237:
235:
232:
230:
227:
225:
224:User:Jayen466
222:
220:
217:
215:
212:
207:Pigsonthewing
203:
198:
195:
192:
189:
186:
184:
181:
179:
176:
174:
171:
169:
168:User:Jtmorgan
166:
164:
160:
156:
153:
151:
148:
146:
143:
141:
138:
136:
133:
131:
128:
126:
123:
121:
118:
116:
115:User:Kubigula
113:
111:
108:
106:
103:
101:
98:
96:
93:
91:
88:
86:
83:
81:
78:
77:
76:
70:
68:
65:
58:
56:
54:
44:
40:
39:
36:
25:
19:
1641:
1640:
1637:
1629:
1595:
986:; welcomes:
452:Date started
434:
383:
339:
307:
295:User:Ciphers
244:User:Snowolf
202:Andy Mabbett
110:User:Kudpung
90:User:Staeiou
74:
71:Participants
66:
62:
50:
1598:A/B testing
1213:SDPatrolBot
404:SDPatrolBot
325:User:Lexein
290:User:JohnCD
280:User:DMacks
254:User:mabdul
155:Eraserhead1
913:spam 1-4:
455:Date ended
399:Shared IPs
349:bitey-ness
312:Farmbrough
300:Nathan2055
239:User:Logan
234:User:Thogo
183:Ljhenshall
55:on Meta.
1233:Wikitable
793:Twinkle 1
446:Test name
260:Katarighe
173:User:Chzz
43:WP:UWTEST
1654:Category
1634:Analysis
1624:Z number
1253:2 months
1226:2 months
898:XLinkBot
610:Huggle 3
574:~2 weeks
562:Huggle 2
481:~2 weeks
469:Huggle 1
458:Duration
409:XLinkBot
355:and the
194:Beetstra
188:XLinkBot
120:User:DGG
35:Shortcut
1614:control
1415:1 month
1041:1 month
910:1 month
862:1 month
805:1 month
622:1 month
394:Twinkle
363:Suggest
389:Huggle
135:Ebe123
1533:28bot
430:28bot
416:(Afc)
380:Tests
345:Draft
336:Tasks
161:: -->
59:Scope
16:<
1579:z146
1570:z145
1561:z144
1552:z143
1521:z128
1512:z127
1503:z126
1494:z125
1485:z124
1476:z123
1467:z122
1458:z121
1449:z120
1440:z119
1431:z118
1422:z117
1390:z142
1381:z141
1372:z140
1363:z139
1354:z138
1345:z137
1336:z136
1327:z135
1318:z134
1309:z133
1300:z132
1291:z131
1201:z116
1192:z115
1183:z114
1174:z113
1165:z112
1156:z111
1147:z110
1138:z109
1129:z108
1120:z107
1111:z106
1102:z105
1093:z104
1084:z103
1075:z102
1066:z101
1057:z100
309:Rich
269:talk
159:talk
157:<
1048:z99
1018:z98
1009:z97
1000:z96
991:z95
981:z94
972:z93
963:z92
954:z91
945:z90
936:z89
927:z88
918:z87
887:z86
878:z85
869:z84
839:z82
830:z81
821:z79
812:z78
782:z77
773:z76
764:z75
755:z74
746:z73
737:z72
728:z71
719:z70
710:z69
701:z68
692:z67
683:z66
674:z65
665:z64
656:z63
647:z62
638:z61
629:z60
599:z59
590:z58
581:z57
551:z56
542:z55
533:z54
524:z53
515:z52
506:z51
497:z50
488:z49
1656::
1622:A
1612:A
1582:}}
1576:{{
1573:}}
1567:{{
1564:}}
1558:{{
1555:}}
1549:{{
1524:}}
1518:{{
1515:}}
1509:{{
1506:}}
1500:{{
1497:}}
1491:{{
1488:}}
1482:{{
1479:}}
1473:{{
1470:}}
1464:{{
1461:}}
1455:{{
1452:}}
1446:{{
1443:}}
1437:{{
1434:}}
1428:{{
1425:}}
1419:{{
1393:}}
1387:{{
1384:}}
1378:{{
1375:}}
1369:{{
1366:}}
1360:{{
1357:}}
1351:{{
1348:}}
1342:{{
1339:}}
1333:{{
1330:}}
1324:{{
1321:}}
1315:{{
1312:}}
1306:{{
1303:}}
1297:{{
1294:}}
1288:{{
1262:,
1204:}}
1198:{{
1195:}}
1189:{{
1186:}}
1180:{{
1177:}}
1171:{{
1168:}}
1162:{{
1159:}}
1153:{{
1150:}}
1144:{{
1141:}}
1135:{{
1132:}}
1126:{{
1123:}}
1117:{{
1114:}}
1108:{{
1105:}}
1099:{{
1096:}}
1090:{{
1087:}}
1081:{{
1078:}}
1072:{{
1069:}}
1063:{{
1060:}}
1054:{{
1051:}}
1045:{{
1021:}}
1015:{{
1012:}}
1006:{{
1003:}}
997:{{
994:}}
988:{{
984:}}
978:{{
975:}}
969:{{
966:}}
960:{{
957:}}
951:{{
948:}}
942:{{
939:}}
933:{{
930:}}
924:{{
921:}}
915:{{
890:}}
884:{{
881:}}
875:{{
872:}}
866:{{
842:}}
836:{{
833:}}
827:{{
824:}}
818:{{
815:}}
809:{{
785:}}
779:{{
776:}}
770:{{
767:}}
761:{{
758:}}
752:{{
749:}}
743:{{
740:}}
734:{{
731:}}
725:{{
722:}}
716:{{
713:}}
707:{{
704:}}
698:{{
695:}}
689:{{
686:}}
680:{{
677:}}
671:{{
668:}}
662:{{
659:}}
653:{{
650:}}
644:{{
641:}}
635:{{
632:}}
626:{{
602:}}
596:{{
593:}}
587:{{
584:}}
578:{{
554:}}
548:{{
545:}}
539:{{
536:}}
530:{{
527:}}
521:{{
518:}}
512:{{
509:}}
503:{{
500:}}
494:{{
491:}}
485:{{
440:.
315:,
1646:.
1609:.
1256:—
1229:—
372:.
320:.
271:)
267:(
209:)
205:(
140:Σ
26:)
Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.