Knowledge (XXG)

Fisher consistency

Source đź“ť

936:. Fisher consistency and asymptotic consistency are distinct concepts, although both aim to define a desirable property of an estimator. While many estimators are consistent in both senses, neither definition encompasses the other. For example, suppose we take an estimator 797: 389: 979:
on (0,θ) and we wish to estimate θ. The sample maximum is Fisher consistent, but downwardly biased. Conversely, the sample variance is an unbiased estimate of the population variance, but is not Fisher consistent.
642: 178: 904: 234: 661: 319: 1124: 964:
is a deterministic sequence of nonzero numbers converging to zero. This estimator is asymptotically consistent, but not Fisher consistent for any
530: 1108: 1083: 976: 77: 104: 1014:
Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character
975:
estimate of the population mean, but not all Fisher consistent estimates are unbiased. Suppose we observe a sample from a
119: 249: 988:
A loss function is Fisher consistent if the population minimizer of the risk leads to the Bayes optimal decision rule.
292: 824: 1177: 193: 100: 1128: 1182: 33: 1096: 1021: 972: 933: 49: 37: 1009: 1057: 652: 280:
over all permutations of the data. The resulting estimator will have the same expected value as
1104: 1079: 792:{\displaystyle n^{-1}\sum _{i=1}^{n}\sum _{j=1}^{m}p_{j}Z_{j}=n^{-1}\sum _{i=1}^{n}\mu =\mu ,} 29: 1049: 1039: 1029: 1053: 521: 1025: 517: 1171: 1150: 1005: 25: 384:{\displaystyle T\left(\lim _{n\rightarrow \infty }{\hat {F}}_{n}\right)=\theta .\,} 309:, allowing us to express Fisher consistency as a limit — the estimator is 17: 943:
that is both Fisher consistent and asymptotically consistent, and then form
89: 1034: 637:{\displaystyle n^{-1}\sum _{i=1}^{n}\sum _{j=1}^{m}I(X_{i}=Z_{j})Z_{j},} 428:
taking on each value in the population. Writing our estimator of θ as
1044: 1061: 32:
asserting that if the estimator were calculated using the entire
40:, the true value of the estimated parameter would be obtained. 814:
gives an estimate that is Fisher consistent for a parameter
1010:"On the mathematical foundations of theoretical statistics" 1125:"Natural Increase Refers to Net Population Growth Rates" 399:
Suppose our sample is obtained from a finite population
924:
Relationship to asymptotic consistency and unbiasedness
932:
in statistics usually refers to an estimator that is
827: 664: 533: 322: 295:
can be applied, the empirical distribution functions
196: 173:{\displaystyle {\hat {\theta }}=T({\hat {F}}_{n})\,,} 122: 898: 791: 636: 383: 228: 172: 655:. The population analogue of this expression is 332: 284:and its variance will be no larger than that of 899:{\displaystyle E\left=0{\text{ at }}b=b_{0},\,} 454:), the population analogue of the estimator is 1158:Statistics 881: Advanced Statistical Learning 8: 99:based on the sample can be represented as a 971:The sample mean is a Fisher consistent and 1043: 1033: 895: 886: 871: 835: 826: 771: 760: 747: 734: 724: 714: 703: 693: 682: 669: 663: 625: 612: 599: 583: 572: 562: 551: 538: 532: 516:Suppose the parameter of interest is the 417:in terms of the proportion of the sample 380: 360: 349: 348: 335: 321: 229:{\displaystyle T(F_{\theta })=\theta \,.} 222: 207: 195: 166: 157: 146: 145: 124: 123: 121: 997: 413:. We can represent our sample of size 806:Role in maximum likelihood estimation 7: 810:Maximising the likelihood function 265:can be converted into an estimator 342: 14: 1101:Robust Statistical Methods with R 269:that can be defined in terms of 28:, is a desirable property of an 1074:Cox, D.R., Hinkley D.V. (1974) 802:so we have Fisher consistency. 105:empirical distribution function 1149:Lee, Yoonkyung (Spring 2008). 618: 592: 354: 339: 213: 200: 163: 151: 141: 129: 1: 916:represents the true value of 183:the estimator is said to be 88:which depends on an unknown 520:ÎĽ and the estimator is the 293:strong law of large numbers 1199: 934:asymptotically consistent 395:Finite population example 1160:. Ohio State University. 256:defined in terms of the 984:Role in decision theory 524:, which can be written 78:cumulative distribution 1076:Theoretical Statistics 1035:10.1098/rsta.1922.0009 900: 793: 776: 719: 698: 638: 588: 567: 385: 302:converge pointwise to 230: 174: 95:. If an estimator of 901: 794: 756: 699: 678: 639: 568: 547: 386: 231: 175: 1099:; Jan Picek (2006). 1078:, Chapman and Hall, 1020:(594–604): 309–368. 977:uniform distribution 825: 662: 531: 320: 194: 120: 1086:. (defined on p287) 1026:1922RSPTA.222..309F 896: 789: 653:indicator function 634: 493:Fisher consistency 381: 346: 226: 170: 50:statistical sample 48:Suppose we have a 22:Fisher consistency 1178:Estimation theory 874: 859: 513:) = Î¸. 491:). Thus we have 357: 331: 311:Fisher consistent 185:Fisher consistent 154: 132: 1190: 1162: 1161: 1155: 1146: 1140: 1139: 1137: 1136: 1127:. Archived from 1121: 1115: 1114: 1093: 1087: 1072: 1066: 1065: 1047: 1037: 1002: 905: 903: 902: 897: 891: 890: 875: 872: 864: 860: 858: 850: 836: 798: 796: 795: 790: 775: 770: 755: 754: 739: 738: 729: 728: 718: 713: 697: 692: 677: 676: 643: 641: 640: 635: 630: 629: 617: 616: 604: 603: 587: 582: 566: 561: 546: 545: 390: 388: 387: 382: 370: 366: 365: 364: 359: 358: 350: 345: 235: 233: 232: 227: 212: 211: 179: 177: 176: 171: 162: 161: 156: 155: 147: 134: 133: 125: 1198: 1197: 1193: 1192: 1191: 1189: 1188: 1187: 1168: 1167: 1166: 1165: 1153: 1148: 1147: 1143: 1134: 1132: 1123: 1122: 1118: 1111: 1097:JureÄŤková, Jana 1095: 1094: 1090: 1073: 1069: 1004: 1003: 999: 994: 986: 963: 956: 949: 942: 926: 915: 882: 851: 837: 831: 823: 822: 808: 743: 730: 720: 665: 660: 659: 621: 608: 595: 534: 529: 528: 512: 505: 490: 475: 471: 464: 449: 438: 423: 412: 405: 397: 347: 330: 326: 318: 317: 307: 300: 274: 264: 252:, an estimator 247: 239:As long as the 203: 192: 191: 144: 118: 117: 111: 87: 75: 66: 57: 46: 12: 11: 5: 1196: 1194: 1186: 1185: 1180: 1170: 1169: 1164: 1163: 1141: 1116: 1109: 1088: 1067: 996: 995: 993: 990: 985: 982: 961: 954: 947: 940: 925: 922: 913: 907: 906: 894: 889: 885: 881: 878: 873: at  870: 867: 863: 857: 854: 849: 846: 843: 840: 834: 830: 807: 804: 800: 799: 788: 785: 782: 779: 774: 769: 766: 763: 759: 753: 750: 746: 742: 737: 733: 727: 723: 717: 712: 709: 706: 702: 696: 691: 688: 685: 681: 675: 672: 668: 645: 644: 633: 628: 624: 620: 615: 611: 607: 602: 598: 594: 591: 586: 581: 578: 575: 571: 565: 560: 557: 554: 550: 544: 541: 537: 518:expected value 510: 503: 488: 473: 469: 462: 447: 436: 421: 410: 403: 396: 393: 392: 391: 379: 376: 373: 369: 363: 356: 353: 344: 341: 338: 334: 329: 325: 305: 298: 272: 260: 243: 237: 236: 225: 221: 218: 215: 210: 206: 202: 199: 181: 180: 169: 165: 160: 153: 150: 143: 140: 137: 131: 128: 109: 83: 71: 62: 55: 45: 42: 36:rather than a 24:, named after 13: 10: 9: 6: 4: 3: 2: 1195: 1184: 1183:Ronald Fisher 1181: 1179: 1176: 1175: 1173: 1159: 1152: 1151:"Consistency" 1145: 1142: 1131:on 2009-03-13 1130: 1126: 1120: 1117: 1112: 1110:1-58488-454-1 1106: 1103:. CRC Press. 1102: 1098: 1092: 1089: 1085: 1084:0-412-12420-3 1081: 1077: 1071: 1068: 1063: 1059: 1055: 1051: 1046: 1041: 1036: 1031: 1027: 1023: 1019: 1015: 1011: 1007: 1001: 998: 991: 989: 983: 981: 978: 974: 969: 967: 960: 953: 950: +  946: 939: 935: 931: 923: 921: 919: 912: 892: 887: 883: 879: 876: 868: 865: 861: 855: 852: 847: 844: 841: 838: 832: 828: 821: 820: 819: 817: 813: 805: 803: 786: 783: 780: 777: 772: 767: 764: 761: 757: 751: 748: 744: 740: 735: 731: 725: 721: 715: 710: 707: 704: 700: 694: 689: 686: 683: 679: 673: 670: 666: 658: 657: 656: 654: 650: 631: 626: 622: 613: 609: 605: 600: 596: 589: 584: 579: 576: 573: 569: 563: 558: 555: 552: 548: 542: 539: 535: 527: 526: 525: 523: 519: 514: 509: 502: 498: 494: 487: 484: =  483: 479: 476: =  468: 461: 457: 453: 450: /  446: 442: 439: /  435: 431: 427: 424: /  420: 416: 409: 402: 394: 377: 374: 371: 367: 361: 351: 336: 327: 323: 316: 315: 314: 312: 308: 301: 294: 289: 287: 283: 279: 276:by averaging 275: 268: 263: 259: 255: 251: 246: 242: 223: 219: 216: 208: 204: 197: 190: 189: 188: 186: 167: 158: 148: 138: 135: 126: 116: 115: 114: 112: 106: 102: 98: 94: 91: 86: 82: 79: 74: 70: 65: 61: 54: 51: 43: 41: 39: 35: 31: 27: 26:Ronald Fisher 23: 19: 1157: 1144: 1133:. Retrieved 1129:the original 1119: 1100: 1091: 1075: 1070: 1017: 1013: 1006:Fisher, R.A. 1000: 987: 970: 965: 958: 951: 944: 937: 929: 927: 917: 910: 908: 815: 811: 809: 801: 648: 646: 515: 507: 500: 496: 492: 485: 481: 477: 466: 459: 455: 451: 444: 440: 433: 429: 425: 418: 414: 407: 400: 398: 310: 303: 296: 290: 285: 281: 277: 270: 266: 261: 257: 253: 250:exchangeable 244: 240: 238: 184: 182: 107: 96: 92: 84: 80: 72: 68: 63: 59: 52: 47: 21: 15: 930:consistency 522:sample mean 67:where each 1172:Categories 1135:2009-01-09 1054:48.1280.02 1045:2440/15172 992:References 472:), where p 101:functional 76:follows a 44:Definition 34:population 18:statistics 928:The term 845:⁡ 784:μ 778:μ 758:∑ 749:− 701:∑ 680:∑ 671:− 570:∑ 549:∑ 540:− 375:θ 355:^ 343:∞ 340:→ 220:θ 209:θ 152:^ 130:^ 127:θ 90:parameter 30:estimator 1008:(1922). 973:unbiased 957:, where 267:T′ 1022:Bibcode 651:is the 506:, ..., 465:, ..., 443:, ..., 406:, ..., 291:If the 103:of the 58:, ..., 1107:  1082:  1060:  1052:  909:where 647:where 38:sample 1154:(PDF) 1062:91208 1058:JSTOR 1105:ISBN 1080:ISBN 248:are 187:if: 1050:JFM 1040:hdl 1030:doi 1018:222 818:if 495:if 333:lim 313:if 16:In 1174:: 1156:. 1056:. 1048:. 1038:. 1028:. 1016:. 1012:. 968:. 920:. 842:ln 297:FĚ‚ 288:. 271:FĚ‚ 113:: 108:FĚ‚ 20:, 1138:. 1113:. 1064:. 1042:: 1032:: 1024:: 966:n 962:n 959:E 955:n 952:E 948:n 945:T 941:n 938:T 918:b 914:0 911:b 893:, 888:0 884:b 880:= 877:b 869:0 866:= 862:] 856:b 853:d 848:L 839:d 833:[ 829:E 816:b 812:L 787:, 781:= 773:n 768:1 765:= 762:i 752:1 745:n 741:= 736:j 732:Z 726:j 722:p 716:m 711:1 708:= 705:j 695:n 690:1 687:= 684:i 674:1 667:n 649:I 632:, 627:j 623:Z 619:) 614:j 610:Z 606:= 601:i 597:X 593:( 590:I 585:m 580:1 577:= 574:j 564:n 559:1 556:= 553:i 543:1 536:n 511:m 508:p 504:1 501:p 499:( 497:T 489:i 486:Z 482:X 480:( 478:P 474:i 470:m 467:p 463:1 460:p 458:( 456:T 452:n 448:m 445:n 441:n 437:1 434:n 432:( 430:T 426:n 422:i 419:n 415:n 411:m 408:Z 404:1 401:Z 378:. 372:= 368:) 362:n 352:F 337:n 328:( 324:T 306:θ 304:F 299:n 286:T 282:T 278:T 273:n 262:i 258:X 254:T 245:i 241:X 224:. 217:= 214:) 205:F 201:( 198:T 168:, 164:) 159:n 149:F 142:( 139:T 136:= 110:n 97:θ 93:θ 85:θ 81:F 73:i 69:X 64:n 60:X 56:1 53:X

Index

statistics
Ronald Fisher
estimator
population
sample
statistical sample
cumulative distribution
parameter
functional
empirical distribution function
exchangeable
strong law of large numbers
expected value
sample mean
indicator function
asymptotically consistent
unbiased
uniform distribution
Fisher, R.A.
"On the mathematical foundations of theoretical statistics"
Bibcode
1922RSPTA.222..309F
doi
10.1098/rsta.1922.0009
hdl
2440/15172
JFM
48.1280.02
JSTOR
91208

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑