Knowledge (XXG)

False positives and false negatives

Source 📝

153:, is a test result which wrongly indicates that a condition does not hold. For example, when a pregnancy test indicates a woman is not pregnant, but she is, or when a person guilty of a crime is acquitted, these are false negatives. The condition "the woman is pregnant", or "the person is guilty" holds, but the test (the pregnancy test or the trial in a court of law) fails to realize this condition, and wrongly decides that the person is not pregnant or not guilty. 367:
When developing detection algorithms or tests, a balance must be chosen between risks of false negatives and false positives. Usually there is a threshold of how close a match to a given sample must be achieved before the algorithm reports a match. The higher this threshold, the more false negatives
259:
The term false discovery rate (FDR) was used by Colquhoun (2014) to mean the probability that a "significant" result was a false positive. Later Colquhoun (2017) used the term false positive risk (FPR) for the same quantity, to avoid confusion with the term FDR as used by people who work on
132:
where the test is checking a single condition, and wrongly gives an affirmative (positive) decision. However it is important to distinguish between the type 1 error rate and the probability of a positive result being false. The latter is known as the false positive risk (see
216:
is defined as the specificity of the test. Increasing the specificity of the test lowers the probability of type I errors, but may raise the probability of type II errors (false negatives that reject the alternative hypothesis when it is true).
109:, and a negative result corresponds to not rejecting the null hypothesis. The terms are often used interchangeably, but there are differences in detail and interpretation due to the differences between medical testing and statistical hypothesis testing. 294:= 0.001 was not necessarily strong evidence against the null hypothesis. Despite the fact that the likelihood ratio in favor of the alternative hypothesis over the null is close to 100, if the hypothesis was implausible, with a 49:
is the opposite error, where the test result incorrectly indicates the absence of a condition when it is actually present. These are the two kinds of errors in a binary test, in contrast to the two kinds of correct result (a
189:(FPR) is the proportion of all negatives that still yield positive test outcomes, i.e., the conditional probability of a positive test result given an event that was not present. The false positive rate depends on the 228:(FNR) is the proportion of positives which yield negative test outcomes with the test, i.e., the conditional probability of a negative test result given that the condition being looked for is present. 306:-value should be accompanied by the prior probability of there being a real effect that it would be necessary to assume in order to achieve a false positive risk of 5%. For example, if we observe 125:, is a result that indicates a given condition exists when it does not. For example, a pregnancy test which indicates a woman is pregnant when she is not, or the conviction of an innocent person. 497:
Alnabulsi, Hussein; Islam, Rafiqui; Mamun, Qasi (2018). "A novel algorithm to protect code injection attacks". In Abawajy, Jemal H.; Choo, Kim-Kwang Raymond; Islam, Rafiqul (eds.).
573:
Bose, Prosenjit; Guo, Hua; Kranakis, Evangelos; Maheshwari, Anil; Morin, Pat; Morrison, Jason; Smid, Michiel; Tang, Yihui (2008). "On the false-positive rate of Bloom filters".
286:, has caused much mischief. Because of the ambiguity of notation in this field, it is essential to look at the definition in every paper. The hazards of reliance on 310:= 0.05 in a single experiment, we would have to be 87% certain that there was a real effect before the experiment was done to achieve a false positive risk of 5%. 347: 499:
International Conference on Applications and Techniques in Cyber Security and Intelligence: Applications and Techniques in Cyber Security and Intelligence
302:= 0.001 would have a false positive rate of 8 percent. It wouldn't even reach the 5 percent level. As a consequence, it has been recommended that every 341: 506: 793: 45:
in which a test result incorrectly indicates the presence of a condition (such as a disease when the disease is not present), while a
319: 283: 160:
occurring in a test where a single condition is checked for, and the result of the test is erroneous, that the condition is absent.
600:
Cronin, Paul; Kelly, Aine Marie (2011). "Influence of population prevalences on numbers of false positives: an overlooked entity".
31: 711: 232: 205: 98: 244: 174: 79: 264:. Corrections for multiple comparisons aim only to correct the type I error rate, so the result is a (corrected) 102: 388: 803: 788: 42: 737:
Colquhoun, David (2018). "The false positive risk: A proposal concerning what to do about p values".
666: 261: 322:" discusses parameters in statistical signal processing based on ratios of errors of various types. 336: 194: 185: 178: 764: 746: 656: 190: 692: 555: 502: 479: 421: 331: 295: 240: 756: 682: 674: 609: 582: 545: 535: 469: 461: 413: 106: 401: 670: 798: 687: 640: 550: 523: 474: 449: 290:-values was emphasized in Colquhoun (2017) by pointing out that even an observation of 782: 157: 768: 129: 760: 613: 586: 275:-value. The false positive risk is always higher, often much higher, than the 17: 425: 540: 696: 641:"An investigation of the false discovery rate and the misinterpretation of 559: 483: 400:
Robinson, Alexander; Keller, L. Robin; del Campo, Cristina (October 2022).
522:
Banerjee, A; Chitnis, UB; Jadhav, SL; Bhawalkar, JS; Chaudhury, S (2009).
678: 465: 450:"The reproducibility of research and the misinterpretation of p-values" 417: 271:. Thus they are susceptible to the same misinterpretation as any other 265: 134: 402:"Building insights on true positives vs. false positives: Bayes' rule" 501:. Cham, Switzerland: Springer International Publishing. p. 288. 751: 661: 135:
Ambiguity in the definition of false positive rate, below
105:, where a positive result corresponds to rejecting the 30:"False Positive" redirects here. For other uses, see 298:
of a real effect being 0.1, even the observation of
255:Ambiguity in the definition of false positive rate 406:Decision Sciences Journal of Innovative Education 524:"Hypothesis testing, type I and type II errors" 348:Why Most Published Research Findings Are False 8: 208:, this fraction is given the Greek letter 750: 686: 660: 634: 632: 549: 539: 473: 247:") of the test is equal to 1 −  443: 441: 439: 437: 435: 66:). They are also known in medicine as a 381: 360: 342:Positive and negative predictive values 169:False positive and false negative rates 27:Types of error in binary classification 101:, the analogous concepts are known as 7: 235:, this fraction is given the letter 389:False Positives and False Negatives 284:error of the transposed conditional 282:Confusion of these two ideas, the 25: 320:Receiver operating characteristic 314:Receiver operating characteristic 626:Cronin & Kelly, 2011, p.1087 201:minus the false positive rate. 32:False Positive (disambiguation) 575:Information Processing Letters 368:and the fewer false positives. 233:statistical hypothesis testing 206:statistical hypothesis testing 99:statistical hypothesis testing 1: 761:10.1080/00031305.2018.1529622 156:A false negative error is a 128:A false positive error is a 712:"The problem with p-values" 175:Sensitivity and specificity 820: 794:Statistical classification 649:Royal Society Open Science 614:10.1016/j.acra.2011.04.011 454:Royal Society Open Science 172: 80:statistical classification 29: 739:The American Statistician 639:Colquhoun, David (2014). 587:10.1016/j.ipl.2008.05.018 448:Colquhoun, David (2017). 103:type I and type II errors 197:of the test is equal to 541:10.4103/0972-6748.62274 220:Complementarily, the 43:binary classification 262:multiple comparisons 212:, and 1 −  147:false negative error 141:False negative error 119:false positive error 113:False positive error 679:10.1098/rsos.140216 671:2014RSOS....140216C 466:10.1098/rsos.171085 337:False positive rate 224:false negative rate 186:false positive rate 179:False positive rate 710:Colquhoun, David. 602:Academic Radiology 418:10.1111/dsji.12265 191:significance level 508:978-3-31967-071-3 332:Base rate fallacy 296:prior probability 16:(Redirected from 811: 773: 772: 754: 734: 728: 727: 725: 723: 707: 701: 700: 690: 664: 636: 627: 624: 618: 617: 597: 591: 590: 570: 564: 563: 553: 543: 528:Ind Psychiatry J 519: 513: 512: 494: 488: 487: 477: 445: 430: 429: 397: 391: 386: 369: 365: 226: 225: 64: 63: 56: 55: 21: 819: 818: 814: 813: 812: 810: 809: 808: 779: 778: 777: 776: 736: 735: 731: 721: 719: 718:. Aeon Magazine 709: 708: 704: 638: 637: 630: 625: 621: 599: 598: 594: 572: 571: 567: 521: 520: 516: 509: 496: 495: 491: 447: 446: 433: 399: 398: 394: 387: 383: 378: 373: 372: 366: 362: 357: 328: 316: 257: 223: 222: 181: 173:Main articles: 171: 166: 143: 115: 107:null hypothesis 61: 60: 53: 52: 41:is an error in 35: 28: 23: 22: 15: 12: 11: 5: 817: 815: 807: 806: 801: 796: 791: 781: 780: 775: 774: 729: 702: 628: 619: 592: 565: 514: 507: 489: 460:(12): 171085. 431: 412:(4): 224–234. 392: 380: 379: 377: 374: 371: 370: 359: 358: 356: 353: 352: 351: 344: 339: 334: 327: 324: 315: 312: 256: 253: 170: 167: 165: 162: 151:false negative 142: 139: 123:false positive 114: 111: 88:false negative 84:false positive 72:false negative 68:false positive 47:false negative 39:false positive 26: 24: 18:False negative 14: 13: 10: 9: 6: 4: 3: 2: 816: 805: 804:Medical error 802: 800: 797: 795: 792: 790: 789:Medical tests 787: 786: 784: 770: 766: 762: 758: 753: 748: 744: 740: 733: 730: 717: 713: 706: 703: 698: 694: 689: 684: 680: 676: 672: 668: 663: 658: 655:(3): 140216. 654: 650: 646: 644: 635: 633: 629: 623: 620: 615: 611: 607: 603: 596: 593: 588: 584: 580: 576: 569: 566: 561: 557: 552: 547: 542: 537: 534:(2): 127–31. 533: 529: 525: 518: 515: 510: 504: 500: 493: 490: 485: 481: 476: 471: 467: 463: 459: 455: 451: 444: 442: 440: 438: 436: 432: 427: 423: 419: 415: 411: 407: 403: 396: 393: 390: 385: 382: 375: 364: 361: 354: 350: 349: 345: 343: 340: 338: 335: 333: 330: 329: 325: 323: 321: 318:The article " 313: 311: 309: 305: 301: 297: 293: 289: 285: 280: 278: 274: 270: 268: 263: 254: 252: 250: 246: 242: 238: 234: 229: 227: 218: 215: 211: 207: 202: 200: 196: 192: 188: 187: 180: 176: 168: 164:Related terms 163: 161: 159: 158:type II error 154: 152: 148: 140: 138: 136: 131: 126: 124: 120: 112: 110: 108: 104: 100: 95: 93: 89: 85: 81: 77: 73: 69: 65: 62:true negative 57: 54:true positive 48: 44: 40: 33: 19: 742: 738: 732: 720:. Retrieved 715: 705: 652: 648: 642: 622: 605: 601: 595: 578: 574: 568: 531: 527: 517: 498: 492: 457: 453: 409: 405: 395: 384: 363: 346: 317: 307: 303: 299: 291: 287: 281: 276: 272: 266: 258: 248: 236: 230: 221: 219: 213: 209: 203: 198: 184: 182: 155: 150: 146: 144: 130:type I error 127: 122: 118: 116: 96: 91: 87: 83: 75: 71: 67: 59: 51: 46: 38: 36: 745:: 192–201. 722:11 December 608:(9): 1088. 245:sensitivity 243:" (or the " 195:specificity 783:Categories 752:1802.04888 581:(4): 210. 376:References 662:1407.5296 426:1540-4595 78:, and in 76:diagnosis 769:85530643 697:26064558 645:-values" 560:21180491 484:29308247 326:See also 279:-value. 688:4448847 667:Bibcode 551:2996198 475:5750014 239:. The " 767:  695:  685:  558:  548:  505:  482:  472:  424:  269:-value 193:. The 58:and a 799:Error 765:S2CID 747:arXiv 657:arXiv 355:Notes 241:power 149:, or 121:, or 92:error 82:as a 724:2016 716:Aeon 693:PMID 556:PMID 503:ISBN 480:PMID 422:ISSN 183:The 177:and 86:(or 70:(or 757:doi 683:PMC 675:doi 610:doi 583:doi 579:108 546:PMC 536:doi 470:PMC 462:doi 414:doi 231:In 204:In 137:). 97:In 785:: 763:. 755:. 743:73 741:. 714:. 691:. 681:. 673:. 665:. 651:. 647:. 631:^ 606:18 604:. 577:. 554:. 544:. 532:18 530:. 526:. 478:. 468:. 456:. 452:. 434:^ 420:. 410:20 408:. 404:. 251:. 145:A 117:A 94:. 90:) 74:) 37:A 771:. 759:: 749:: 726:. 699:. 677:: 669:: 659:: 653:1 643:p 616:. 612:: 589:. 585:: 562:. 538:: 511:. 486:. 464:: 458:4 428:. 416:: 308:p 304:p 300:p 292:p 288:p 277:p 273:p 267:p 249:β 237:β 214:α 210:α 199:1 34:. 20:)

Index

False negative
False Positive (disambiguation)
binary classification
statistical classification
statistical hypothesis testing
type I and type II errors
null hypothesis
type I error
Ambiguity in the definition of false positive rate, below
type II error
Sensitivity and specificity
False positive rate
false positive rate
significance level
specificity
statistical hypothesis testing
statistical hypothesis testing
power
sensitivity
multiple comparisons
p-value
error of the transposed conditional
prior probability
Receiver operating characteristic
Base rate fallacy
False positive rate
Positive and negative predictive values
Why Most Published Research Findings Are False
False Positives and False Negatives
"Building insights on true positives vs. false positives: Bayes' rule"

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.