Knowledge

Barnardisation

Source 📝

44:. Barnard, at that time President of the Royal Statistical Society, was one of three Fellows appointed by the Council of the Royal Statistical Society to help provide a government-commissioned review of data security for the 1971 UK Census. The resulting report questioned whether rounding small numbers to the nearest five was the best approach to preserving respondent confidentiality. The formal government response to the report noted that an additional safeguard of small random adjustments had been introduced for 1971 Census, the suggestion for which they explicitly attributed to Professor Barnard, as did a New Scientist article dated July 1973. Muddying the waters slightly, a 1973 paper in the Journal of the Royal Statistical Society discussing this new safeguard reported that "after much discussion, a variant of a procedure suggested in Canada was adopted.". Presumably Professor Barnard was involved in these discussions, and was the inventor of the variant. In any case, no evidence can be found of any such safeguard being applied in Canada, with Statistics Canada seeming to stick instead to the use of random rounding of all counts to the nearest 0 or 5. 172:. Some aspects of an initial decision by the Commissioner were overturned on appeal to the House of Lords, and the Commissioner was invited to revisit his original decision. The Commissioner's final decision ruled that barnardisation provided insufficient disclosure protection for rare events (in this case, Childhood Leukaemia), reversing in part his original decision: "the barnardised data, by themselves, can lead to identification, and the effect of barnardisation on the actual figures, at least as deployed by the CSA, does not have the effect of concealing or disguising the data which he had originally considered that it would." However, in his written decision the Commissioner offered no statistical justification for this assertion. Instead the Commissioner's decision centred mainly around addressing points of law relating to the nature of the original and barnardised data, and how this related to legal definitions of (sensitive) personal data. 161:
the relatively high probability that Barnardisation will leave a small count (in particular a 1) unadjusted and, secondarily, to the dangers of reverse engineering the original value if sufficient overlapping barnardised tables are released. For these and other reasons UK Censuses from 2001 onwards have abandoned the use of Barnardisation. See Spicer for a good review of the 2001, 2011 and 2021 alternatives to Barnardisation that have been adopted, and the rationale for this,.
59:, where it is used by two separate chapter authors and by the index compiler. However, by at least the late 1980s the term was already in widespread conversational usage during UK academic conferences and meetings. More recently the term 'Barnardisation' has also become firmly ensconced in the lexicon of official reports produced by official UK statistical agencies and others. 51:
The earliest use of the term 'Barnardisation' found in print so far dates to an Office for Population Censuses and Surveys working paper written by Hakim in 1979, where the term is mentioned without citation, and without ascribing it to Prof G A Barnard. But, at the time, Hakim's coinage of this term
47:
Despite originating from Prof Barnard, in documentation surrounding the 1971 Census the method of adjustment now known as Barnardisation was simply described as a 'procedure'; an 'adjustment of values'; a 'special procedure'; a 'process of random error injection'; or a 'modification' or 'adjustment'.
23:
for tables of counts. It involves adding +1, 0 or -1 to some or all of the internal non-zero cells in a table in a pseudo-random fashion. The probability of adjustment for each internal cell is calculated as p/2 (add 1), 1-p (leave as is), p/2 (subtract 1). The table totals are then calculated as the
160:
Since the late 1990s concerns over the efficacy of Barnardisation in protecting confidentiality have increased to the point where it is now no longer recommended as a 'go to' tool, but rather as a technique only to be used in special circumstances. This change in attitudes appears to centre around
83:
rights of the individuals to whom the information relates (e.g.). In some cases this has involved further modifications to the Barndardisation procedure. For example, as implemented by the Common Service Agency, adjustments of -1, 0 or +1 were only applied to counts of 1 to 4, whilst counts of 0,
67:
As originally conceived and implemented in the 1971 UK Census, Barnardisation had the added characteristic of pairing tables from separate areas, and applying equal and opposite adjustments to the two areas. For example, if a given table cell in Area A had its value increased by 1, then in paired
71:
For the 1991 UK Census the pairing of areas prior to the application of Barnardisation was dropped; and for the more detailed Local Base Statistics, its scope was extended to include adjustments of -2, -1, 0, +1 or +2, achieved by applying the +1, 0 or +1 adjustment twice.
68:
Area B the equivalent table cell would have its value reduced by 1 (subject to not making the value negative). The purpose of this pairing was to cancel out, as much as possible, the amount of noise introduced via the Barnardisation process at a more aggregate level.
534: 135:
From a user point-of-view, another advantage of Barnardisation is that it has been shown to have a smaller impact on typical user analyses than the following Statistical Disclose Control measures: random rounding to base 5; as used by
127:
The adjustment can be unpicked via differencing if other tables are available that share the same counts or totals, or that provide an unadjusted total for a larger spatial area within which the barnardised tables
217: 164:
The question of whether barnardisation may fall short of the complete anonymisation of data, and the status of barnardised data under the complex provisions of the
52:
appears to have been either widely overlooked or widely ignored, at least in print, as demonstrated by the wide range of later publications already cited above.
79:, barnardisation became increasingly employed by public agencies in order to enable them to provide information for statistical purposes without infringing the 571:"Decision 021/2005 Mr Michael Collie and the Common Services Agency for the Scottish Health ServiceChildhood leukaemia statistics in Dumfries and Galloway" 630: 96:
methods in the run up to the 2011 UK Census identified the following list of pros/cons of Barnardisation from the point-of view of the data provider:
472: 124:
Leads to inconsistent values for the same cell counts and table totals if they are present in two or more separately barnardised tables
497: 437: 169: 149: 145: 93: 20: 665: 660: 353: 55:
The term 'Barnardisation' does not appear to have reemerged in print until the 1995 publication of Stan Openshaw's
570: 165: 141: 428:
Marsh (1993). "Privacy, confidentiality and anonymity in the 1991 Census". In Dale, A; Marsh, C (eds.).
131:
The probability of adjustment used is typically small, meaning that many cell values are left unadjusted
33: 535:"Statistical Disclosure Control (SDC) methods short-listed for 2011 UK Census tabular outputs, Paper 1" 594:
Willliamson, Paul (2007). "The impact of cell adjustment on the analysis of aggregate census data".
80: 41: 611: 327: 319: 262: 493: 468: 433: 137: 603: 460: 311: 254: 76: 654: 615: 331: 453:
Hakim, Catherine (1979). "Census confidentiality in Britain". In Bulmer, M (ed.).
196:
Techniques for ensuring the confidentiality of census information in Great Britain
464: 37: 454: 382:
Geographical analysis and mapping of the 1971 UK Census data, Working Paper 3
225:(Working Paper 3: Risk Management ed.). Office for National Statistics. 84:
instead of being left unchanged, were adjusted by the addition of 0 or +1.
32:
The technique of Barnardisation appears to have been named after Professor
219:
Review of the dissemination of health statistics: confidentiality guidance
410:
J. C. Dewdney (1983). "Censuses past and present". In Rhind, D W (ed.).
361:(Introduction to volume I (part 1) ed.). Ottawa: Statistics Canada 323: 299: 266: 242: 144:; and Small Cell Adjustment, as used at various points in time by the 315: 258: 607: 384:. Dept of Geography, University of Durham: Census Research Unit. 300:"Population census: recent British developments in methodology" 632:
EAP125 on Statistical disclosure control (SDC) for Census 2021
355:
1971 Census of Canada : population : vol. I - part 1
247:
Journal of the Royal Statistical Society. Series A (General)
515:
Dept. of Geography and Planning, University of Liverpool
528: 526: 524: 399:(Occasional Paper 3 ed.). Census Division, OPCS. 397:
Census confidentiality, microdata and census analysis
198:(Occasional Paper 4 ed.). Census Division, OPCS. 111:
Table totals are consistent with internal cell values
513:Williamson, Paul (2022). "Personal communication". 298:Jones, H. J. M.; Lawson, H. B.; Newman, D. (1973). 280:New Scientist (1973). "Census data not so secret". 293: 291: 423: 421: 304:Royal Statistical Society. Series A (General) 189: 187: 185: 8: 635:. Titchfield: Office for National Statistics 236: 234: 232: 24:sum of the post-adjustment internal counts. 564: 562: 560: 558: 569:Scottish Information Commissioner (2010). 211: 209: 207: 205: 140:; random rounding to base 3, as used by 243:"'Security of the Census of Population" 181: 459:. London: Palgrave. pp. 132–157. 7: 432:. London: HMSO. pp. 129–154. 36:(1915–2002), a Professor of 14: 414:. London: Methuen. pp. 1–16. 170:Scottish Information Commissioner 150:Australian Bureau of Statistics 542:Office for National Statistics 146:Office for National Statistics 94:Statistical Disclosure Control 21:statistical disclosure control 1: 456:Censuses, Surveys and Privacy 465:10.1007/978-1-349-16184-3_10 430:The 1991 Census User's Guide 682: 596:Environment and Planning A 352:Statistics Canada (1974). 114:The adjustment is unbiased 395:Hakim, Catherine (1978). 168:, were considered by the 412:A Census User's Handbook 166:Data Protection Act 1998 488:Openshaw, Stan (1995). 194:Newman, Dennis (1978). 533:SDC UKCDMAC Subgroup. 492:. Cambridge: Pearson. 142:Statistics New Zealand 57:Census Users' Handbook 490:Census Users' Handbok 34:George Alfred Barnard 156:Efficacy reappraised 666:Information privacy 380:Rhind, D W (1975). 241:Moore, P G (1973). 81:information privacy 63:Operational details 42:University of Essex 661:Survey methodology 105:Easy to understand 474:978-0-333-26223-8 284:(19th July): 142. 138:Statistics Canada 108:Easy to implement 673: 645: 644: 642: 640: 626: 620: 619: 602:(5): 1058–1078. 591: 585: 584: 582: 580: 575: 566: 553: 552: 550: 548: 539: 530: 519: 518: 510: 504: 503: 485: 479: 478: 450: 444: 443: 425: 416: 415: 407: 401: 400: 392: 386: 385: 377: 371: 370: 368: 366: 360: 349: 343: 342: 340: 338: 295: 286: 285: 277: 271: 270: 238: 227: 226: 224: 213: 200: 199: 191: 681: 680: 676: 675: 674: 672: 671: 670: 651: 650: 649: 648: 638: 636: 628: 627: 623: 593: 592: 588: 578: 576: 573: 568: 567: 556: 546: 544: 537: 532: 531: 522: 512: 511: 507: 500: 487: 486: 482: 475: 452: 451: 447: 440: 427: 426: 419: 409: 408: 404: 394: 393: 389: 379: 378: 374: 364: 362: 358: 351: 350: 346: 336: 334: 316:10.2307/2344749 297: 296: 289: 279: 278: 274: 259:10.2307/2344751 240: 239: 230: 222: 215: 214: 203: 193: 192: 183: 178: 158: 90: 65: 30: 19:is a method of 12: 11: 5: 679: 677: 669: 668: 663: 653: 652: 647: 646: 621: 608:10.1068/a38142 586: 554: 520: 505: 498: 480: 473: 445: 438: 417: 402: 387: 372: 344: 310:(4): 505–538. 287: 272: 253:(4): 583–596. 228: 201: 180: 179: 177: 174: 157: 154: 133: 132: 129: 125: 116: 115: 112: 109: 106: 89: 86: 77:United Kingdom 64: 61: 29: 26: 17:Barnardisation 13: 10: 9: 6: 4: 3: 2: 678: 667: 664: 662: 659: 658: 656: 634: 633: 625: 622: 617: 613: 609: 605: 601: 597: 590: 587: 572: 565: 563: 561: 559: 555: 543: 536: 529: 527: 525: 521: 516: 509: 506: 501: 499:1-899761-06-3 495: 491: 484: 481: 476: 470: 466: 462: 458: 457: 449: 446: 441: 439:0-11-691527-7 435: 431: 424: 422: 418: 413: 406: 403: 398: 391: 388: 383: 376: 373: 357: 356: 348: 345: 333: 329: 325: 321: 317: 313: 309: 305: 301: 294: 292: 288: 283: 282:New Scientist 276: 273: 268: 264: 260: 256: 252: 248: 244: 237: 235: 233: 229: 221: 220: 212: 210: 208: 206: 202: 197: 190: 188: 186: 182: 175: 173: 171: 167: 162: 155: 153: 151: 147: 143: 139: 130: 126: 123: 122: 121: 120: 119:Disadvantages 113: 110: 107: 104: 103: 102: 101: 97: 95: 88:Pros and cons 87: 85: 82: 78: 73: 69: 62: 60: 58: 53: 49: 45: 43: 39: 35: 27: 25: 22: 18: 637:. Retrieved 631: 624: 599: 595: 589: 577:. Retrieved 545:. Retrieved 541: 514: 508: 489: 483: 455: 448: 429: 411: 405: 396: 390: 381: 375: 363:. Retrieved 354: 347: 335:. Retrieved 307: 303: 281: 275: 250: 246: 218: 216:ONS (2006). 195: 163: 159: 134: 118: 117: 99: 98: 92:A review of 91: 74: 70: 66: 56: 54: 50: 46: 31: 16: 15: 629:Spicer, K. 38:Mathematics 655:Categories 176:References 100:Advantages 616:154653446 332:133740484 28:Etymology 148:and the 324:2344749 267:2344751 75:In the 40:at the 639:16 May 614:  579:16 May 547:16 May 496:  471:  436:  365:16 May 337:16 May 330:  322:  265:  612:S2CID 574:(PDF) 538:(PDF) 359:(PDF) 328:S2CID 320:JSTOR 263:JSTOR 223:(PDF) 641:2022 581:2022 549:2022 494:ISBN 469:ISBN 434:ISBN 367:2022 339:2022 128:nest 604:doi 461:doi 312:doi 308:136 255:doi 251:136 657:: 610:. 600:39 598:. 557:^ 540:. 523:^ 467:. 420:^ 326:. 318:. 306:. 302:. 290:^ 261:. 249:. 245:. 231:^ 204:^ 184:^ 152:. 643:. 618:. 606:: 583:. 551:. 517:. 502:. 477:. 463:: 442:. 369:. 341:. 314:: 269:. 257::

Index

statistical disclosure control
George Alfred Barnard
Mathematics
University of Essex
United Kingdom
information privacy
Statistical Disclosure Control
Statistics Canada
Statistics New Zealand
Office for National Statistics
Australian Bureau of Statistics
Data Protection Act 1998
Scottish Information Commissioner







Review of the dissemination of health statistics: confidentiality guidance



"'Security of the Census of Population"
doi
10.2307/2344751
JSTOR
2344751

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.