Preregistration (science) - Knowledge (XXG)

99:

principle acceptance). The proposed study is then performed, and the research report is submitted for Stage 2 peer review. Stage 2 peer review confirms that the actual research methods are consistent with the preregistered protocol, that quality thresholds are met (e.g., manipulation checks confirm the validity of the experimental manipulation), and that the conclusions follow from the data. Because studies are accepted for publication regardless of whether the results are statistically significant Registered Reports prevent publication bias. Meta-scientific research has shown that the percentage of non-significant results in Registered Reports is substantially higher than in standard publications.

90:. The preregistered study is then conducted, and a report of the study and its results is submitted for publication together with access to the preregistration document. This preregistration approach allows peer reviewers and subsequent readers to cross-reference the preregistration document with the published research article in order to identify the presence of any undisclosed deviations of the preregistration. Deviations from the preregistration are possible and common in practice, but they should be transparently reported, and the consequences for the severity of the test should be evaluated. 211:(NLM) was the first online registry for clinical trials, and remains the largest and most widely used. In addition to combating bias, clinical trial registries serve to increase transparency and access to clinical trials for the public. Clinical trials registries are often searchable (e.g. by disease/indication, drug, location, etc.). Trials are registered by the pharmaceutical, biotech or medical device company (Sponsor) or by the hospital or foundation which is sponsoring the study, or by another organization, such as a 232:

international and written about for over 50 years. One of the proposals to address this potential bias was a comprehensive register of initiated clinical trials that would inform the public which trials had been started. Ethical issues were those that seemed to interest the public most, as trialists (including those with potential commercial gain) benefited from those who enrolled in trials, but were not required to “give back,” telling the public what they had learned.

3990: 731:). The most frequent deviations were with regards to the planned sample size, exclusion criteria, and statistical model. Hence, what were intended as preregistered confirmatory tests ended up as unplanned exploratory tests. Again, preregistration advocates argue that deviations from preregistered plans are acceptable as long as they are reported transparently and justified. They also point out that even vague preregistrations help to reduce 413:

biomedical research relies on animal experiments. The non-publication of results gained from animal experiments not only distorts the state of research by reinforcing the publication bias, it further represents an ethical issue. Preregistration is discussed as a measure that could counteract this problem. Following registries are suited for the preregistration of preclinical studies.

723:). For example, pre-registered studies are only of higher quality than non-pre registered studies in that the former does has a power analysis and higher sample size than the latter but other than that they do not seem to prevent p-hacking and HARKing, as both the proportion of positive results and effect sizes are similar between preregistered and non-preregistered studies ( 592:). In response, preregistration advocates have stressed that exploratory analyses are permitted in preregistered studies, and that the results of these analyses retain some value vis-a-vis hypothesis generation rather than hypothesis testing. Preregistration merely makes the distinction between confirmatory and exploratory research clearer ( 612:). However, critics counterargue that, if preregistration is only supposed to be a plan, and not a prison, then researchers should feel free to deviate from that plan and undertake exploratory analyses without fearing accusations of low research credibility due to circular reasoning and inappropriate research practices such as 539:

concepts and students felt that they understood their dissertation and it improved the clarity of the manuscript writing, promoted rigour and were more likely to avoid questionable research practices. In addition, it becomes a tool that can supervisors can use to shape students to combat any questionable research practices.

264:(ICMJE) announced that their journals would not publish reports of trials unless they had been registered. The ICMJE action was probably the most important motivator for trial registration, as investigators wanted to reserve the possibility that they could publish their results in prestigious journals, should they want to. 584:). Circular reasoning can be identified by analysing the reasoning per se without needing to know whether that reasoning was preregistered. Critics have also noted that the idea that preregistration improves research credibility may deter researchers from undertaking non-preregistered exploratory analyses ( 535:). The primary goal of preregistration is to improve the transparency of reported hypothesis tests, which allows readers to evaluate the extent to which decisions during the data analysis were pre-planned (maintaining statistical error control) or data-driven (increasing the Type 1 or Type 2 error rate). 538:

Meta-scientific research has revealed additional benefits. Researchers indicate preregistering a study leads to a more carefully thought through research hypothesis, experimental design, and statistical analysis. In addition, preregistration has been shown to encourage better learning of Open Science

235:

Those who were particularly concerned by the double standard were systematic reviewers, those who summarize what is known from clinical trials. If the literature is skewed, then the results of a systematic review are also likely to be skewed, possibly favoring the test intervention when in fact the

231:

For many years, scientists and others have worried about reporting biases such that negative or null results from initiated clinical trials may be less likely to be published than positive results, thus skewing the literature and our understanding of how well interventions work. This worry has been

81:

In the standard preregistration format, researchers prepare a research protocol document prior to conducting their research. Ideally, this document indicates the research hypotheses, sampling procedure, sample size, research design, testing conditions, stimuli, measures, data coding and aggregation

503:

defines this format: “In a registered report, authors create a study proposal that includes theoretical and empirical background, research questions/hypotheses, and pilot data (if available). Upon submission, this proposal will then be reviewed prior to data collection, and if accepted, the paper

305:. WHO states that the international registry's mission is "to ensure that a complete view of research is accessible to all those involved in health care decision making. This will improve research transparency and will ultimately strengthen the validity and value of the scientific evidence base." 755:

changes that have led up to the current method and analyses” (pp. 378–379). In addition, pre-registering a study requires careful deliberation about the study's hypotheses, research design and statistical analyses. This depends on the use of pre-registration templates that provides detailed

98:

The registered report format requires authors to submit a description of the study methods and analyses prior to data collection. Once the theoretical introduction, method, and analysis plan has been peer reviewed (Stage 1 peer review), publication of the findings is provisionally guaranteed (in

412:

Similar to clinical research, preregistration can help to improve transparency and quality of research data in preclinical research. In contrast to clinical research where preregistration is mandatory for vast parts it is still new in preclinical research. A large part of preclinical and basic

507:

Note that only a very small proportion of academic journals in psychology and neurosciences explicitly stated that they welcome submissions of replication studies in their aim and scope or instructions to authors. This phenomenon does not encourage the reporting or even attempt on replication

3140:

Pownall, Madeleine; Pennington, Charlotte R.; Norris, Emma; Juanchich, Marie; Smailes, David; Russell, Sophie; Gooch, Debbie; Evans, Thomas Rhys; Persson, Sofia; Mak, Matthew H. C.; Tzavella, Loukia; Monk, Rebecca; Gough, Thomas; Benwell, Christopher S. Y.; Elsherif, Mahmoud (October 2023).

246:(Food and Drug Administration Modernization Act of 1997. Pub L No. 105-115, §113 Stat 2296), but the law provided neither funding nor a mechanism of enforcement. In addition, the law required that ClinicalTrials.gov only include trials of serious and life-threatening diseases. 3424: 609: 795:

for inconclusive evidence), although it is unclear whether this represents a "false" sense of credibility due to pre-existing positive community attitudes about preregistration or a genuine causal effect of registered reports on quality of research.

4317:

Akker, Olmo R. van den; Weston, Sara; Campbell, Lorne; Chopik, Bill; Damian, Rodica; Davis-Kean, Pamela; Hall, Andrew; Kosie, Jessica; Kruse, Elliott; Olsen, Jerome; Ritchie, Stuart; Valentine, K. D.; Veer, Anna van 't; Bakker, Marjan (2021-11-09).

3055:

Toth, Allison A.; Banks, George C.; Mellor, David; O’Boyle, Ernest H.; Dickson, Ashleigh; Davis, Daniel J.; DeHaven, Alex; Bochantin, Jaime; Borns, Jared (1 August 2021). "Study Preregistration: An Evaluation of a Method for Transparent Reporting".

1912:

International Collaborative Group on Clinical Trial Registries (1993). "Position paper and consensus recommendations on clinical trial registries. Ad Hoc Working Party of the International Collaborative Group on Clinical Trials Registries".

272: 312:

ICMJE accepts all primary registries in the WHO network in addition to clinicaltrials.gov. Clinical trial registration in other registries excluding ClinicalTrials.gov has increased irrespective of study designs since 2014.

309: 283: 218:

There has been a push from governments and international organizations, especially since 2005, to make clinical trial information more widely available and to standardize registries and processes of registering. The

918:

Parsons, Sam; Azevedo, Flávio; Elsherif, Mahmoud M.; Guay, Samuel; Shahim, Owen N.; Govaart, Gisela H.; Norris, Emma; O’Mahony, Aoife; Parker, Adam J.; Todorovic, Ana; Pennington, Charlotte R. (2022-02-21).

82:

method, criteria for data exclusions, and statistical analyses, including potential variations on those analyses. This preregistration document is then posted on a publicly available website such as the

200:. Registration of clinical trials is required in some countries and is increasingly being standardized. Some top medical journals will only publish the results of trials that have been pre-registered. 64:

increase the probability of incorrect claims. Although the idea is old, the practice of preregistering studies has gained prominence to mitigate to some of the issues that are thought to underlie the

1448:

Akker, Olmo R. van den; Weston, Sara; Campbell, Lorne; Chopik, Bill; Damian, Rodica; Davis-Kean, Pamela; Hall, Andrew; Kosie, Jessica; Kruse, Elliott; Olsen, Jerome; Ritchie, Stuart (2021-11-09).

487:

also noted that the editorial staff will be asking for replication of studies with surprising findings from examinations using small sample sizes before allowing the manuscripts to be published.

3898:

Singh, B.; Fairman, C. M.; Christensen, J. F.; Bolam, K. A.; Twomey, R.; Nunan, D.; Lahart, I. M. (2021). "Outcome reporting bias in exercise oncology trials (OREO): A cross-sectional study".

294:. There has also been action from the pharmaceutical industry, which released plans to make clinical trial data more transparent and publicly available. Released in October 2008, the revised 771:

Finally, some commentators have argued that, under some circumstances, preregistration may actually harm science by providing a false sense of credibility to research studies and analyses (

660:), and that concerns about inflated familywise error rates are unjustified when those error rates refer to abstract, atheoretical studywise hypotheses that are not being tested (Rubin, 548:

preregistration in economics journals found that preregistration did not reduce p-hacking and publication bias, unless the preregistration was accompanied by a preanalysis plan.

1155:

Scheel, Anne M.; Schijen, Mitchell R. M. J.; Lakens, Daniël (April 2021). "An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports".

2127:

Banno, M; Tsujimoto, Y; Kataoka, Y (2019). "Studies registered in non-ClinicalTrials.gov accounted for an increasing proportion of protocol registrations in medical research".

495:

has adopted the registered report format, as it “shift the emphasis from the results of research to the questions that guide the research and the methods used to answer them”.

268: 271:(FDAAA) clarified the requirements for registration and also set penalties for non-compliance (Public Law 110-85. The Food and Drug Administration Amendments Act of 2007 261: 2550:"Publication rates in animal research. Extent and characteristics of published and non-published animal studies followed up at two German university medical centres" 787:). Consistent with this view, there is some evidence that researchers view registered reports as being more credible than standard reports on a range of dimensions ( 291: 1669:

Bert, Bettina; Heinl, Céline; Chmielewska, Justyna; Schwarz, Franziska; Grune, Barbara; Hensel, Andreas; Greiner, Matthias; Schönfelder, Gilbert (2019-10-15).

44:

Preregistration has the goal to allow others to transparently evaluate the capacity of a test to falsify a prediction. A number of research practices such as

3821:

Bakker, M.; Veldkamp, C. L. S.; van Assen, M. A. L. M.; Crompvoets, E. A. V.; Ong, H. H.; Nosek, B.; Soderberg, C. K.; Mellor, D.; Wicherts, J. M. (2020).

2317:"Clinical trial registration, reporting, publication and FDAAA compliance: a cross-sectional analysis and ranking of new drugs approved by the FDA in 2012" 544: 648:). Finally, and more fundamentally, critics have argued that the distinction between confirmatory and exploratory analyses is unclear and/or irrelevant ( 208: 3274:"Do Preregistration and Preanalysis Plans Reduce p -Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement" 249:

Then, two events occurred in 2004 that increased public awareness of the problems of reporting bias. First, the then-New York State Attorney General

4227:

Bowman, Sara D.; Dehaven, Alexander Carl; Errington, Timothy M.; Hardwicke, Tom Elis; Mellor, David Thomas; Nosek, Brian A.; Soderberg, Courtney K.

739:). However, critics have argued that it is not useful to identify or justify deviations from preregistered plans when those plans do not reflect 768:). Many pre-registration template stress the importance of a power analysis but not only stress the importance of why the methodology was used. 335:

Worldwide, there is growing number of registries. A 2013 study identified the following top five registries (numbers updated as of August 2013):

286:(ICMJE) decided that from July 1, 2005 no trials will be considered for publication unless they are included on a clinical trials registry. The 580:, p. 2600). However, critics have argued that preregistration is not necessary to identify circular reasoning during exploratory analyses ( 3189: 4503:

Soderberg, C. K.; Errington, T. M.; Schiavone, S R.; Bottesini, J.; Singleton Thorn, F.; Vazire, S.; Esterling, K. M.; Nosek, B. A. (2020).

2019: 3951:

van den Akker, Olmo R.; van Assen, Marcel A. L. M.; Bakker, Marjan; Elsherif, Mahmoud; Wong, Tsz Keung; Wicherts, Jelte M. (2023-11-10).

2385:"Evaluating adherence to the International Committee of Medical Journal Editors' policy of mandatory, timely clinical trial registration" 1877:

Sterling, TD (1959). "Publication decisions and their possible effects on inferences drawn from tests of significances – or vice versa".

3207:"Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor's perceived attitudes" 2365: 1583:"Making the black box transparent: A template and tutorial for (pre-)registration of studies using experience sampling methods (ESM)" 727:). In addition, in a survey of 27 preregistered studies found that researchers deviated from their preregistered plans in all cases ( 675:

There are also concerns about the practical implementation of preregistration. Many preregistered protocols leave plenty of room for

4603: 330: 321:

Various studies have measured the extent to which various trials are in compliance with the reporting standards of their registry.

298:, states that "Every clinical trial must be registered in a publicly accessible database before recruitment of the first subject." 2548:

Wieschowski, Susanne; Biernot, Svenja; Deutsch, Susanne; Glage, Silke; Bleich, André; Tolba, René; Strech, Daniel (2019-11-26).

1812: 2826: 1128:

Nosek, Brian A.; Lakens, Daniël (1 May 2014). "Registered Reports: A Method to Increase the Credibility of Published Results".

499: 479: 4190:"Pre-registration is a game changer. But, like random assignment, it is neither necessary nor sufficient for credible science" 3924:"Preregistration specificity & adherence: A review of preregistered gambling studies & cross-disciplinary comparison" 2434:"Animal Study Registries: Results from a Stakeholder Analysis on Potential Strengths, Weaknesses, Facilitators, and Barriers" 212: 2170:

Anderson, Monique L.; Chiswell, Karen; Peterson, Eric D.; Tasneem, Asba; Topping, James; Califf, Robert M. (12 March 2015).

628:). Again, they have pointed out that preregistration is not necessary to address such concerns. For example, concerns about 1940:

Dickersin, K; Rennie, D (2012). "The evolution of trial registries and their use to assess the clinical trial enterprise".

4137:

Sun, L. W.; Lee, D. J.; Collins, J. A.; Carll, T. C.; Ramahi, K.; Sandy, S. J.; Unteriner, J. G.; Weinberg, D. V. (2019).

732: 605: 243: 242:

was originally developed largely as a result of breast cancer consumer lobbying, which led to authorizing language in the

617: 223:

is working toward "achieving consensus on both the minimal and the optimal operating standards for trial registration".

2615:

Naald, Mira van der; Wenker, Steven; Doevendans, Pieter A.; Wever, Kimberley E.; Chamuleau, Steven A. J. (2020-08-01).

3639: 1757: 810: 2063: 3030: 1994: 1728: 576:

analyses because they may involve "circular reasoning" in which post hoc hypotheses are based on the observed data (

524: 3774:"When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing" 1233:

Bosnjak, M.; Fiebach, C. J.; Mellor, D.; Mueller, S.; O’Connor, D. B.; Oswald, F. L.; Sokol-Chang, R. I. (2021). .

257:(GSK) because they had failed to reveal results from trials showing that certain antidepressants might be harmful. 556:

Proponents of preregistration have argued that it is "a method to increase the credibility of published results" (

33:

is the practice of registering the hypotheses, methods, or analyses of a scientific study before it is conducted.

1095: 287: 220: 483:

has encouraged the preregistration of studies and the reporting of effect sizes and confidence intervals. The

512: 295: 720: 107:

Preregistration can be used in relation to a variety of different research designs and methods, including:

2221:"Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study" 621: 491: 83: 3725:

Szollosi, A.; Kellen, D.; Navarro, D. J.; Shiffrin, R.; van Rooji, I.; Van Zandt, T.; Donkin, C. (2020).

2220: 4598: 4528: 4384: 3953:"Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology" 3695: 3474: 1270: 1005:

Lakens, Daniël (2019). "The value of preregistration for psychological science: A conceptual analysis".

471:), and the number of journals that are adopting registered reports is approximately doubling each year ( 424: 4446:"The effect of preregistration on trust in empirical research findings: Results of a registered report" 4444:

Field, S. M.; Wagenmakers, E. J.; Kiers, H. A.; Hoekstra, R.; Ernst, A.F.; van Ravenzwaaij, D. (2020).

3922:

Heirene, R.; LaPlante, D.; Louderback, E. R.; Keen, B.; Bakker, M.; Serafimovska, A.; Gainsbury, S. M.

3083:

Sarafoglou, Alexandra; Kovacs, Marton; Bakos, Bence; Wagenmakers, Eric-Jan; Aczel, Balazs (July 2022).

3680:"Arrested theory development: The misguided distinction between exploratory and confirmatory research" 4593: 4583: 4457: 3899: 3218: 3143:"Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation" 3096: 2561: 864: 761: 119: 4009: 2674:"Registered Reports: Peer review before results are known to align scientific values and practices" 680: 169: 162: 2064:"WHO facilitates international collaboration in setting standards for clinical trial registration" 636:

practices, such as (a) open data and research materials and (b) robustness or multiverse analyses

504:

resulting from this peer-reviewed procedure will be published, regardless of the study outcomes.”

41:

include the peer review and in principle acceptance of a study protocol prior to data collection.

37:

is similar, although it may not require the registration of a study's analysis protocol. Finally,

4516: 4372: 4319: 4244: 4209: 4078: 3803: 3785: 3754: 3660: 3617: 3541: 3521: 3462: 3405: 3366: 3011: 2808: 2718: 2248: 2152: 2091: 1894: 1859: 1600: 1512: 1449: 1379: 1258: 966: 900: 716: 692: 589: 239: 204: 65: 4098:"Adherence to guidance on registration of randomised controlled trials published in Anaesthesia" 2023: 2020:"WMA Declaration of Helsinki - Ethical Principles for Medical Research Involving Human Subjects" 699:), and researchers rarely follow the exact research methods and analyses that they preregister ( 784: 724: 696: 669: 665: 4588: 4485: 4341: 4299: 4291: 4170: 4119: 4070: 3978: 3970: 3904: 3854: 3746: 3582: 3289: 3254: 3236: 3185: 3162: 3122: 3003: 2940: 2922: 2881: 2863: 2767: 2759: 2710: 2654: 2636: 2597: 2579: 2530: 2512: 2473: 2455: 2414: 2346: 2297: 2240: 2201: 2144: 2083: 1957: 1922: 1851: 1787: 1710: 1692: 1651: 1563: 1471: 1430: 1371: 1320: 1250: 1215: 1049: 958: 950: 892: 57: 3873: 3085:"A survey on how preregistration affects the research workflow: better science but more work" 772: 688: 649: 597: 557: 4508: 4475: 4465: 4424: 4364: 4331: 4281: 4236: 4201: 4160: 4150: 4139:"Assessment of consistency between peer-reviewed publications and clinical trial registries" 4109: 4060: 4050: 3960: 3844: 3834: 3795: 3738: 3683: 3650: 3609: 3572: 3531: 3454: 3397: 3356: 3323: 3281: 3244: 3226: 3154: 3142: 3112: 3104: 3065: 2995: 2930: 2912: 2871: 2853: 2798: 2749: 2700: 2644: 2628: 2587: 2569: 2520: 2504: 2463: 2445: 2404: 2396: 2336: 2328: 2287: 2279: 2232: 2191: 2183: 2136: 2075: 1949: 1886: 1843: 1700: 1682: 1641: 1631: 1590: 1553: 1543: 1502: 1461: 1420: 1410: 1361: 1351: 1310: 1242: 1205: 1195: 1164: 1137: 1110: 1076: 1041: 1014: 984: 940: 932: 882: 872: 193: 49: 641: 601: 532: 141: 130: 4541: 4397: 3994: 3989: 3708: 3487: 2982:

Wagenmakers, E. J.; Wetzels, R.; Borsboom, D.; van der Maas, H. L.; Kievit, R. A. (2012).

1283: 484: 254: 197: 744: 661: 653: 637: 632:-hacking and unreported multiple testing can be addressed if researchers engage in other 593: 581: 577: 565: 528: 4461: 3993: This article incorporates text from this source, which is available under the 3222: 3100: 2689:"Science in flux: Registered Reports and beyond at the European Journal of Neuroscience" 2565: 868: 17: 4480: 4445: 4165: 4138: 4065: 4038: 3849: 3822: 3273: 3249: 3206: 3117: 3084: 2935: 2900: 2876: 2841: 2649: 2592: 2549: 2525: 2492: 2468: 2433: 2409: 2384: 2341: 2316: 2292: 2267: 2196: 2171: 1705: 1670: 1646: 1619: 1581:

Kirtley, O. J.; Lafit, G.; Achterhof, R.; Hiekkaranta, A. P.; Myin-Germeys, I. (2019).

1425: 1398: 1366: 1339: 1210: 1183: 887: 852: 515:, which maintains a list of journals encouraging the submission of registered reports. 185: 2236: 2079: 1820: 1399:"Recommendations for increasing the transparency of analysis of preexisting data sets" 560:), that it "makes your science better by increasing the credibility of your results" ( 4577: 4520: 4376: 4248: 4213: 4155: 4082: 3807: 3758: 3664: 3545: 3466: 3409: 2252: 2156: 1604: 1558: 1516: 1383: 1262: 970: 920: 776: 765: 757: 728: 704: 657: 625: 564:), and that it "improves the interpretability and credibility of research findings" ( 250: 155: 134: 112: 53: 3621: 3370: 3345:"Pre-analysis plans have limited upside, especially where replications are feasible" 3182:

A student's guide to open science: using the replication crisis to reform psychology

2812: 2722: 2095: 1863: 1620:"Preregistration of exploratory research: Learning from the golden age of discovery" 203:

A clinical trials registry is a platform which catalogs registered clinical trials.

3015: 2140: 1890: 904: 820: 633: 4505:"Research Quality of registered reports compared to the standard publishing model" 4286: 4269: 2616: 1315: 1298: 700: 608:

during the data analysis stage, it is also supposed to be “a plan, not a prison” (

3839: 3231: 2574: 2450: 1687: 1636: 1200: 1114: 585: 511:

Overall, the number of participating journals is increasing, as indicated by the

3401: 3328: 3311: 2400: 2332: 1141: 1067:

Lakens, Daniël (14 May 2024). "When and How to Deviate From a Preregistration".

815: 3965: 3952: 3799: 3742: 3312:"Registered reports: A method to increase the credibility of published results" 3069: 3031:"The value of preregistration for psychological science: A conceptual analysis" 1758:"WHO | Working Group on Best Practice for Clinical Trials Registers (BPG)" 936: 712: 3655: 3385: 3272:

Brodeur, Abel; Cook, Nikolai M.; Hartley, Jonathan S.; Heyes, Anthony (2024).

3158: 2632: 1168: 290:

has begun the push for clinical trial registration with the initiation of the

4345: 4295: 4037:

Claesen, A.; Gomes, S.; Tuerlinckx, F.; Vanpaemel, W.; Leuven, K. U. (2019).

3974: 3773: 3726: 3577: 3560: 3293: 3240: 3166: 2999: 2926: 2917: 2901:"Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices" 2867: 2858: 2763: 2754: 2737: 2640: 2583: 2516: 2459: 1696: 1507: 1490: 1475: 1415: 954: 780: 736: 472: 4512: 4368: 4240: 4055: 3687: 3613: 3536: 3509: 3458: 2803: 2786: 1765: 1595: 1582: 1548: 1531: 1246: 1080: 877: 805: 301:

The World Health Organization maintains an international registry portal at

45: 4504: 4489: 4303: 4174: 4123: 4074: 3982: 3858: 3750: 3586: 3258: 3126: 3007: 2983: 2944: 2885: 2771: 2714: 2658: 2601: 2534: 2477: 2418: 2350: 2244: 2205: 2148: 2087: 1961: 1953: 1926: 1855: 1847: 1714: 1655: 1567: 1434: 1375: 1324: 1254: 1219: 1032:

Bakan, David (1966). "The test of significance in psychological research".

1018: 962: 896: 788: 4336: 2301: 2283: 2187: 1813:"WHO - Working Group on Best Practice for Clinical Trials Registers (BPG)" 1736: 1466: 1053: 4564:

Guidelines for creating registered reports by the Center for Open Science

1998: 792: 4558: 4470: 4360: 3601: 3361: 3344: 3108: 2044: 561: 523:

Several articles have outlined the rationale for preregistration (e.g.,

4114: 4097: 3638:

Devezer, B.; Navarro, D. J.; Vandekerckhove, J.; Buzbas, E. O. (2020).

1898: 1184:"Open science challenges, benefits and tips in early career and beyond" 572:

analyses are less "credible" and/or "interpretable" than preregistered

126: 61: 4429: 4413:"Preregistration is neither sufficient nor necessary for good science" 4412: 4205: 3679: 3450: 2842:"Do Neuroscience Journals Accept Replications? A Survey of Literature" 2827:"Streamlined review and registered reports soon to be official at EJP" 2705: 2688: 2617:"Publication rate in preclinical research: a plea for preregistration" 1995:"ICMJE: Frequently Asked Questions about Clinical Trials Registration" 1532:"Making ERP research more transparent: Guidelines for preregistration" 945: 4320:"Preregistration of secondary data analysis: A template and tutorial" 2508: 1450:"Preregistration of secondary data analysis: A template and tutorial" 1045: 851:

Nosek, B. A.; Ebersole, C. R.; DeHaven, A. C.; Mellor, D. T. (2018).

4189: 3602:"Sound inference in complicated research: A multi-strategy approach" 3510:"Does preregistration improve the credibility of research findings?" 2432:

Wieschowski, Susanne; Silva, Diego S.; Strech, Daniel (2016-11-10).

2315:

Miller, Jennifer E; Korn, David; Ross, Joseph S (12 November 2015).

3790: 3526: 3285: 1356: 302: 4096:

Boghdadly, K. El.; Wiles, M. D.; Atton, S.; Bailey, C. R. (2018).

747:

explained, “we should be more interested in the rationale for the

236:

accumulated data do not show this, if all data were made public.

2109: 454: 3559:

Steegen, S.; Tuerlinckx, F.; Gelman, A.; Vanpaemel, W. (2016).

2219:

DeVito, Nicholas J; Bacon, Seb; Goldacre, Ben (February 2020).

1834:

Dickersin, K; Rennie, D (2009). "Registering clinical trials".

4010:"Research registries: Facts, myths, and possible improvements" 2958: 2366:"As ClinicalTrialsgov Turns 10 Will We See Compliance Improve" 645: 568:, p. 2605). This argument assumes that non-preregistered 148: 3923: 708: 684: 3874:"Questionable research practices following pre-registration" 3305: 3303: 2977: 2975: 1976: 4568: 4268:

L. Haven, Tamarinde; Van Grootel, Dr. Leonie (2019-04-03).

1096:"Registered Reports: A new publishing initiative at Cortex" 434: 87: 4559:

Preregistration resources from the Centre for Open Science

3823:"Ensuring the quality and specificity of preregistrations" 3147:

Advances in Methods and Practices in Psychological Science

2687:

Chambers, C. D.; Forstmann, B.; Pruszynski, J. A. (2019).

1403:

Advances in Methods and Practices in Psychological Science

1157:

Advances in Methods and Practices in Psychological Science

3872:

Ikeda, A.; Xu, H.; Fuji, N.; Zhu, S.; Yamada, Y. (2019).

3720: 3718: 2172:"Compliance with Results Reporting at ClinicalTrials.gov" 2110:"International Clinical Trials Registry Platform (ICTRP)" 2062:

Gülmezoglu, AM; Pang, T; Horton, R; Dickersin, K (2005).

1729:"International Clinical Trials Registry Platform (ICTRP)" 444: 4228: 4032: 4030: 3917: 3915: 3633: 3631: 921:"A community-sourced glossary of open scholarship terms" 604:). Hence, although preregistraton is supposed to reduce 3561:"Increasing transparency through a multiverse analysis" 3451:"Paths in strange spaces: A comment on preregistration" 2389:

Journal of the American Medical Informatics Association

3893: 3891: 3640:"The case for formal methodology in scientific reform" 1788:"Major Journals Press for Clinical Trial Registration" 1182:

Allen, Christopher; Mehler, David M. A. (1 May 2019).

4563: 4188:

Simmons, J. P.; Nelson, L. D.; Simonsohn, U. (2021).

2673: 2491:

Kimmelman, Jonathan; Anderson, James A. (June 2012).

1671:"Refining animal research: The Animal Study Registry" 1397:

Weston, S. J.; Ritchie, S. J.; Rohrer, J. M. (2019).

846: 844: 842: 840: 838: 836: 468: 467:

Over 200 journals offer a registered reports option (

3390:

Organizational Behavior and Human Decision Processes

3384:Collins, H.K.; Whillans, A. V.; John, L. K (2021). 2787:"Promoting reproducibility with registered reports" 269:

Food and Drug Administration Amendments Act of 2007

3205:Krishna, Anand; Peter, Sebastian M. (2018-08-30). 310:International Committee of Medical Journal Editors 284:International Committee of Medical Journal Editors 262:International Committee of Medical Journal Editors 1340:"Preregistration of analyses of preexisting data" 1530:Paul, M.; Govaart, G. H.; Schettino, A. (2021). 1491:"Preregistration in single-case design research" 3503: 3501: 3499: 3497: 857:Proceedings of the National Academy of Sciences 735:and make any residual flexibility transparent ( 292:International Clinical Trials Registry Platform 4008:Abrams, E.; Libgober, J.; List, J. A. (2020). 2266:Pullar, T; Kumar, S; Feely, M (October 1989). 751:method and analyses than in the rationale for 4039:"Preregistration: Comparing dream to reality" 8: 2984:"An agenda for purely confirmatory research" 545:Journal of Political Economy: Microeconomics 3278:Journal of Political Economy Microeconomics 2493:"Should preclinical studies be registered?" 2899:Martin, G. N.; Clarke, Richard M. (2017). 209:United States National Library of Medicine 4479: 4469: 4428: 4335: 4285: 4164: 4154: 4113: 4064: 4054: 3964: 3903: 3848: 3838: 3789: 3654: 3576: 3535: 3525: 3360: 3327: 3248: 3230: 3116: 2934: 2916: 2875: 2857: 2802: 2753: 2704: 2648: 2591: 2573: 2524: 2467: 2449: 2408: 2340: 2291: 2195: 1704: 1686: 1645: 1635: 1594: 1557: 1547: 1536:International Journal of Psychophysiology 1506: 1465: 1424: 1414: 1365: 1355: 1314: 1297:Haven, T. L.; Van Grootel, D. L. (2019). 1209: 1199: 944: 886: 876: 741:high quality theory and research practice 4361:"What should a preregistration contain?" 415: 408:Overview of preclinical study registries 337: 3514:The Quantitative Methods for Psychology 3425:"Preregistration: A plan, not a prison" 1094:Chambers, Christopher D. (March 2013). 987:. Association for Psychological Science 832: 4537: 4526: 4393: 4382: 3704: 3693: 3483: 3472: 2738:"Replication in Psychological Science" 1786:Barrett, Stephen (13 September 2004). 1279: 1268: 4270:"Preregistering qualitative research" 3946: 3944: 3565:Perspectives on Psychological Science 3386:"Joy and rigor in behavioral science" 3343:Coffman, L. C.; Niederle, M. (2015). 3184:. Maidenhead: Open University Press. 2988:Perspectives on Psychological Science 1338:Mertens, G.; Krypotos, A. M. (2019). 1299:"Preregistering qualitative research" 756:guidance on what to include and why ( 325:Overview of clinical trial registries 111:Quantitative research in psychology ( 7: 1489:Johnson, A. H.; Cook, B. G. (2019). 644:; for several other approaches, see 3058:Journal of Business and Psychology 2736:Lindsay, D. Stephen (2015-11-09). 396:Australia and New Zealand (ANZCTR) 215:(CRO) which is running the study. 25: 3678:Szollosi, A.; Donkin, C. (2019). 3310:Nosek, B. A.; Lakens, D. (2014). 3180:Pennington, Charlotte R. (2023). 2383:Huser, V.; Cimino, J. J. (2013). 331:List of clinical trial registries 4156:10.1001/jamaophthalmol.2019.0312 3988: 3727:"Is preregistration worthwhile?" 3349:Journal of Economic Perspectives 2693:European Journal of Neuroscience 2272:Annals of the Rheumatic Diseases 2129:Journal of Clinical Epidemiology 985:"Registered Replication Reports" 853:"The preregistration revolution" 303:http://apps.who.int/trialsearch/ 4411:Pham, M. T.; Oh, T. T. (2020). 2846:Frontiers in Human Neuroscience 2268:"Compliance in clinical trials" 2176:New England Journal of Medicine 500:European Journal of Personality 370:Japan registries network (JPRN) 188:before they are performed in a 184:is the practice of documenting 147:Electroencephalogram research ( 4417:Journal of Consumer Psychology 4194:Journal of Consumer Psychology 2141:10.1016/j.jclinepi.2019.09.005 1891:10.1080/01621459.1959.10501497 213:contract research organization 1: 4287:10.1080/08989621.2019.1580147 3878:Japanese Psychological Review 3038:Japanese Psychological Review 2959:"Registered Reports Overview" 2364:Miseta, Ed (9 January 2018). 2237:10.1016/S0140-6736(19)33220-9 2080:10.1016/s0140-6736(05)66589-0 1316:10.1080/08989621.2019.1580147 1007:Japanese Psychological Review 762:Haven & Van Grootel, 2019 733:researcher degrees of freedom 606:researcher degrees of freedom 590:Collins et al., 2021, Study 1 469:Centre for Open Science, 2019 244:FDA Modernization Act of 1997 127:Mertens & Krypotosm, 2019 120:Haven & Van Grootel, 2019 3840:10.1371/journal.pbio.3000937 3731:Trends in Cognitive Sciences 3232:10.1371/journal.pone.0203470 2575:10.1371/journal.pone.0223758 2451:10.1371/journal.pbio.2000391 1688:10.1371/journal.pbio.3000463 1637:10.1371/journal.pbio.3000690 1201:10.1371/journal.pbio.3000246 1115:10.1016/j.cortex.2012.12.016 737:Simmons et al., 2021, p. 180 586:Coffman & Niederle, 2015 3905:10.1101/2021.03.12.21253378 3402:10.1016/j.obhdp.2021.03.002 2401:10.1136/amiajnl-2012-001501 2333:10.1136/bmjopen-2015-009758 811:Clinical trial registration 658:Szollosi & Donkin, 2019 278:International participation 182:Clinical trial registration 177:Clinical trial registration 103:Specialised preregistration 35:Clinical trial registration 4620: 4450:Royal Society Open Science 4274:Accountability in Research 4043:Royal Society Open Science 3966:10.3758/s13428-023-02277-0 3800:10.1007/s11229-021-03276-4 3743:10.1016/j.tics.2019.11.009 3089:Royal Society Open Science 3070:10.1007/s10869-020-09695-3 2840:Yeung, Andy W. K. (2017). 1303:Accountability in Research 937:10.1038/s41562-021-01269-4 766:Van den Akker et al., 2021 725:Van den Akker et al., 2023 697:Van den Akker et al., 2023 328: 135:van den Akker et al., 2021 3957:Behavior Research Methods 3656:10.1101/2020.04.26.048306 3329:10.1027/1864-9335/a000192 3159:10.1177/25152459231202724 2961:. Center for Open Science 2672:Centre for Open Science. 2633:10.1136/bmjos-2019-100051 2114:World Health Organization 1559:21.11116/0000-0008-2B30-2 1235:The American Psychologist 1169:10.1177/25152459211007467 1142:10.1027/1864-9335/a000192 288:World Health Organization 221:World Health Organization 56:, inappropriate forms of 4604:Evidence-based practices 3578:10.1177/1745691616658637 3000:10.1177/1745691612463078 2918:10.3389/fpsyg.2017.00523 2859:10.3389/fnhum.2017.00468 2755:10.1177/0956797615616374 1508:10.1177/0014402919868529 1416:10.1177/2515245919848684 616:-hacking and unreported 602:Wagenmakers et al., 2012 598:Nosek & Lakens, 2014 558:Nosek & Lakens, 2014 533:Wagenmakers et al., 2012 260:Shortly thereafter, the 227:Creation and development 190:clinical trials registry 142:Johnson & Cook, 2019 77:Standard preregistration 18:Clinical trials registry 3600:Srivastava, S. (2018). 3537:10.20982/tqmp.16.4.p376 3429:Centre for Open Science 2905:Frontiers in Psychology 2804:10.1038/s41562-016-0034 1081:10.1525/collabra.117094 878:10.1073/pnas.1708274114 620:that leads to inflated 562:Centre for Open Science 513:Center for Open Science 425:Animalstudyregistry.org 296:Declaration of Helsinki 4536:Cite journal requires 4392:Cite journal requires 4359:McPhetres, J. (2020). 3703:Cite journal requires 3482:Cite journal requires 2791:Nature Human Behaviour 2370:www.clinicalleader.com 1954:10.1001/jama.2012.4230 1848:10.1001/jama.290.4.516 1823:on September 17, 2008. 1163:(2): 251524592110074. 1034:Psychological Bulletin 1019:10.24602/sjpr.62.3_221 925:Nature Human Behaviour 789:Soderberg et al., 2020 713:Boghdadly et al., 2018 622:familywise error rates 492:Nature Human Behaviour 161:Exploratory research ( 118:Qualitative research ( 84:Open Science Framework 4513:10.31222/osf.io/7x9vy 4369:10.31234/osf.io/cj5mh 4337:10.15626/MP.2020.2625 4241:10.31222/osf.io/epgjd 4056:10.31234/osf.io/d8wex 3688:10.31234/osf.io/suzej 3649:: 2020.04.26.048306. 3614:10.31234/osf.io/bwr48 3459:10.31234/osf.io/wxn58 2742:Psychological Science 2284:10.1136/ard.48.10.871 2188:10.1056/NEJMsa1409364 1596:10.31234/osf.io/seyq7 1549:10.31234/osf.io/4tgve 1467:10.15626/MP.2020.2625 1247:10.31234/osf.io/d7m5r 785:Szollosi et al., 2020 670:Szollosi et al., 2020 480:Psychological Science 473:Chambers et al., 2019 154:Experience sampling ( 140:Single case designs ( 3784:(3–4): 10969–11000. 3772:Rubin, Mark (2021). 3449:Navarro, D. (2020). 2497:Nature Biotechnology 1915:Clin Trials Metaanal 1618:Dirnagl, U. (2020). 1495:Exceptional Children 1344:Psychologica Belgica 1069:Collabra: Psychology 773:Devezer et al., 2020 729:Claesen et al., 2019 709:Heirene et al., 2021 705:Claesen et al., 2019 685:Heirene et al., 2021 650:Devezer et al., 2020 642:Steegen et al., 2016 542:A 2024 study in the 455:Preclinicaltrials.eu 317:Reporting compliance 156:Kirtley et al., 2019 113:Bosnjak et al., 2021 4471:10.1098/rsos.181351 4462:2020RSOS....781351F 4017:NBER Working Papers 3362:10.1257/jep.29.3.81 3223:2018PLoSO..1303470K 3109:10.1098/rsos.211997 3101:2022RSOS....911997S 3029:Lakens, D. (2019). 2785:Mellor, D. (2017). 2566:2019PLoSO..1423758W 2074:(9474): 1829–1831. 1768:on October 12, 2008 869:2018PNAS..115.2600N 781:Pham & Oh, 2020 758:Bowman et al., 2016 701:Abrams et al., 2020 681:Bakker et al., 2020 417: 198:selective reporting 131:Weston et al., 2019 27:Scientific practice 4143:JAMA Ophthalmology 4115:10.1111/anae.14103 3508:Rubin, M. (2020). 2829:. 6 February 2018. 2231:(10221): 361–369. 1977:"SANCTR > Home" 1792:www.quackwatch.org 793:Field et al., 2020 717:Singh et al., 2021 693:Singh et al., 2021 689:Ikeda et al., 2019 594:Nosek et al., 2018 578:Nosek et al., 2018 566:Nosek et al., 2018 529:Nosek et al., 2018 416: 344:ClinicalTrials.gov 240:ClinicalTrials.gov 205:ClinicalTrials.gov 125:Preexisting data ( 94:Registered reports 66:replication crisis 39:registered reports 4430:10.1002/jcpy.1209 4206:10.1002/jcpy.1207 3316:Social Psychology 3191:978-0-335-25116-2 2706:10.1111/ejn.14319 2182:(11): 1031–1039. 2049:www.anzctr.org.au 1981:www.sanctr.gov.za 1130:Social Psychology 863:(11): 2600–2606. 460: 459: 405: 404: 170:Bert et al., 2019 168:Animal Research ( 149:Paul et al., 2021 58:post hoc analysis 16:(Redirected from 4611: 4546: 4545: 4539: 4534: 4532: 4524: 4500: 4494: 4493: 4483: 4473: 4441: 4435: 4434: 4432: 4408: 4402: 4401: 4395: 4390: 4388: 4380: 4356: 4350: 4349: 4339: 4314: 4308: 4307: 4289: 4265: 4259: 4258: 4256: 4255: 4224: 4218: 4217: 4185: 4179: 4178: 4168: 4158: 4134: 4128: 4127: 4117: 4093: 4087: 4086: 4068: 4058: 4034: 4025: 4024: 4014: 4005: 3999: 3992: 3986: 3968: 3948: 3939: 3938: 3936: 3934: 3919: 3910: 3909: 3907: 3895: 3886: 3885: 3869: 3863: 3862: 3852: 3842: 3833:(12): e3000937. 3818: 3812: 3811: 3793: 3769: 3763: 3762: 3722: 3713: 3712: 3706: 3701: 3699: 3691: 3675: 3669: 3668: 3658: 3644: 3635: 3626: 3625: 3597: 3591: 3590: 3580: 3556: 3550: 3549: 3539: 3529: 3505: 3492: 3491: 3485: 3480: 3478: 3470: 3446: 3440: 3439: 3437: 3435: 3420: 3414: 3413: 3381: 3375: 3374: 3364: 3340: 3334: 3333: 3331: 3307: 3298: 3297: 3269: 3263: 3262: 3252: 3234: 3202: 3196: 3195: 3177: 3171: 3170: 3137: 3131: 3130: 3120: 3080: 3074: 3073: 3052: 3046: 3045: 3035: 3026: 3020: 3019: 2979: 2970: 2969: 2967: 2966: 2955: 2949: 2948: 2938: 2920: 2896: 2890: 2889: 2879: 2861: 2837: 2831: 2830: 2823: 2817: 2816: 2806: 2782: 2776: 2775: 2757: 2733: 2727: 2726: 2708: 2684: 2678: 2677: 2669: 2663: 2662: 2652: 2621:BMJ Open Science 2612: 2606: 2605: 2595: 2577: 2560:(11): e0223758. 2545: 2539: 2538: 2528: 2509:10.1038/nbt.2261 2488: 2482: 2481: 2471: 2453: 2444:(11): e2000391. 2429: 2423: 2422: 2412: 2380: 2374: 2373: 2361: 2355: 2354: 2344: 2312: 2306: 2305: 2295: 2263: 2257: 2256: 2216: 2210: 2209: 2199: 2167: 2161: 2160: 2124: 2118: 2117: 2106: 2100: 2099: 2059: 2053: 2052: 2041: 2035: 2034: 2032: 2031: 2022:. Archived from 2016: 2010: 2009: 2007: 2006: 1997:. Archived from 1991: 1985: 1984: 1972: 1966: 1965: 1937: 1931: 1930: 1921:(4–5): 255–266. 1909: 1903: 1902: 1874: 1868: 1867: 1831: 1825: 1824: 1819:. Archived from 1809: 1803: 1802: 1800: 1798: 1783: 1777: 1776: 1774: 1773: 1764:. Archived from 1754: 1748: 1747: 1745: 1744: 1739:on July 19, 2013 1735:. Archived from 1725: 1719: 1718: 1708: 1690: 1681:(10): e3000463. 1666: 1660: 1659: 1649: 1639: 1615: 1609: 1608: 1598: 1578: 1572: 1571: 1561: 1551: 1527: 1521: 1520: 1510: 1486: 1480: 1479: 1469: 1445: 1439: 1438: 1428: 1418: 1394: 1388: 1387: 1369: 1359: 1335: 1329: 1328: 1318: 1294: 1288: 1287: 1281: 1276: 1274: 1266: 1230: 1224: 1223: 1213: 1203: 1179: 1173: 1172: 1152: 1146: 1145: 1125: 1119: 1118: 1100: 1091: 1085: 1084: 1064: 1058: 1057: 1046:10.1037/h0020412 1029: 1023: 1022: 1002: 996: 995: 993: 992: 981: 975: 974: 948: 915: 909: 908: 890: 880: 848: 721:Sun et al., 2019 646:Srivastava, 2018 618:multiple testing 418: 338: 308:Since 2007, the 194:publication bias 192:so as to combat 50:publication bias 21: 4619: 4618: 4614: 4613: 4612: 4610: 4609: 4608: 4574: 4573: 4555: 4550: 4549: 4535: 4525: 4502: 4501: 4497: 4443: 4442: 4438: 4410: 4409: 4405: 4391: 4381: 4358: 4357: 4353: 4324:Meta-Psychology 4316: 4315: 4311: 4267: 4266: 4262: 4253: 4251: 4226: 4225: 4221: 4187: 4186: 4182: 4136: 4135: 4131: 4095: 4094: 4090: 4036: 4035: 4028: 4012: 4007: 4006: 4002: 3950: 3949: 3942: 3932: 3930: 3921: 3920: 3913: 3897: 3896: 3889: 3871: 3870: 3866: 3820: 3819: 3815: 3771: 3770: 3766: 3724: 3723: 3716: 3702: 3692: 3677: 3676: 3672: 3642: 3637: 3636: 3629: 3599: 3598: 3594: 3558: 3557: 3553: 3507: 3506: 3495: 3481: 3471: 3448: 3447: 3443: 3433: 3431: 3422: 3421: 3417: 3383: 3382: 3378: 3342: 3341: 3337: 3309: 3308: 3301: 3271: 3270: 3266: 3217:(8): e0203470. 3204: 3203: 3199: 3192: 3179: 3178: 3174: 3139: 3138: 3134: 3082: 3081: 3077: 3054: 3053: 3049: 3033: 3028: 3027: 3023: 2981: 2980: 2973: 2964: 2962: 2957: 2956: 2952: 2898: 2897: 2893: 2839: 2838: 2834: 2825: 2824: 2820: 2784: 2783: 2779: 2748:(12): 1827–32. 2735: 2734: 2730: 2686: 2685: 2681: 2671: 2670: 2666: 2614: 2613: 2609: 2547: 2546: 2542: 2490: 2489: 2485: 2431: 2430: 2426: 2395:(e1): e169–74. 2382: 2381: 2377: 2363: 2362: 2358: 2327:(11): e009758. 2314: 2313: 2309: 2265: 2264: 2260: 2218: 2217: 2213: 2169: 2168: 2164: 2126: 2125: 2121: 2108: 2107: 2103: 2061: 2060: 2056: 2043: 2042: 2038: 2029: 2027: 2018: 2017: 2013: 2004: 2002: 1993: 1992: 1988: 1974: 1973: 1969: 1939: 1938: 1934: 1911: 1910: 1906: 1879:J Am Stat Assoc 1876: 1875: 1871: 1833: 1832: 1828: 1811: 1810: 1806: 1796: 1794: 1785: 1784: 1780: 1771: 1769: 1756: 1755: 1751: 1742: 1740: 1727: 1726: 1722: 1668: 1667: 1663: 1630:(3): e3000690. 1617: 1616: 1612: 1580: 1579: 1575: 1529: 1528: 1524: 1488: 1487: 1483: 1454:Meta-Psychology 1447: 1446: 1442: 1396: 1395: 1391: 1337: 1336: 1332: 1296: 1295: 1291: 1277: 1267: 1232: 1231: 1227: 1194:(5): e3000246. 1181: 1180: 1176: 1154: 1153: 1149: 1127: 1126: 1122: 1098: 1093: 1092: 1088: 1066: 1065: 1061: 1031: 1030: 1026: 1004: 1003: 999: 990: 988: 983: 982: 978: 917: 916: 912: 850: 849: 834: 829: 802: 777:McPhetres, 2020 554: 521: 485:editor-in-chief 465: 463:Journal support 410: 333: 327: 319: 280: 255:GlaxoSmithKline 229: 186:clinical trials 179: 105: 96: 79: 74: 31:Preregistration 28: 23: 22: 15: 12: 11: 5: 4617: 4615: 4607: 4606: 4601: 4596: 4591: 4586: 4576: 4575: 4572: 4571: 4566: 4561: 4554: 4553:External links 4551: 4548: 4547: 4538:|journal= 4495: 4436: 4403: 4394:|journal= 4351: 4309: 4280:(3): 229–244. 4260: 4219: 4200:(1): 177–180. 4180: 4149:(5): 552–556. 4129: 4108:(5): 556–563. 4088: 4026: 4000: 3940: 3911: 3887: 3864: 3813: 3764: 3714: 3705:|journal= 3670: 3627: 3592: 3571:(5): 702–712. 3551: 3520:(4): 376–390. 3493: 3484:|journal= 3441: 3415: 3376: 3335: 3322:(3): 137–141. 3299: 3286:10.1086/730455 3264: 3197: 3190: 3172: 3132: 3075: 3064:(4): 553–571. 3047: 3021: 2994:(6): 632–638. 2971: 2950: 2891: 2832: 2818: 2777: 2728: 2679: 2664: 2627:(1): e100051. 2607: 2540: 2503:(6): 488–489. 2483: 2424: 2375: 2356: 2307: 2258: 2211: 2162: 2119: 2101: 2054: 2036: 2011: 1986: 1967: 1948:(17): 1861–4. 1932: 1904: 1885:(285): 30–34. 1869: 1842:(4): 516–523. 1826: 1804: 1778: 1749: 1720: 1661: 1610: 1573: 1522: 1481: 1440: 1409:(3): 214–227. 1389: 1357:10.5334/pb.493 1350:(1): 338–352. 1330: 1309:(3): 229–244. 1289: 1241:(4): 602–615. 1225: 1174: 1147: 1136:(3): 137–141. 1120: 1109:(3): 609–610. 1086: 1059: 1040:(6): 423–437. 1024: 1013:(3): 221–230. 997: 976: 931:(3): 312–318. 910: 831: 830: 828: 825: 824: 823: 818: 813: 808: 801: 798: 553: 550: 520: 517: 464: 461: 458: 457: 452: 448: 447: 442: 438: 437: 432: 428: 427: 422: 409: 406: 403: 402: 397: 394: 390: 389: 384: 381: 377: 376: 371: 368: 364: 363: 358: 355: 351: 350: 345: 342: 326: 323: 318: 315: 279: 276: 228: 225: 178: 175: 174: 173: 166: 159: 152: 145: 138: 123: 116: 104: 101: 95: 92: 78: 75: 73: 70: 26: 24: 14: 13: 10: 9: 6: 4: 3: 2: 4616: 4605: 4602: 4600: 4597: 4595: 4592: 4590: 4587: 4585: 4582: 4581: 4579: 4570: 4567: 4565: 4562: 4560: 4557: 4556: 4552: 4543: 4530: 4522: 4518: 4514: 4510: 4506: 4499: 4496: 4491: 4487: 4482: 4477: 4472: 4467: 4463: 4459: 4456:(4): 181351. 4455: 4451: 4447: 4440: 4437: 4431: 4426: 4422: 4418: 4414: 4407: 4404: 4399: 4386: 4378: 4374: 4370: 4366: 4362: 4355: 4352: 4347: 4343: 4338: 4333: 4329: 4325: 4321: 4313: 4310: 4305: 4301: 4297: 4293: 4288: 4283: 4279: 4275: 4271: 4264: 4261: 4250: 4246: 4242: 4238: 4234: 4230: 4223: 4220: 4215: 4211: 4207: 4203: 4199: 4195: 4191: 4184: 4181: 4176: 4172: 4167: 4162: 4157: 4152: 4148: 4144: 4140: 4133: 4130: 4125: 4121: 4116: 4111: 4107: 4103: 4099: 4092: 4089: 4084: 4080: 4076: 4072: 4067: 4062: 4057: 4052: 4048: 4044: 4040: 4033: 4031: 4027: 4022: 4018: 4011: 4004: 4001: 3998: 3996: 3991: 3984: 3980: 3976: 3972: 3967: 3962: 3958: 3954: 3947: 3945: 3941: 3929: 3925: 3918: 3916: 3912: 3906: 3901: 3894: 3892: 3888: 3884:(3): 281–295. 3883: 3879: 3875: 3868: 3865: 3860: 3856: 3851: 3846: 3841: 3836: 3832: 3828: 3824: 3817: 3814: 3809: 3805: 3801: 3797: 3792: 3787: 3783: 3779: 3775: 3768: 3765: 3760: 3756: 3752: 3748: 3744: 3740: 3736: 3732: 3728: 3721: 3719: 3715: 3710: 3697: 3689: 3685: 3681: 3674: 3671: 3666: 3662: 3657: 3652: 3648: 3641: 3634: 3632: 3628: 3623: 3619: 3615: 3611: 3607: 3603: 3596: 3593: 3588: 3584: 3579: 3574: 3570: 3566: 3562: 3555: 3552: 3547: 3543: 3538: 3533: 3528: 3523: 3519: 3515: 3511: 3504: 3502: 3500: 3498: 3494: 3489: 3476: 3468: 3464: 3460: 3456: 3452: 3445: 3442: 3430: 3426: 3419: 3416: 3411: 3407: 3403: 3399: 3395: 3391: 3387: 3380: 3377: 3372: 3368: 3363: 3358: 3354: 3350: 3346: 3339: 3336: 3330: 3325: 3321: 3317: 3313: 3306: 3304: 3300: 3295: 3291: 3287: 3283: 3279: 3275: 3268: 3265: 3260: 3256: 3251: 3246: 3242: 3238: 3233: 3228: 3224: 3220: 3216: 3212: 3208: 3201: 3198: 3193: 3187: 3183: 3176: 3173: 3168: 3164: 3160: 3156: 3152: 3148: 3144: 3136: 3133: 3128: 3124: 3119: 3114: 3110: 3106: 3102: 3098: 3094: 3090: 3086: 3079: 3076: 3071: 3067: 3063: 3059: 3051: 3048: 3044:(3): 221–230. 3043: 3039: 3032: 3025: 3022: 3017: 3013: 3009: 3005: 3001: 2997: 2993: 2989: 2985: 2978: 2976: 2972: 2960: 2954: 2951: 2946: 2942: 2937: 2932: 2928: 2924: 2919: 2914: 2910: 2906: 2902: 2895: 2892: 2887: 2883: 2878: 2873: 2869: 2865: 2860: 2855: 2851: 2847: 2843: 2836: 2833: 2828: 2822: 2819: 2814: 2810: 2805: 2800: 2796: 2792: 2788: 2781: 2778: 2773: 2769: 2765: 2761: 2756: 2751: 2747: 2743: 2739: 2732: 2729: 2724: 2720: 2716: 2712: 2707: 2702: 2698: 2694: 2690: 2683: 2680: 2675: 2668: 2665: 2660: 2656: 2651: 2646: 2642: 2638: 2634: 2630: 2626: 2622: 2618: 2611: 2608: 2603: 2599: 2594: 2589: 2585: 2581: 2576: 2571: 2567: 2563: 2559: 2555: 2551: 2544: 2541: 2536: 2532: 2527: 2522: 2518: 2514: 2510: 2506: 2502: 2498: 2494: 2487: 2484: 2479: 2475: 2470: 2465: 2461: 2457: 2452: 2447: 2443: 2439: 2435: 2428: 2425: 2420: 2416: 2411: 2406: 2402: 2398: 2394: 2390: 2386: 2379: 2376: 2371: 2367: 2360: 2357: 2352: 2348: 2343: 2338: 2334: 2330: 2326: 2322: 2318: 2311: 2308: 2303: 2299: 2294: 2289: 2285: 2281: 2278:(10): 871–5. 2277: 2273: 2269: 2262: 2259: 2254: 2250: 2246: 2242: 2238: 2234: 2230: 2226: 2222: 2215: 2212: 2207: 2203: 2198: 2193: 2189: 2185: 2181: 2177: 2173: 2166: 2163: 2158: 2154: 2150: 2146: 2142: 2138: 2134: 2130: 2123: 2120: 2115: 2111: 2105: 2102: 2097: 2093: 2089: 2085: 2081: 2077: 2073: 2069: 2065: 2058: 2055: 2050: 2046: 2040: 2037: 2026:on 2011-08-30 2025: 2021: 2015: 2012: 2001:on 2010-07-06 2000: 1996: 1990: 1987: 1982: 1978: 1971: 1968: 1963: 1959: 1955: 1951: 1947: 1943: 1936: 1933: 1928: 1924: 1920: 1916: 1908: 1905: 1900: 1896: 1892: 1888: 1884: 1880: 1873: 1870: 1865: 1861: 1857: 1853: 1849: 1845: 1841: 1837: 1830: 1827: 1822: 1818: 1814: 1808: 1805: 1793: 1789: 1782: 1779: 1767: 1763: 1759: 1753: 1750: 1738: 1734: 1730: 1724: 1721: 1716: 1712: 1707: 1702: 1698: 1694: 1689: 1684: 1680: 1676: 1672: 1665: 1662: 1657: 1653: 1648: 1643: 1638: 1633: 1629: 1625: 1621: 1614: 1611: 1606: 1602: 1597: 1592: 1588: 1584: 1577: 1574: 1569: 1565: 1560: 1555: 1550: 1545: 1541: 1537: 1533: 1526: 1523: 1518: 1514: 1509: 1504: 1501:(1): 95–112. 1500: 1496: 1492: 1485: 1482: 1477: 1473: 1468: 1463: 1459: 1455: 1451: 1444: 1441: 1436: 1432: 1427: 1422: 1417: 1412: 1408: 1404: 1400: 1393: 1390: 1385: 1381: 1377: 1373: 1368: 1363: 1358: 1353: 1349: 1345: 1341: 1334: 1331: 1326: 1322: 1317: 1312: 1308: 1304: 1300: 1293: 1290: 1285: 1272: 1264: 1260: 1256: 1252: 1248: 1244: 1240: 1236: 1229: 1226: 1221: 1217: 1212: 1207: 1202: 1197: 1193: 1189: 1185: 1178: 1175: 1170: 1166: 1162: 1158: 1151: 1148: 1143: 1139: 1135: 1131: 1124: 1121: 1116: 1112: 1108: 1104: 1097: 1090: 1087: 1082: 1078: 1074: 1070: 1063: 1060: 1055: 1051: 1047: 1043: 1039: 1035: 1028: 1025: 1020: 1016: 1012: 1008: 1001: 998: 986: 980: 977: 972: 968: 964: 960: 956: 952: 947: 942: 938: 934: 930: 926: 922: 914: 911: 906: 902: 898: 894: 889: 884: 879: 874: 870: 866: 862: 858: 854: 847: 845: 843: 841: 839: 837: 833: 826: 822: 819: 817: 814: 812: 809: 807: 804: 803: 799: 797: 794: 790: 786: 782: 778: 774: 769: 767: 763: 759: 754: 750: 746: 742: 738: 734: 730: 726: 722: 718: 714: 710: 706: 702: 698: 694: 690: 686: 682: 678: 673: 671: 667: 663: 659: 655: 651: 647: 643: 639: 635: 631: 627: 626:Navarro, 2020 623: 619: 615: 611: 610:Dehaven, 2017 607: 603: 599: 595: 591: 587: 583: 579: 575: 571: 567: 563: 559: 551: 549: 547: 546: 540: 536: 534: 530: 526: 518: 516: 514: 509: 505: 502: 501: 496: 494: 493: 488: 486: 482: 481: 476: 474: 470: 462: 456: 453: 450: 449: 446: 443: 440: 439: 436: 433: 430: 429: 426: 423: 420: 419: 414: 407: 401: 398: 395: 392: 391: 388: 385: 382: 379: 378: 375: 372: 369: 366: 365: 362: 359: 356: 353: 352: 349: 346: 343: 340: 339: 336: 332: 324: 322: 316: 314: 311: 306: 304: 299: 297: 293: 289: 285: 277: 275: 273: 270: 267:In 2007, the 265: 263: 258: 256: 252: 251:Eliot Spitzer 247: 245: 241: 237: 233: 226: 224: 222: 216: 214: 210: 207:, run by the 206: 201: 199: 195: 191: 187: 183: 176: 171: 167: 164: 163:Dirnagl, 2020 160: 157: 153: 150: 146: 143: 139: 136: 132: 128: 124: 121: 117: 114: 110: 109: 108: 102: 100: 93: 91: 89: 85: 76: 71: 69: 67: 63: 59: 55: 54:data dredging 51: 47: 42: 40: 36: 32: 19: 4599:Open science 4569:As Predicted 4529:cite journal 4498: 4453: 4449: 4439: 4420: 4416: 4406: 4385:cite journal 4354: 4327: 4323: 4312: 4277: 4273: 4263: 4252:. Retrieved 4232: 4222: 4197: 4193: 4183: 4146: 4142: 4132: 4105: 4101: 4091: 4046: 4042: 4020: 4016: 4003: 3987: 3956: 3931:. Retrieved 3927: 3881: 3877: 3867: 3830: 3826: 3816: 3781: 3777: 3767: 3737:(2): 94–95. 3734: 3730: 3696:cite journal 3673: 3646: 3605: 3595: 3568: 3564: 3554: 3517: 3513: 3475:cite journal 3444: 3434:25 September 3432:. Retrieved 3428: 3423:Dehaven, A. 3418: 3393: 3389: 3379: 3355:(3): 81–98. 3352: 3348: 3338: 3319: 3315: 3277: 3267: 3214: 3210: 3200: 3181: 3175: 3150: 3146: 3135: 3092: 3088: 3078: 3061: 3057: 3050: 3041: 3037: 3024: 2991: 2987: 2963:. Retrieved 2953: 2908: 2904: 2894: 2849: 2845: 2835: 2821: 2794: 2790: 2780: 2745: 2741: 2731: 2696: 2692: 2682: 2667: 2624: 2620: 2610: 2557: 2553: 2543: 2500: 2496: 2486: 2441: 2438:PLOS Biology 2437: 2427: 2392: 2388: 2378: 2369: 2359: 2324: 2320: 2310: 2275: 2271: 2261: 2228: 2224: 2214: 2179: 2175: 2165: 2132: 2128: 2122: 2113: 2104: 2071: 2067: 2057: 2048: 2039: 2028:. Retrieved 2024:the original 2014: 2003:. Retrieved 1999:the original 1989: 1980: 1970: 1945: 1941: 1935: 1918: 1914: 1907: 1882: 1878: 1872: 1839: 1835: 1829: 1821:the original 1816: 1807: 1795:. Retrieved 1791: 1781: 1770:. Retrieved 1766:the original 1761: 1752: 1741:. Retrieved 1737:the original 1732: 1723: 1678: 1675:PLOS Biology 1674: 1664: 1627: 1623: 1613: 1586: 1576: 1539: 1535: 1525: 1498: 1494: 1484: 1457: 1453: 1443: 1406: 1402: 1392: 1347: 1343: 1333: 1306: 1302: 1292: 1271:cite journal 1238: 1234: 1228: 1191: 1188:PLOS Biology 1187: 1177: 1160: 1156: 1150: 1133: 1129: 1123: 1106: 1102: 1089: 1072: 1068: 1062: 1037: 1033: 1027: 1010: 1006: 1000: 989:. Retrieved 979: 928: 924: 913: 860: 856: 821:Open science 770: 752: 748: 745:Rubin (2020) 740: 676: 674: 638:(Rubin, 2020 634:open science 629: 613: 574:confirmatory 573: 569: 555: 543: 541: 537: 525:Lakens, 2019 522: 510: 506: 498: 497: 490: 489: 478: 477: 466: 445:OSF Registry 435:As Predicted 411: 399: 386: 373: 360: 347: 334: 320: 307: 300: 281: 266: 259: 248: 238: 234: 230: 217: 202: 189: 181: 180: 106: 97: 80: 43: 38: 34: 30: 29: 4594:Metascience 4584:Peer review 4423:: 163–176. 4102:Anaesthesia 3396:: 179–191. 2135:: 106–113. 1817:www.who.int 816:Metascience 791:; see also 711:; see also 654:Rubin, 2020 588:; see also 582:Rubin, 2020 570:exploratory 357:EU register 88:AsPredicted 4578:Categories 4254:2023-11-12 3791:2107.02947 3527:2010.10513 2965:2018-11-28 2699:(1): 4–5. 2225:The Lancet 2030:2010-09-02 2005:2010-07-23 1772:2017-06-23 1743:2017-06-23 1280:|url= 991:2015-11-13 946:2292/62865 827:References 753:historical 679:-hacking ( 552:Criticisms 329:See also: 4521:242155160 4377:236855127 4346:2003-2714 4296:0898-9621 4249:242644091 4214:230629031 4083:240688291 3995:CC BY 4.0 3975:1554-3528 3827:PLOS Biol 3808:235755301 3759:209500379 3665:218466913 3546:221821323 3467:236797452 3410:234848511 3294:2832-9368 3241:1932-6203 3167:2515-2459 2927:1664-1078 2868:1662-5161 2764:0956-7976 2641:2398-8703 2584:1932-6203 2517:1546-1696 2460:1545-7885 2253:210704225 2157:202582999 1697:1545-7885 1624:PLOS Biol 1605:236657420 1542:: 52–63. 1517:204363608 1476:2003-2714 1384:201844047 1263:236655778 971:247025114 955:2397-3374 806:AllTrials 508:studies. 46:p-hacking 4589:Research 4490:32431853 4304:30741570 4175:30946427 4124:29292498 4075:34729209 3997:license. 3983:37950113 3928:PsyArXiv 3859:33296358 3778:Synthese 3751:31892461 3622:86539993 3606:PsyArXiv 3587:27694465 3371:18163762 3259:30161249 3211:PLOS ONE 3127:35814910 3008:26168122 2945:28443044 2886:28979201 2813:28976450 2797:: 0034. 2772:26553013 2723:58645509 2715:30584679 2659:35047690 2602:31770377 2554:PLOS ONE 2535:22678379 2478:27832101 2419:23396544 2351:26563214 2321:BMJ Open 2245:31958402 2206:25760355 2149:31521723 2096:29203085 2088:15924966 2045:"ANZCTR" 1975:SANCTR. 1962:22550202 1927:10146333 1864:10184671 1856:12876095 1715:31613875 1656:32214315 1587:PsyArXiv 1568:33676957 1435:32190814 1376:31497308 1325:30741570 1255:34807636 1220:31042704 963:35190714 897:29531091 800:See also 519:Benefits 4481:7211853 4458:Bibcode 4166:6512264 4066:8548785 3933:17 July 3900:medRxiv 3850:7725296 3647:bioRxiv 3250:6117074 3219:Bibcode 3118:9257590 3097:Bibcode 3016:5096417 2936:5387793 2911:: 523. 2877:5611708 2852:: 468. 2650:8647586 2593:6879110 2562:Bibcode 2526:4516408 2469:5104355 2410:3715364 2342:4654354 2302:2684057 2293:1003898 2197:4508873 1899:2282137 1762:Who.int 1733:Who.int 1706:6793840 1647:7098547 1426:7079740 1367:6706998 1282:value ( 1211:6513108 1054:5974619 905:4639380 888:5856500 865:Bibcode 749:current 624:(e.g., 348:150,551 62:HARKing 4519: 4488: 4478: 4375: 4344: 4302: 4294: 4247: 4233:osf.io 4212: 4173: 4163: 4122: 4081: 4073: 4063: 4049:(10). 3981: 3973: 3902: 3857: 3847: 3806: 3757: 3749: 3663: 3620: 3585: 3544: 3465: 3408: 3369: 3292: 3257: 3247: 3239: 3188: 3165: 3125: 3115: 3014: 3006: 2943: 2933: 2925: 2884: 2874: 2866: 2811: 2770: 2762: 2721: 2713: 2657: 2647: 2639: 2600: 2590: 2582: 2533: 2523: 2515: 2476: 2466: 2458: 2417: 2407: 2349: 2339: 2300: 2290: 2251: 2243: 2204: 2194: 2155: 2147: 2094: 2086: 2068:Lancet 1960: 1925: 1897: 1862: 1854: 1797:22 May 1713: 1703: 1695: 1654: 1644: 1603: 1566: 1515: 1474: 1433: 1423: 1382: 1374: 1364: 1323: 1278:Check 1261: 1253: 1218: 1208: 1103:Cortex 1052: 969: 961: 953: 903: 895: 885: 387:11,794 383:ISRCTN 374:12,728 361:21,060 60:, and 4517:S2CID 4373:S2CID 4245:S2CID 4229:"OSF" 4210:S2CID 4079:S2CID 4021:27250 4013:(PDF) 3804:S2CID 3786:arXiv 3755:S2CID 3661:S2CID 3643:(PDF) 3618:S2CID 3542:S2CID 3522:arXiv 3463:S2CID 3406:S2CID 3367:S2CID 3153:(4). 3095:(7). 3034:(PDF) 3012:S2CID 2809:S2CID 2719:S2CID 2249:S2CID 2153:S2CID 2092:S2CID 1895:JSTOR 1860:S2CID 1601:S2CID 1513:S2CID 1380:S2CID 1259:S2CID 1099:(PDF) 1075:(1). 967:S2CID 901:S2CID 743:. As 400:8,216 253:sued 72:Types 4542:help 4486:PMID 4398:help 4342:ISSN 4300:PMID 4292:ISSN 4171:PMID 4120:PMID 4071:PMID 3979:PMID 3971:ISSN 3935:2021 3855:PMID 3747:PMID 3709:help 3583:PMID 3488:help 3436:2020 3290:ISSN 3255:PMID 3237:ISSN 3186:ISBN 3163:ISSN 3123:PMID 3004:PMID 2941:PMID 2923:ISSN 2882:PMID 2864:ISSN 2768:PMID 2760:ISSN 2711:PMID 2655:PMID 2637:ISSN 2598:PMID 2580:ISSN 2531:PMID 2513:ISSN 2474:PMID 2456:ISSN 2415:PMID 2347:PMID 2298:PMID 2241:PMID 2202:PMID 2145:PMID 2084:PMID 1958:PMID 1942:JAMA 1923:PMID 1852:PMID 1836:JAMA 1799:2019 1711:PMID 1693:ISSN 1652:PMID 1564:PMID 1472:ISSN 1431:PMID 1372:PMID 1321:PMID 1284:help 1251:PMID 1216:PMID 1050:PMID 959:PMID 951:ISSN 893:PMID 672:). 666:2021 662:2020 282:The 196:and 4509:doi 4476:PMC 4466:doi 4425:doi 4365:doi 4332:doi 4282:doi 4237:doi 4202:doi 4161:PMC 4151:doi 4147:137 4110:doi 4061:PMC 4051:doi 3961:doi 3845:PMC 3835:doi 3796:doi 3782:199 3739:doi 3684:doi 3651:doi 3610:doi 3573:doi 3532:doi 3455:doi 3398:doi 3394:164 3357:doi 3324:doi 3282:doi 3245:PMC 3227:doi 3155:doi 3113:PMC 3105:doi 3066:doi 2996:doi 2931:PMC 2913:doi 2872:PMC 2854:doi 2799:doi 2750:doi 2701:doi 2645:PMC 2629:doi 2588:PMC 2570:doi 2521:PMC 2505:doi 2464:PMC 2446:doi 2405:PMC 2397:doi 2337:PMC 2329:doi 2288:PMC 2280:doi 2233:doi 2229:395 2192:PMC 2184:doi 2180:372 2137:doi 2133:116 2076:doi 2072:365 1950:doi 1946:307 1887:doi 1844:doi 1840:290 1701:PMC 1683:doi 1642:PMC 1632:doi 1591:doi 1554:hdl 1544:doi 1540:164 1503:doi 1462:doi 1421:PMC 1411:doi 1362:PMC 1352:doi 1311:doi 1243:doi 1206:PMC 1196:doi 1165:doi 1138:doi 1111:doi 1077:doi 1042:doi 1015:doi 941:hdl 933:doi 883:PMC 873:doi 861:115 475:). 451:4. 441:3. 431:2. 421:1. 86:or 4580:: 4533:: 4531:}} 4527:{{ 4515:. 4507:. 4484:. 4474:. 4464:. 4452:. 4448:. 4421:31 4419:. 4415:. 4389:: 4387:}} 4383:{{ 4371:. 4363:. 4340:. 4330:. 4326:. 4322:. 4298:. 4290:. 4278:26 4276:. 4272:. 4243:. 4235:. 4231:. 4208:. 4198:31 4196:. 4192:. 4169:. 4159:. 4145:. 4141:. 4118:. 4106:73 4104:. 4100:. 4077:. 4069:. 4059:. 4045:. 4041:. 4029:^ 4019:. 4015:. 3977:. 3969:. 3959:. 3955:. 3943:^ 3926:. 3914:^ 3890:^ 3882:62 3880:. 3876:. 3853:. 3843:. 3831:18 3829:. 3825:. 3802:. 3794:. 3780:. 3776:. 3753:. 3745:. 3735:24 3733:. 3729:. 3717:^ 3700:: 3698:}} 3694:{{ 3682:. 3659:. 3645:. 3630:^ 3616:. 3608:. 3604:. 3581:. 3569:11 3567:. 3563:. 3540:. 3530:. 3518:16 3516:. 3512:. 3496:^ 3479:: 3477:}} 3473:{{ 3461:. 3453:. 3427:. 3404:. 3392:. 3388:. 3365:. 3353:29 3351:. 3347:. 3320:45 3318:. 3314:. 3302:^ 3288:. 3280:. 3276:. 3253:. 3243:. 3235:. 3225:. 3215:13 3213:. 3209:. 3161:. 3149:. 3145:. 3121:. 3111:. 3103:. 3091:. 3087:. 3062:36 3060:. 3042:62 3040:. 3036:. 3010:. 3002:. 2990:. 2986:. 2974:^ 2939:. 2929:. 2921:. 2907:. 2903:. 2880:. 2870:. 2862:. 2850:11 2848:. 2844:. 2807:. 2793:. 2789:. 2766:. 2758:. 2746:26 2744:. 2740:. 2717:. 2709:. 2697:49 2695:. 2691:. 2653:. 2643:. 2635:. 2623:. 2619:. 2596:. 2586:. 2578:. 2568:. 2558:14 2556:. 2552:. 2529:. 2519:. 2511:. 2501:30 2499:. 2495:. 2472:. 2462:. 2454:. 2442:14 2440:. 2436:. 2413:. 2403:. 2393:20 2391:. 2387:. 2368:. 2345:. 2335:. 2323:. 2319:. 2296:. 2286:. 2276:48 2274:. 2270:. 2247:. 2239:. 2227:. 2223:. 2200:. 2190:. 2178:. 2174:. 2151:. 2143:. 2131:. 2112:. 2090:. 2082:. 2070:. 2066:. 2047:. 1979:. 1956:. 1944:. 1919:28 1917:. 1893:. 1883:54 1881:. 1858:. 1850:. 1838:. 1815:. 1790:. 1760:. 1731:. 1709:. 1699:. 1691:. 1679:17 1677:. 1673:. 1650:. 1640:. 1628:18 1626:. 1622:. 1599:. 1589:. 1585:. 1562:. 1552:. 1538:. 1534:. 1511:. 1499:86 1497:. 1493:. 1470:. 1460:. 1456:. 1452:. 1429:. 1419:. 1405:. 1401:. 1378:. 1370:. 1360:. 1348:59 1346:. 1342:. 1319:. 1307:26 1305:. 1301:. 1275:: 1273:}} 1269:{{ 1257:. 1249:. 1239:77 1237:. 1214:. 1204:. 1192:17 1190:. 1186:. 1159:. 1134:45 1132:. 1107:49 1105:. 1101:. 1073:10 1071:. 1048:. 1038:66 1036:. 1011:62 1009:. 965:. 957:. 949:. 939:. 927:. 923:. 899:. 891:. 881:. 871:. 859:. 855:. 835:^ 783:; 779:; 775:; 764:; 760:; 719:; 715:; 707:; 703:; 695:; 691:; 687:; 683:; 668:; 664:, 656:; 652:; 640:; 600:; 596:; 531:; 527:; 393:5. 380:4. 367:3. 354:2. 341:1. 274:. 133:; 129:; 68:. 52:, 48:, 4544:) 4540:( 4523:. 4511:: 4492:. 4468:: 4460:: 4454:7 4433:. 4427:: 4400:) 4396:( 4379:. 4367:: 4348:. 4334:: 4328:5 4306:. 4284:: 4257:. 4239:: 4216:. 4204:: 4177:. 4153:: 4126:. 4112:: 4085:. 4053:: 4047:8 4023:. 3985:. 3963:: 3937:. 3908:. 3861:. 3837:: 3810:. 3798:: 3788:: 3761:. 3741:: 3711:) 3707:( 3690:. 3686:: 3667:. 3653:: 3624:. 3612:: 3589:. 3575:: 3548:. 3534:: 3524:: 3490:) 3486:( 3469:. 3457:: 3438:. 3412:. 3400:: 3373:. 3359:: 3332:. 3326:: 3296:. 3284:: 3261:. 3229:: 3221:: 3194:. 3169:. 3157:: 3151:6 3129:. 3107:: 3099:: 3093:9 3072:. 3068:: 3018:. 2998:: 2992:7 2968:. 2947:. 2915:: 2909:8 2888:. 2856:: 2815:. 2801:: 2795:1 2774:. 2752:: 2725:. 2703:: 2676:. 2661:. 2631:: 2625:4 2604:. 2572:: 2564:: 2537:. 2507:: 2480:. 2448:: 2421:. 2399:: 2372:. 2353:. 2331:: 2325:5 2304:. 2282:: 2255:. 2235:: 2208:. 2186:: 2159:. 2139:: 2116:. 2098:. 2078:: 2051:. 2033:. 2008:. 1983:. 1964:. 1952:: 1929:. 1901:. 1889:: 1866:. 1846:: 1801:. 1775:. 1746:. 1717:. 1685:: 1658:. 1634:: 1607:. 1593:: 1570:. 1556:: 1546:: 1519:. 1505:: 1478:. 1464:: 1458:5 1437:. 1413:: 1407:2 1386:. 1354:: 1327:. 1313:: 1286:) 1265:. 1245:: 1222:. 1198:: 1171:. 1167:: 1161:4 1144:. 1140:: 1117:. 1113:: 1083:. 1079:: 1056:. 1044:: 1021:. 1017:: 994:. 973:. 943:: 935:: 929:6 907:. 875:: 867:: 677:p 630:p 614:p 172:) 165:) 158:) 151:) 144:) 137:) 122:) 115:) 20:)

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

Index