Knowledge

Preregistration (science)

Source đź“ť

768:). Many pre-registration template stress the importance of a power analysis but not only stress the importance of why the methodology was used. Additionally to the concerns raised about its practical implementation in quantitative research, critics have also argued that preregistration is less applicable, or even unsuitable, for qualitative research. Pre-registration imposes rigidity, limiting researchers' ability to adapt to emerging data and evolving contexts, which are essential to capturing the richness of participants' lived experiences. Additionally, it conflicts with the inductive and flexible nature of theory-building in qualitative research, constraining the exploratory approach that is central to this methodology. 99:
principle acceptance). The proposed study is then performed, and the research report is submitted for Stage 2 peer review. Stage 2 peer review confirms that the actual research methods are consistent with the preregistered protocol, that quality thresholds are met (e.g., manipulation checks confirm the validity of the experimental manipulation), and that the conclusions follow from the data. Because studies are accepted for publication regardless of whether the results are statistically significant Registered Reports prevent publication bias. Meta-scientific research has shown that the percentage of non-significant results in Registered Reports is substantially higher than in standard publications.
90:. The preregistered study is then conducted, and a report of the study and its results is submitted for publication together with access to the preregistration document. This preregistration approach allows peer reviewers and subsequent readers to cross-reference the preregistration document with the published research article in order to identify the presence of any undisclosed deviations of the preregistration. Deviations from the preregistration are possible and common in practice, but they should be transparently reported, and the consequences for the severity of the test should be evaluated. 211:(NLM) was the first online registry for clinical trials, and remains the largest and most widely used. In addition to combating bias, clinical trial registries serve to increase transparency and access to clinical trials for the public. Clinical trials registries are often searchable (e.g. by disease/indication, drug, location, etc.). Trials are registered by the pharmaceutical, biotech or medical device company (Sponsor) or by the hospital or foundation which is sponsoring the study, or by another organization, such as a 232:
international and written about for over 50 years. One of the proposals to address this potential bias was a comprehensive register of initiated clinical trials that would inform the public which trials had been started. Ethical issues were those that seemed to interest the public most, as trialists (including those with potential commercial gain) benefited from those who enrolled in trials, but were not required to “give back,” telling the public what they had learned.
3989: 731:). The most frequent deviations were with regards to the planned sample size, exclusion criteria, and statistical model. Hence, what were intended as preregistered confirmatory tests ended up as unplanned exploratory tests. Again, preregistration advocates argue that deviations from preregistered plans are acceptable as long as they are reported transparently and justified. They also point out that even vague preregistrations help to reduce 413:
biomedical research relies on animal experiments. The non-publication of results gained from animal experiments not only distorts the state of research by reinforcing the publication bias, it further represents an ethical issue. Preregistration is discussed as a measure that could counteract this problem. Following registries are suited for the preregistration of preclinical studies.
723:). For example, pre-registered studies are only of higher quality than non-pre registered studies in that the former does has a power analysis and higher sample size than the latter but other than that they do not seem to prevent p-hacking and HARKing, as both the proportion of positive results and effect sizes are similar between preregistered and non-preregistered studies ( 592:). In response, preregistration advocates have stressed that exploratory analyses are permitted in preregistered studies, and that the results of these analyses retain some value vis-a-vis hypothesis generation rather than hypothesis testing. Preregistration merely makes the distinction between confirmatory and exploratory research clearer ( 612:). However, critics counterargue that, if preregistration is only supposed to be a plan, and not a prison, then researchers should feel free to deviate from that plan and undertake exploratory analyses without fearing accusations of low research credibility due to circular reasoning and inappropriate research practices such as 539:
concepts and students felt that they understood their dissertation and it improved the clarity of the manuscript writing, promoted rigour and were more likely to avoid questionable research practices. In addition, it becomes a tool that can supervisors can use to shape students to combat any questionable research practices.
264:(ICMJE) announced that their journals would not publish reports of trials unless they had been registered. The ICMJE action was probably the most important motivator for trial registration, as investigators wanted to reserve the possibility that they could publish their results in prestigious journals, should they want to. 584:). Circular reasoning can be identified by analysing the reasoning per se without needing to know whether that reasoning was preregistered. Critics have also noted that the idea that preregistration improves research credibility may deter researchers from undertaking non-preregistered exploratory analyses ( 535:). The primary goal of preregistration is to improve the transparency of reported hypothesis tests, which allows readers to evaluate the extent to which decisions during the data analysis were pre-planned (maintaining statistical error control) or data-driven (increasing the Type 1 or Type 2 error rate). 538:
Meta-scientific research has revealed additional benefits. Researchers indicate preregistering a study leads to a more carefully thought through research hypothesis, experimental design, and statistical analysis. In addition, preregistration has been shown to encourage better learning of Open Science
235:
Those who were particularly concerned by the double standard were systematic reviewers, those who summarize what is known from clinical trials. If the literature is skewed, then the results of a systematic review are also likely to be skewed, possibly favoring the test intervention when in fact the
231:
For many years, scientists and others have worried about reporting biases such that negative or null results from initiated clinical trials may be less likely to be published than positive results, thus skewing the literature and our understanding of how well interventions work. This worry has been
81:
In the standard preregistration format, researchers prepare a research protocol document prior to conducting their research. Ideally, this document indicates the research hypotheses, sampling procedure, sample size, research design, testing conditions, stimuli, measures, data coding and aggregation
503:
defines this format: “In a registered report, authors create a study proposal that includes theoretical and empirical background, research questions/hypotheses, and pilot data (if available). Upon submission, this proposal will then be reviewed prior to data collection, and if accepted, the paper
305:. WHO states that the international registry's mission is "to ensure that a complete view of research is accessible to all those involved in health care decision making. This will improve research transparency and will ultimately strengthen the validity and value of the scientific evidence base." 755:
changes that have led up to the current method and analyses” (pp. 378–379). In addition, pre-registering a study requires careful deliberation about the study's hypotheses, research design and statistical analyses. This depends on the use of pre-registration templates that provides detailed
98:
The registered report format requires authors to submit a description of the study methods and analyses prior to data collection. Once the theoretical introduction, method, and analysis plan has been peer reviewed (Stage 1 peer review), publication of the findings is provisionally guaranteed (in
412:
Similar to clinical research, preregistration can help to improve transparency and quality of research data in preclinical research. In contrast to clinical research where preregistration is mandatory for vast parts it is still new in preclinical research. A large part of preclinical and basic
507:
Note that only a very small proportion of academic journals in psychology and neurosciences explicitly stated that they welcome submissions of replication studies in their aim and scope or instructions to authors. This phenomenon does not encourage the reporting or even attempt on replication
3139:
Pownall, Madeleine; Pennington, Charlotte R.; Norris, Emma; Juanchich, Marie; Smailes, David; Russell, Sophie; Gooch, Debbie; Evans, Thomas Rhys; Persson, Sofia; Mak, Matthew H. C.; Tzavella, Loukia; Monk, Rebecca; Gough, Thomas; Benwell, Christopher S. Y.; Elsherif, Mahmoud (October 2023).
246:(Food and Drug Administration Modernization Act of 1997. Pub L No. 105-115, §113 Stat 2296), but the law provided neither funding nor a mechanism of enforcement. In addition, the law required that ClinicalTrials.gov only include trials of serious and life-threatening diseases. 3423: 609: 795:
for inconclusive evidence), although it is unclear whether this represents a "false" sense of credibility due to pre-existing positive community attitudes about preregistration or a genuine causal effect of registered reports on quality of research.
4316:
Akker, Olmo R. van den; Weston, Sara; Campbell, Lorne; Chopik, Bill; Damian, Rodica; Davis-Kean, Pamela; Hall, Andrew; Kosie, Jessica; Kruse, Elliott; Olsen, Jerome; Ritchie, Stuart; Valentine, K. D.; Veer, Anna van 't; Bakker, Marjan (2021-11-09).
3054:
Toth, Allison A.; Banks, George C.; Mellor, David; O’Boyle, Ernest H.; Dickson, Ashleigh; Davis, Daniel J.; DeHaven, Alex; Bochantin, Jaime; Borns, Jared (1 August 2021). "Study Preregistration: An Evaluation of a Method for Transparent Reporting".
1912:
International Collaborative Group on Clinical Trial Registries (1993). "Position paper and consensus recommendations on clinical trial registries. Ad Hoc Working Party of the International Collaborative Group on Clinical Trials Registries".
272: 312:
ICMJE accepts all primary registries in the WHO network in addition to clinicaltrials.gov. Clinical trial registration in other registries excluding ClinicalTrials.gov has increased irrespective of study designs since 2014.
309: 283: 218:
There has been a push from governments and international organizations, especially since 2005, to make clinical trial information more widely available and to standardize registries and processes of registering. The
918:
Parsons, Sam; Azevedo, Flávio; Elsherif, Mahmoud M.; Guay, Samuel; Shahim, Owen N.; Govaart, Gisela H.; Norris, Emma; O’Mahony, Aoife; Parker, Adam J.; Todorovic, Ana; Pennington, Charlotte R. (2022-02-21).
82:
method, criteria for data exclusions, and statistical analyses, including potential variations on those analyses. This preregistration document is then posted on a publicly available website such as the
200:. Registration of clinical trials is required in some countries and is increasingly being standardized. Some top medical journals will only publish the results of trials that have been pre-registered. 64:
increase the probability of incorrect claims. Although the idea is old, the practice of preregistering studies has gained prominence to mitigate to some of the issues that are thought to underlie the
1448:
Akker, Olmo R. van den; Weston, Sara; Campbell, Lorne; Chopik, Bill; Damian, Rodica; Davis-Kean, Pamela; Hall, Andrew; Kosie, Jessica; Kruse, Elliott; Olsen, Jerome; Ritchie, Stuart (2021-11-09).
487:
also noted that the editorial staff will be asking for replication of studies with surprising findings from examinations using small sample sizes before allowing the manuscripts to be published.
3897:
Singh, B.; Fairman, C. M.; Christensen, J. F.; Bolam, K. A.; Twomey, R.; Nunan, D.; Lahart, I. M. (2021). "Outcome reporting bias in exercise oncology trials (OREO): A cross-sectional study".
294:. There has also been action from the pharmaceutical industry, which released plans to make clinical trial data more transparent and publicly available. Released in October 2008, the revised 771:
Finally, some commentators have argued that, under some circumstances, preregistration may actually harm science by providing a false sense of credibility to research studies and analyses (
660:), and that concerns about inflated familywise error rates are unjustified when those error rates refer to abstract, atheoretical studywise hypotheses that are not being tested (Rubin, 548:
preregistration in economics journals found that preregistration did not reduce p-hacking and publication bias, unless the preregistration was accompanied by a preanalysis plan.
1155:
Scheel, Anne M.; Schijen, Mitchell R. M. J.; Lakens, Daniël (April 2021). "An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports".
2126:
Banno, M; Tsujimoto, Y; Kataoka, Y (2019). "Studies registered in non-ClinicalTrials.gov accounted for an increasing proportion of protocol registrations in medical research".
495:
has adopted the registered report format, as it “shift the emphasis from the results of research to the questions that guide the research and the methods used to answer them”.
268: 271:(FDAAA) clarified the requirements for registration and also set penalties for non-compliance (Public Law 110-85. The Food and Drug Administration Amendments Act of 2007 261: 2549:"Publication rates in animal research. Extent and characteristics of published and non-published animal studies followed up at two German university medical centres" 787:). Consistent with this view, there is some evidence that researchers view registered reports as being more credible than standard reports on a range of dimensions ( 291: 1669:
Bert, Bettina; Heinl, Céline; Chmielewska, Justyna; Schwarz, Franziska; Grune, Barbara; Hensel, Andreas; Greiner, Matthias; Schönfelder, Gilbert (2019-10-15).
44:
Preregistration has the goal to allow others to transparently evaluate the capacity of a test to falsify a prediction. A number of research practices such as
3820:
Bakker, M.; Veldkamp, C. L. S.; van Assen, M. A. L. M.; Crompvoets, E. A. V.; Ong, H. H.; Nosek, B.; Soderberg, C. K.; Mellor, D.; Wicherts, J. M. (2020).
2316:"Clinical trial registration, reporting, publication and FDAAA compliance: a cross-sectional analysis and ranking of new drugs approved by the FDA in 2012" 544: 648:). Finally, and more fundamentally, critics have argued that the distinction between confirmatory and exploratory analyses is unclear and/or irrelevant ( 208: 3273:"Do Preregistration and Preanalysis Plans Reduce p -Hacking and Publication Bias? Evidence from 15,992 Test Statistics and Suggestions for Improvement" 249:
Then, two events occurred in 2004 that increased public awareness of the problems of reporting bias. First, the then-New York State Attorney General
4226:
Bowman, Sara D.; Dehaven, Alexander Carl; Errington, Timothy M.; Hardwicke, Tom Elis; Mellor, David Thomas; Nosek, Brian A.; Soderberg, Courtney K.
739:). However, critics have argued that it is not useful to identify or justify deviations from preregistered plans when those plans do not reflect 335:
Worldwide, there is growing number of registries. A 2013 study identified the following top five registries (numbers updated as of August 2013):
286:(ICMJE) decided that from July 1, 2005 no trials will be considered for publication unless they are included on a clinical trials registry. The 580:, p. 2600). However, critics have argued that preregistration is not necessary to identify circular reasoning during exploratory analyses ( 3188: 4583:
Soderberg, C. K.; Errington, T. M.; Schiavone, S R.; Bottesini, J.; Singleton Thorn, F.; Vazire, S.; Esterling, K. M.; Nosek, B. A. (2020).
2018: 3950:
van den Akker, Olmo R.; van Assen, Marcel A. L. M.; Bakker, Marjan; Elsherif, Mahmoud; Wong, Tsz Keung; Wicherts, Jelte M. (2023-11-10).
2384:"Evaluating adherence to the International Committee of Medical Journal Editors' policy of mandatory, timely clinical trial registration" 1877:
Sterling, TD (1959). "Publication decisions and their possible effects on inferences drawn from tests of significances – or vice versa".
3206:"Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor's perceived attitudes" 2364: 1583:"Making the black box transparent: A template and tutorial for (pre-)registration of studies using experience sampling methods (ESM)" 727:). In addition, in a survey of 27 preregistered studies found that researchers deviated from their preregistered plans in all cases ( 675:
There are also concerns about the practical implementation of preregistration. Many preregistered protocols leave plenty of room for
4683: 330: 4402:"Preregistration is not a panacea, but why? A rejoinder to Chen & Li's (2024) "infusing preregistration into tourism research"" 321:
Various studies have measured the extent to which various trials are in compliance with the reporting standards of their registry.
298:, states that "Every clinical trial must be registered in a publicly accessible database before recruitment of the first subject." 2547:
Wieschowski, Susanne; Biernot, Svenja; Deutsch, Susanne; Glage, Silke; Bleich, André; Tolba, René; Strech, Daniel (2019-11-26).
1812: 2825: 1128:
Nosek, Brian A.; Lakens, Daniël (1 May 2014). "Registered Reports: A Method to Increase the Credibility of Published Results".
499: 479: 4189:"Pre-registration is a game changer. But, like random assignment, it is neither necessary nor sufficient for credible science" 3923:"Preregistration specificity & adherence: A review of preregistered gambling studies & cross-disciplinary comparison" 2433:"Animal Study Registries: Results from a Stakeholder Analysis on Potential Strengths, Weaknesses, Facilitators, and Barriers" 212: 2169:
Anderson, Monique L.; Chiswell, Karen; Peterson, Eric D.; Tasneem, Asba; Topping, James; Califf, Robert M. (12 March 2015).
628:). Again, they have pointed out that preregistration is not necessary to address such concerns. For example, concerns about 1940:
Dickersin, K; Rennie, D (2012). "The evolution of trial registries and their use to assess the clinical trial enterprise".
4136:
Sun, L. W.; Lee, D. J.; Collins, J. A.; Carll, T. C.; Ramahi, K.; Sandy, S. J.; Unteriner, J. G.; Weinberg, D. V. (2019).
732: 605: 243: 242:
was originally developed largely as a result of breast cancer consumer lobbying, which led to authorizing language in the
617: 223:
is working toward "achieving consensus on both the minimal and the optimal operating standards for trial registration".
2614:
Naald, Mira van der; Wenker, Steven; Doevendans, Pieter A.; Wever, Kimberley E.; Chamuleau, Steven A. J. (2020-08-01).
3638: 1757: 810: 2062: 3029: 1993: 1728: 576:
analyses because they may involve "circular reasoning" in which post hoc hypotheses are based on the observed data (
524: 3773:"When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing" 1233:
Bosnjak, M.; Fiebach, C. J.; Mellor, D.; Mueller, S.; O’Connor, D. B.; Oswald, F. L.; Sokol-Chang, R. I. (2021). .
257:(GSK) because they had failed to reveal results from trials showing that certain antidepressants might be harmful. 556:
Proponents of preregistration have argued that it is "a method to increase the credibility of published results" (
33:
is the practice of registering the hypotheses, methods, or analyses of a scientific study before it is conducted.
1095: 287: 220: 483:
has encouraged the preregistration of studies and the reporting of effect sizes and confidence intervals. The
512: 295: 720: 107:
Preregistration can be used in relation to a variety of different research designs and methods, including:
2220:"Compliance with legal requirement to report clinical trial results on ClinicalTrials.gov: a cohort study" 621: 491: 83: 3724:
Szollosi, A.; Kellen, D.; Navarro, D. J.; Shiffrin, R.; van Rooji, I.; Van Zandt, T.; Donkin, C. (2020).
2219: 4678: 4608: 4464: 3952:"Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology" 3694: 3473: 1270: 1005:
Lakens, Daniël (2019). "The value of preregistration for psychological science: A conceptual analysis".
471:), and the number of journals that are adopting registered reports is approximately doubling each year ( 424: 4526:"The effect of preregistration on trust in empirical research findings: Results of a registered report" 4524:
Field, S. M.; Wagenmakers, E. J.; Kiers, H. A.; Hoekstra, R.; Ernst, A.F.; van Ravenzwaaij, D. (2020).
3921:
Heirene, R.; LaPlante, D.; Louderback, E. R.; Keen, B.; Bakker, M.; Serafimovska, A.; Gainsbury, S. M.
3082:
Sarafoglou, Alexandra; Kovacs, Marton; Bakos, Bence; Wagenmakers, Eric-Jan; Aczel, Balazs (July 2022).
3679:"Arrested theory development: The misguided distinction between exploratory and confirmatory research" 4673: 4663: 4537: 3898: 3217: 3142:"Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation" 3095: 2560: 864: 761: 119: 4008: 2673:"Registered Reports: Peer review before results are known to align scientific values and practices" 680: 169: 162: 2063:"WHO facilitates international collaboration in setting standards for clinical trial registration" 636:
practices, such as (a) open data and research materials and (b) robustness or multiverse analyses
504:
resulting from this peer-reviewed procedure will be published, regardless of the study outcomes.”
41:
include the peer review and in principle acceptance of a study protocol prior to data collection.
37:
is similar, although it may not require the registration of a study's analysis protocol. Finally,
4596: 4452: 4401: 4318: 4243: 4208: 4077: 3802: 3784: 3753: 3659: 3616: 3540: 3520: 3461: 3404: 3365: 3010: 2807: 2717: 2247: 2151: 2090: 1894: 1859: 1600: 1512: 1449: 1379: 1258: 966: 900: 716: 692: 589: 239: 204: 65: 4097:"Adherence to guidance on registration of randomised controlled trials published in Anaesthesia" 2022: 2019:"WMA Declaration of Helsinki - Ethical Principles for Medical Research Involving Human Subjects" 699:), and researchers rarely follow the exact research methods and analyses that they preregister ( 784: 724: 696: 669: 665: 4668: 4565: 4421: 4379: 4359: 4340: 4298: 4290: 4169: 4118: 4069: 3977: 3969: 3903: 3853: 3745: 3581: 3288: 3253: 3235: 3184: 3161: 3121: 3002: 2939: 2921: 2880: 2862: 2766: 2758: 2709: 2653: 2635: 2596: 2578: 2529: 2511: 2472: 2454: 2413: 2345: 2296: 2239: 2200: 2143: 2082: 1957: 1922: 1851: 1787: 1710: 1692: 1651: 1563: 1471: 1430: 1371: 1320: 1250: 1215: 1049: 958: 950: 892: 57: 3872: 3084:"A survey on how preregistration affects the research workflow: better science but more work" 772: 688: 649: 597: 557: 4588: 4555: 4545: 4504: 4444: 4413: 4371: 4330: 4280: 4235: 4200: 4159: 4149: 4138:"Assessment of consistency between peer-reviewed publications and clinical trial registries" 4108: 4059: 4049: 3959: 3843: 3833: 3794: 3737: 3682: 3649: 3608: 3571: 3530: 3453: 3396: 3355: 3322: 3280: 3243: 3225: 3153: 3141: 3111: 3103: 3064: 2994: 2929: 2911: 2870: 2852: 2797: 2748: 2699: 2643: 2627: 2586: 2568: 2519: 2503: 2462: 2444: 2403: 2395: 2335: 2327: 2286: 2278: 2231: 2190: 2182: 2135: 2074: 1949: 1886: 1843: 1700: 1682: 1641: 1631: 1590: 1553: 1543: 1502: 1461: 1420: 1410: 1361: 1351: 1310: 1242: 1205: 1195: 1164: 1137: 1110: 1076: 1041: 1014: 984: 940: 932: 882: 872: 193: 49: 641: 601: 532: 141: 130: 4621: 4477: 3993: 3988: 3707: 3486: 2981:
Wagenmakers, E. J.; Wetzels, R.; Borsboom, D.; van der Maas, H. L.; Kievit, R. A. (2012).
1283: 484: 254: 197: 744: 661: 653: 637: 632:-hacking and unreported multiple testing can be addressed if researchers engage in other 593: 581: 577: 565: 528: 4541: 3992: This article incorporates text from this source, which is available under the 3221: 3099: 2688:"Science in flux: Registered Reports and beyond at the European Journal of Neuroscience" 2564: 868: 4560: 4525: 4164: 4137: 4064: 4037: 3848: 3821: 3272: 3248: 3205: 3116: 3083: 2934: 2899: 2875: 2840: 2648: 2591: 2548: 2524: 2491: 2467: 2432: 2408: 2383: 2340: 2315: 2291: 2266: 2195: 2170: 1705: 1670: 1646: 1619: 1581:
Kirtley, O. J.; Lafit, G.; Achterhof, R.; Hiekkaranta, A. P.; Myin-Germeys, I. (2019).
1425: 1398: 1366: 1339: 1210: 1183: 887: 852: 515:, which maintains a list of journals encouraging the submission of registered reports. 185: 2235: 2078: 1820: 1399:"Recommendations for increasing the transparency of analysis of preexisting data sets" 560:), that it "makes your science better by increasing the credibility of your results" ( 4657: 4600: 4456: 4247: 4212: 4154: 4081: 3806: 3757: 3663: 3544: 3465: 3408: 2251: 2155: 1604: 1558: 1516: 1383: 1262: 970: 920: 776: 765: 757: 728: 704: 657: 625: 564:), and that it "improves the interpretability and credibility of research findings" ( 250: 155: 134: 112: 53: 3620: 3369: 3344:"Pre-analysis plans have limited upside, especially where replications are feasible" 3181:
A student's guide to open science: using the replication crisis to reform psychology
2811: 2721: 2094: 1863: 1620:"Preregistration of exploratory research: Learning from the golden age of discovery" 203:
A clinical trials registry is a platform which catalogs registered clinical trials.
3014: 2139: 1890: 904: 820: 633: 4585:"Research Quality of registered reports compared to the standard publishing model" 4417: 4285: 4268: 2615: 1315: 1298: 700: 608:
during the data analysis stage, it is also supposed to be “a plan, not a prison” (
3838: 3230: 2573: 2449: 1687: 1636: 1200: 1114: 585: 511:
Overall, the number of participating journals is increasing, as indicated by the
3400: 3327: 3310: 2399: 2331: 1141: 1067:
Lakens, Daniël (14 May 2024). "When and How to Deviate From a Preregistration".
815: 3964: 3951: 3798: 3741: 3311:"Registered reports: A method to increase the credibility of published results" 3068: 3030:"The value of preregistration for psychological science: A conceptual analysis" 1758:"WHO | Working Group on Best Practice for Clinical Trials Registers (BPG)" 936: 712: 3654: 3384: 3271:
Brodeur, Abel; Cook, Nikolai M.; Hartley, Jonathan S.; Heyes, Anthony (2024).
3157: 2631: 1168: 290:
has begun the push for clinical trial registration with the initiation of the
4425: 4383: 4344: 4294: 4036:
Claesen, A.; Gomes, S.; Tuerlinckx, F.; Vanpaemel, W.; Leuven, K. U. (2019).
3973: 3772: 3725: 3576: 3559: 3292: 3239: 3165: 2998: 2925: 2916: 2900:"Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices" 2866: 2857: 2762: 2753: 2736: 2639: 2582: 2515: 2458: 1696: 1507: 1490: 1475: 1415: 954: 780: 736: 472: 4592: 4448: 4239: 4054: 3686: 3612: 3535: 3508: 3457: 2802: 2785: 1765: 1595: 1582: 1548: 1531: 1246: 1080: 877: 805: 301:
The World Health Organization maintains an international registry portal at
45: 4584: 4569: 4302: 4173: 4122: 4073: 3981: 3857: 3749: 3585: 3257: 3125: 3006: 2982: 2943: 2884: 2770: 2713: 2657: 2600: 2533: 2476: 2417: 2349: 2243: 2204: 2147: 2086: 1961: 1953: 1926: 1855: 1847: 1714: 1655: 1567: 1434: 1375: 1324: 1254: 1219: 1032:
Bakan, David (1966). "The test of significance in psychological research".
1018: 962: 896: 788: 17: 4335: 2300: 2282: 2186: 1813:"WHO - Working Group on Best Practice for Clinical Trials Registers (BPG)" 1736: 1466: 1053: 4644:
Guidelines for creating registered reports by the Center for Open Science
1997: 792: 4638: 4550: 4440: 3600: 3360: 3343: 3107: 2043: 561: 523:
Several articles have outlined the rationale for preregistration (e.g.,
4113: 4096: 3637:
Devezer, B.; Navarro, D. J.; Vandekerckhove, J.; Buzbas, E. O. (2020).
1898: 1184:"Open science challenges, benefits and tips in early career and beyond" 572:
analyses are less "credible" and/or "interpretable" than preregistered
126: 61: 4509: 4493:"Preregistration is neither sufficient nor necessary for good science" 4492: 4375: 4204: 3678: 3449: 2841:"Do Neuroscience Journals Accept Replications? A Survey of Literature" 2826:"Streamlined review and registered reports soon to be official at EJP" 2704: 2687: 2616:"Publication rate in preclinical research: a plea for preregistration" 1994:"ICMJE: Frequently Asked Questions about Clinical Trials Registration" 1532:"Making ERP research more transparent: Guidelines for preregistration" 945: 4319:"Preregistration of secondary data analysis: A template and tutorial" 2507: 1450:"Preregistration of secondary data analysis: A template and tutorial" 1045: 851:
Nosek, B. A.; Ebersole, C. R.; DeHaven, A. C.; Mellor, D. T. (2018).
4188: 3601:"Sound inference in complicated research: A multi-strategy approach" 3509:"Does preregistration improve the credibility of research findings?" 2431:
Wieschowski, Susanne; Silva, Diego S.; Strech, Daniel (2016-11-10).
2314:
Miller, Jennifer E; Korn, David; Ross, Joseph S (12 November 2015).
3789: 3525: 3284: 1356: 302: 4095:
Boghdadly, K. El.; Wiles, M. D.; Atton, S.; Bailey, C. R. (2018).
747:
explained, “we should be more interested in the rationale for the
236:
accumulated data do not show this, if all data were made public.
2108: 454: 3558:
Steegen, S.; Tuerlinckx, F.; Gelman, A.; Vanpaemel, W. (2016).
2218:
DeVito, Nicholas J; Bacon, Seb; Goldacre, Ben (February 2020).
1834:
Dickersin, K; Rennie, D (2009). "Registering clinical trials".
4009:"Research registries: Facts, myths, and possible improvements" 2957: 2365:"As ClinicalTrialsgov Turns 10 Will We See Compliance Improve" 645: 568:, p. 2605). This argument assumes that non-preregistered 148: 3922: 708: 684: 3873:"Questionable research practices following pre-registration" 3304: 3302: 2976: 2974: 1975: 4648: 4267:
L. Haven, Tamarinde; Van Grootel, Dr. Leonie (2019-04-03).
1096:"Registered Reports: A new publishing initiative at Cortex" 434: 87: 4639:
Preregistration resources from the Centre for Open Science
3822:"Ensuring the quality and specificity of preregistrations" 3146:
Advances in Methods and Practices in Psychological Science
2686:
Chambers, C. D.; Forstmann, B.; Pruszynski, J. A. (2019).
1403:
Advances in Methods and Practices in Psychological Science
1157:
Advances in Methods and Practices in Psychological Science
3871:
Ikeda, A.; Xu, H.; Fuji, N.; Zhu, S.; Yamada, Y. (2019).
3719: 3717: 2171:"Compliance with Results Reporting at ClinicalTrials.gov" 2109:"International Clinical Trials Registry Platform (ICTRP)" 2061:
GĂĽlmezoglu, AM; Pang, T; Horton, R; Dickersin, K (2005).
1729:"International Clinical Trials Registry Platform (ICTRP)" 444: 4227: 4031: 4029: 3916: 3914: 3632: 3630: 921:"A community-sourced glossary of open scholarship terms" 604:). Hence, although preregistraton is supposed to reduce 4358:
Fischer, Eileen; Guzel, Gulay Taltekin (January 2023).
3560:"Increasing transparency through a multiverse analysis" 3450:"Paths in strange spaces: A comment on preregistration" 2388:
Journal of the American Medical Informatics Association
3892: 3890: 3639:"The case for formal methodology in scientific reform" 1788:"Major Journals Press for Clinical Trial Registration" 1182:
Allen, Christopher; Mehler, David M. A. (1 May 2019).
4643: 4187:
Simmons, J. P.; Nelson, L. D.; Simonsohn, U. (2021).
2672: 2490:
Kimmelman, Jonathan; Anderson, James A. (June 2012).
1671:"Refining animal research: The Animal Study Registry" 1397:
Weston, S. J.; Ritchie, S. J.; Rohrer, J. M. (2019).
846: 844: 842: 840: 838: 836: 468: 467:
Over 200 journals offer a registered reports option (
3389:
Organizational Behavior and Human Decision Processes
3383:Collins, H.K.; Whillans, A. V.; John, L. K (2021). 2786:"Promoting reproducibility with registered reports" 269:
Food and Drug Administration Amendments Act of 2007
3204:Krishna, Anand; Peter, Sebastian M. (2018-08-30). 310:International Committee of Medical Journal Editors 284:International Committee of Medical Journal Editors 262:International Committee of Medical Journal Editors 1340:"Preregistration of analyses of preexisting data" 4400:Souza-Neto, ValĂ©rio; Moyle, Brent (2025-04-01). 1530:Paul, M.; Govaart, G. H.; Schettino, A. (2021). 1491:"Preregistration in single-case design research" 3502: 3500: 3498: 3496: 857:Proceedings of the National Academy of Sciences 735:and make any residual flexibility transparent ( 292:International Clinical Trials Registry Platform 4007:Abrams, E.; Libgober, J.; List, J. A. (2020). 2265:Pullar, T; Kumar, S; Feely, M (October 1989). 751:method and analyses than in the rationale for 4038:"Preregistration: Comparing dream to reality" 8: 2983:"An agenda for purely confirmatory research" 545:Journal of Political Economy: Microeconomics 3277:Journal of Political Economy Microeconomics 2492:"Should preclinical studies be registered?" 2898:Martin, G. N.; Clarke, Richard M. (2017). 209:United States National Library of Medicine 4559: 4549: 4508: 4334: 4284: 4163: 4153: 4112: 4063: 4053: 3963: 3902: 3847: 3837: 3788: 3653: 3575: 3534: 3524: 3359: 3326: 3247: 3229: 3115: 2933: 2915: 2874: 2856: 2801: 2752: 2703: 2647: 2590: 2572: 2523: 2466: 2448: 2407: 2339: 2290: 2194: 1704: 1686: 1645: 1635: 1594: 1557: 1547: 1536:International Journal of Psychophysiology 1506: 1465: 1424: 1414: 1365: 1355: 1314: 1297:Haven, T. L.; Van Grootel, D. L. (2019). 1209: 1199: 944: 886: 876: 741:high quality theory and research practice 4441:"What should a preregistration contain?" 415: 408:Overview of preclinical study registries 337: 3513:The Quantitative Methods for Psychology 3424:"Preregistration: A plan, not a prison" 1094:Chambers, Christopher D. (March 2013). 987:. Association for Psychological Science 832: 4617: 4606: 4473: 4462: 3703: 3692: 3482: 3471: 2737:"Replication in Psychological Science" 1786:Barrett, Stephen (13 September 2004). 1279: 1268: 4395: 4393: 4269:"Preregistering qualitative research" 3945: 3943: 3564:Perspectives on Psychological Science 3385:"Joy and rigor in behavioral science" 3342:Coffman, L. C.; Niederle, M. (2015). 3183:. Maidenhead: Open University Press. 2987:Perspectives on Psychological Science 1338:Mertens, G.; Krypotos, A. M. (2019). 1299:"Preregistering qualitative research" 756:guidance on what to include and why ( 325:Overview of clinical trial registries 111:Quantitative research in psychology ( 7: 1489:Johnson, A. H.; Cook, B. G. (2019). 644:; for several other approaches, see 4360:"The case for qualitative research" 3057:Journal of Business and Psychology 2735:Lindsay, D. Stephen (2015-11-09). 396:Australia and New Zealand (ANZCTR) 215:(CRO) which is running the study. 25: 3677:Szollosi, A.; Donkin, C. (2019). 3309:Nosek, B. A.; Lakens, D. (2014). 3179:Pennington, Charlotte R. (2023). 2382:Huser, V.; Cimino, J. J. (2013). 331:List of clinical trial registries 4155:10.1001/jamaophthalmol.2019.0312 3987: 3726:"Is preregistration worthwhile?" 3348:Journal of Economic Perspectives 2692:European Journal of Neuroscience 2271:Annals of the Rheumatic Diseases 2128:Journal of Clinical Epidemiology 985:"Registered Replication Reports" 853:"The preregistration revolution" 303:http://apps.who.int/trialsearch/ 4491:Pham, M. T.; Oh, T. T. (2020). 2845:Frontiers in Human Neuroscience 2267:"Compliance in clinical trials" 2175:New England Journal of Medicine 500:European Journal of Personality 370:Japan registries network (JPRN) 188:before they are performed in a 184:is the practice of documenting 147:Electroencephalogram research ( 4497:Journal of Consumer Psychology 4364:Journal of Consumer Psychology 4193:Journal of Consumer Psychology 2140:10.1016/j.jclinepi.2019.09.005 1891:10.1080/01621459.1959.10501497 213:contract research organization 1: 4418:10.1016/j.tourman.2024.105061 4286:10.1080/08989621.2019.1580147 3877:Japanese Psychological Review 3037:Japanese Psychological Review 2958:"Registered Reports Overview" 2363:Miseta, Ed (9 January 2018). 2236:10.1016/S0140-6736(19)33220-9 2079:10.1016/s0140-6736(05)66589-0 1316:10.1080/08989621.2019.1580147 1007:Japanese Psychological Review 762:Haven & Van Grootel, 2019 733:researcher degrees of freedom 606:researcher degrees of freedom 590:Collins et al., 2021, Study 1 469:Centre for Open Science, 2019 244:FDA Modernization Act of 1997 127:Mertens & Krypotosm, 2019 120:Haven & Van Grootel, 2019 3839:10.1371/journal.pbio.3000937 3730:Trends in Cognitive Sciences 3231:10.1371/journal.pone.0203470 2574:10.1371/journal.pone.0223758 2450:10.1371/journal.pbio.2000391 1688:10.1371/journal.pbio.3000463 1637:10.1371/journal.pbio.3000690 1201:10.1371/journal.pbio.3000246 1115:10.1016/j.cortex.2012.12.016 737:Simmons et al., 2021, p. 180 586:Coffman & Niederle, 2015 3904:10.1101/2021.03.12.21253378 3401:10.1016/j.obhdp.2021.03.002 2400:10.1136/amiajnl-2012-001501 2332:10.1136/bmjopen-2015-009758 811:Clinical trial registration 658:Szollosi & Donkin, 2019 278:International participation 182:Clinical trial registration 177:Clinical trial registration 103:Specialised preregistration 35:Clinical trial registration 4700: 4530:Royal Society Open Science 4273:Accountability in Research 4042:Royal Society Open Science 3965:10.3758/s13428-023-02277-0 3799:10.1007/s11229-021-03276-4 3742:10.1016/j.tics.2019.11.009 3088:Royal Society Open Science 3069:10.1007/s10869-020-09695-3 2839:Yeung, Andy W. K. (2017). 1303:Accountability in Research 937:10.1038/s41562-021-01269-4 766:Van den Akker et al., 2021 725:Van den Akker et al., 2023 697:Van den Akker et al., 2023 328: 135:van den Akker et al., 2021 3956:Behavior Research Methods 3655:10.1101/2020.04.26.048306 3328:10.1027/1864-9335/a000192 3158:10.1177/25152459231202724 2960:. Center for Open Science 2671:Centre for Open Science. 2632:10.1136/bmjos-2019-100051 2113:World Health Organization 1559:21.11116/0000-0008-2B30-2 1235:The American Psychologist 1169:10.1177/25152459211007467 1142:10.1027/1864-9335/a000192 288:World Health Organization 221:World Health Organization 56:, inappropriate forms of 4684:Evidence-based practices 3577:10.1177/1745691616658637 2999:10.1177/1745691612463078 2917:10.3389/fpsyg.2017.00523 2858:10.3389/fnhum.2017.00468 2754:10.1177/0956797615616374 1508:10.1177/0014402919868529 1416:10.1177/2515245919848684 616:-hacking and unreported 602:Wagenmakers et al., 2012 598:Nosek & Lakens, 2014 558:Nosek & Lakens, 2014 533:Wagenmakers et al., 2012 260:Shortly thereafter, the 227:Creation and development 190:clinical trials registry 142:Johnson & Cook, 2019 77:Standard preregistration 3599:Srivastava, S. (2018). 3536:10.20982/tqmp.16.4.p376 3428:Centre for Open Science 2904:Frontiers in Psychology 2803:10.1038/s41562-016-0034 1081:10.1525/collabra.117094 878:10.1073/pnas.1708274114 620:that leads to inflated 562:Centre for Open Science 513:Center for Open Science 425:Animalstudyregistry.org 296:Declaration of Helsinki 4616:Cite journal requires 4472:Cite journal requires 4439:McPhetres, J. (2020). 3702:Cite journal requires 3481:Cite journal requires 2790:Nature Human Behaviour 2369:www.clinicalleader.com 1954:10.1001/jama.2012.4230 1848:10.1001/jama.290.4.516 1823:on September 17, 2008. 1163:(2): 251524592110074. 1034:Psychological Bulletin 1019:10.24602/sjpr.62.3_221 925:Nature Human Behaviour 789:Soderberg et al., 2020 713:Boghdadly et al., 2018 622:familywise error rates 492:Nature Human Behaviour 161:Exploratory research ( 118:Qualitative research ( 84:Open Science Framework 4593:10.31222/osf.io/7x9vy 4449:10.31234/osf.io/cj5mh 4336:10.15626/MP.2020.2625 4240:10.31222/osf.io/epgjd 4055:10.31234/osf.io/d8wex 3687:10.31234/osf.io/suzej 3648:: 2020.04.26.048306. 3613:10.31234/osf.io/bwr48 3458:10.31234/osf.io/wxn58 2741:Psychological Science 2283:10.1136/ard.48.10.871 2187:10.1056/NEJMsa1409364 1596:10.31234/osf.io/seyq7 1549:10.31234/osf.io/4tgve 1467:10.15626/MP.2020.2625 1247:10.31234/osf.io/d7m5r 785:Szollosi et al., 2020 670:Szollosi et al., 2020 480:Psychological Science 473:Chambers et al., 2019 154:Experience sampling ( 140:Single case designs ( 3783:(3–4): 10969–11000. 3771:Rubin, Mark (2021). 3448:Navarro, D. (2020). 2496:Nature Biotechnology 1915:Clin Trials Metaanal 1618:Dirnagl, U. (2020). 1495:Exceptional Children 1344:Psychologica Belgica 1069:Collabra: Psychology 773:Devezer et al., 2020 729:Claesen et al., 2019 709:Heirene et al., 2021 705:Claesen et al., 2019 685:Heirene et al., 2021 650:Devezer et al., 2020 642:Steegen et al., 2016 542:A 2024 study in the 455:Preclinicaltrials.eu 317:Reporting compliance 156:Kirtley et al., 2019 113:Bosnjak et al., 2021 4551:10.1098/rsos.181351 4542:2020RSOS....781351F 4016:NBER Working Papers 3361:10.1257/jep.29.3.81 3222:2018PLoSO..1303470K 3108:10.1098/rsos.211997 3100:2022RSOS....911997S 3028:Lakens, D. (2019). 2784:Mellor, D. (2017). 2565:2019PLoSO..1423758W 2073:(9474): 1829–1831. 1768:on October 12, 2008 869:2018PNAS..115.2600N 781:Pham & Oh, 2020 758:Bowman et al., 2016 701:Abrams et al., 2020 681:Bakker et al., 2020 417: 198:selective reporting 131:Weston et al., 2019 27:Scientific practice 4406:Tourism Management 4142:JAMA Ophthalmology 4114:10.1111/anae.14103 3507:Rubin, M. (2020). 2828:. 6 February 2018. 2230:(10221): 361–369. 1976:"SANCTR > Home" 1792:www.quackwatch.org 793:Field et al., 2020 717:Singh et al., 2021 693:Singh et al., 2021 689:Ikeda et al., 2019 594:Nosek et al., 2018 578:Nosek et al., 2018 566:Nosek et al., 2018 529:Nosek et al., 2018 416: 344:ClinicalTrials.gov 240:ClinicalTrials.gov 205:ClinicalTrials.gov 125:Preexisting data ( 94:Registered reports 66:replication crisis 39:registered reports 4510:10.1002/jcpy.1209 4376:10.1002/jcpy.1300 4205:10.1002/jcpy.1207 3315:Social Psychology 3190:978-0-335-25116-2 2705:10.1111/ejn.14319 2181:(11): 1031–1039. 2048:www.anzctr.org.au 1980:www.sanctr.gov.za 1130:Social Psychology 863:(11): 2600–2606. 460: 459: 405: 404: 170:Bert et al., 2019 168:Animal Research ( 149:Paul et al., 2021 58:post hoc analysis 16:(Redirected from 4691: 4626: 4625: 4619: 4614: 4612: 4604: 4580: 4574: 4573: 4563: 4553: 4521: 4515: 4514: 4512: 4488: 4482: 4481: 4475: 4470: 4468: 4460: 4436: 4430: 4429: 4397: 4388: 4387: 4355: 4349: 4348: 4338: 4313: 4307: 4306: 4288: 4264: 4258: 4257: 4255: 4254: 4223: 4217: 4216: 4184: 4178: 4177: 4167: 4157: 4133: 4127: 4126: 4116: 4092: 4086: 4085: 4067: 4057: 4033: 4024: 4023: 4013: 4004: 3998: 3991: 3985: 3967: 3947: 3938: 3937: 3935: 3933: 3918: 3909: 3908: 3906: 3894: 3885: 3884: 3868: 3862: 3861: 3851: 3841: 3832:(12): e3000937. 3817: 3811: 3810: 3792: 3768: 3762: 3761: 3721: 3712: 3711: 3705: 3700: 3698: 3690: 3674: 3668: 3667: 3657: 3643: 3634: 3625: 3624: 3596: 3590: 3589: 3579: 3555: 3549: 3548: 3538: 3528: 3504: 3491: 3490: 3484: 3479: 3477: 3469: 3445: 3439: 3438: 3436: 3434: 3419: 3413: 3412: 3380: 3374: 3373: 3363: 3339: 3333: 3332: 3330: 3306: 3297: 3296: 3268: 3262: 3261: 3251: 3233: 3201: 3195: 3194: 3176: 3170: 3169: 3136: 3130: 3129: 3119: 3079: 3073: 3072: 3051: 3045: 3044: 3034: 3025: 3019: 3018: 2978: 2969: 2968: 2966: 2965: 2954: 2948: 2947: 2937: 2919: 2895: 2889: 2888: 2878: 2860: 2836: 2830: 2829: 2822: 2816: 2815: 2805: 2781: 2775: 2774: 2756: 2732: 2726: 2725: 2707: 2683: 2677: 2676: 2668: 2662: 2661: 2651: 2620:BMJ Open Science 2611: 2605: 2604: 2594: 2576: 2559:(11): e0223758. 2544: 2538: 2537: 2527: 2508:10.1038/nbt.2261 2487: 2481: 2480: 2470: 2452: 2443:(11): e2000391. 2428: 2422: 2421: 2411: 2379: 2373: 2372: 2360: 2354: 2353: 2343: 2311: 2305: 2304: 2294: 2262: 2256: 2255: 2215: 2209: 2208: 2198: 2166: 2160: 2159: 2123: 2117: 2116: 2105: 2099: 2098: 2058: 2052: 2051: 2040: 2034: 2033: 2031: 2030: 2021:. Archived from 2015: 2009: 2008: 2006: 2005: 1996:. Archived from 1990: 1984: 1983: 1972: 1966: 1965: 1937: 1931: 1930: 1921:(4–5): 255–266. 1909: 1903: 1902: 1874: 1868: 1867: 1831: 1825: 1824: 1819:. Archived from 1809: 1803: 1802: 1800: 1798: 1783: 1777: 1776: 1774: 1773: 1764:. Archived from 1754: 1748: 1747: 1745: 1744: 1739:on July 19, 2013 1735:. Archived from 1725: 1719: 1718: 1708: 1690: 1681:(10): e3000463. 1666: 1660: 1659: 1649: 1639: 1615: 1609: 1608: 1598: 1578: 1572: 1571: 1561: 1551: 1527: 1521: 1520: 1510: 1486: 1480: 1479: 1469: 1445: 1439: 1438: 1428: 1418: 1394: 1388: 1387: 1369: 1359: 1335: 1329: 1328: 1318: 1294: 1288: 1287: 1281: 1276: 1274: 1266: 1230: 1224: 1223: 1213: 1203: 1179: 1173: 1172: 1152: 1146: 1145: 1125: 1119: 1118: 1100: 1091: 1085: 1084: 1064: 1058: 1057: 1046:10.1037/h0020412 1029: 1023: 1022: 1002: 996: 995: 993: 992: 981: 975: 974: 948: 915: 909: 908: 890: 880: 848: 721:Sun et al., 2019 646:Srivastava, 2018 618:multiple testing 418: 338: 308:Since 2007, the 194:publication bias 192:so as to combat 50:publication bias 21: 4699: 4698: 4694: 4693: 4692: 4690: 4689: 4688: 4654: 4653: 4635: 4630: 4629: 4615: 4605: 4582: 4581: 4577: 4523: 4522: 4518: 4490: 4489: 4485: 4471: 4461: 4438: 4437: 4433: 4399: 4398: 4391: 4357: 4356: 4352: 4323:Meta-Psychology 4315: 4314: 4310: 4266: 4265: 4261: 4252: 4250: 4225: 4224: 4220: 4186: 4185: 4181: 4135: 4134: 4130: 4094: 4093: 4089: 4035: 4034: 4027: 4011: 4006: 4005: 4001: 3949: 3948: 3941: 3931: 3929: 3920: 3919: 3912: 3896: 3895: 3888: 3870: 3869: 3865: 3819: 3818: 3814: 3770: 3769: 3765: 3723: 3722: 3715: 3701: 3691: 3676: 3675: 3671: 3641: 3636: 3635: 3628: 3598: 3597: 3593: 3557: 3556: 3552: 3506: 3505: 3494: 3480: 3470: 3447: 3446: 3442: 3432: 3430: 3421: 3420: 3416: 3382: 3381: 3377: 3341: 3340: 3336: 3308: 3307: 3300: 3270: 3269: 3265: 3216:(8): e0203470. 3203: 3202: 3198: 3191: 3178: 3177: 3173: 3138: 3137: 3133: 3081: 3080: 3076: 3053: 3052: 3048: 3032: 3027: 3026: 3022: 2980: 2979: 2972: 2963: 2961: 2956: 2955: 2951: 2897: 2896: 2892: 2838: 2837: 2833: 2824: 2823: 2819: 2783: 2782: 2778: 2747:(12): 1827–32. 2734: 2733: 2729: 2685: 2684: 2680: 2670: 2669: 2665: 2613: 2612: 2608: 2546: 2545: 2541: 2489: 2488: 2484: 2430: 2429: 2425: 2394:(e1): e169–74. 2381: 2380: 2376: 2362: 2361: 2357: 2326:(11): e009758. 2313: 2312: 2308: 2264: 2263: 2259: 2217: 2216: 2212: 2168: 2167: 2163: 2125: 2124: 2120: 2107: 2106: 2102: 2060: 2059: 2055: 2042: 2041: 2037: 2028: 2026: 2017: 2016: 2012: 2003: 2001: 1992: 1991: 1987: 1974: 1973: 1969: 1939: 1938: 1934: 1911: 1910: 1906: 1879:J Am Stat Assoc 1876: 1875: 1871: 1833: 1832: 1828: 1811: 1810: 1806: 1796: 1794: 1785: 1784: 1780: 1771: 1769: 1756: 1755: 1751: 1742: 1740: 1727: 1726: 1722: 1668: 1667: 1663: 1630:(3): e3000690. 1617: 1616: 1612: 1580: 1579: 1575: 1529: 1528: 1524: 1488: 1487: 1483: 1454:Meta-Psychology 1447: 1446: 1442: 1396: 1395: 1391: 1337: 1336: 1332: 1296: 1295: 1291: 1277: 1267: 1232: 1231: 1227: 1194:(5): e3000246. 1181: 1180: 1176: 1154: 1153: 1149: 1127: 1126: 1122: 1098: 1093: 1092: 1088: 1066: 1065: 1061: 1031: 1030: 1026: 1004: 1003: 999: 990: 988: 983: 982: 978: 917: 916: 912: 850: 849: 834: 829: 802: 777:McPhetres, 2020 554: 521: 485:editor-in-chief 465: 463:Journal support 410: 333: 327: 319: 280: 255:GlaxoSmithKline 229: 186:clinical trials 179: 105: 96: 79: 74: 31:Preregistration 28: 23: 22: 15: 12: 11: 5: 4697: 4695: 4687: 4686: 4681: 4676: 4671: 4666: 4656: 4655: 4652: 4651: 4646: 4641: 4634: 4633:External links 4631: 4628: 4627: 4618:|journal= 4575: 4516: 4483: 4474:|journal= 4431: 4389: 4370:(1): 259–272. 4350: 4308: 4279:(3): 229–244. 4259: 4218: 4199:(1): 177–180. 4179: 4148:(5): 552–556. 4128: 4107:(5): 556–563. 4087: 4025: 3999: 3939: 3910: 3886: 3863: 3812: 3763: 3713: 3704:|journal= 3669: 3626: 3591: 3570:(5): 702–712. 3550: 3519:(4): 376–390. 3492: 3483:|journal= 3440: 3414: 3375: 3334: 3321:(3): 137–141. 3298: 3285:10.1086/730455 3263: 3196: 3189: 3171: 3131: 3074: 3063:(4): 553–571. 3046: 3020: 2993:(6): 632–638. 2970: 2949: 2890: 2831: 2817: 2776: 2727: 2678: 2663: 2626:(1): e100051. 2606: 2539: 2502:(6): 488–489. 2482: 2423: 2374: 2355: 2306: 2257: 2210: 2161: 2118: 2100: 2053: 2035: 2010: 1985: 1967: 1948:(17): 1861–4. 1932: 1904: 1885:(285): 30–34. 1869: 1842:(4): 516–523. 1826: 1804: 1778: 1749: 1720: 1661: 1610: 1573: 1522: 1481: 1440: 1409:(3): 214–227. 1389: 1357:10.5334/pb.493 1350:(1): 338–352. 1330: 1309:(3): 229–244. 1289: 1241:(4): 602–615. 1225: 1174: 1147: 1136:(3): 137–141. 1120: 1109:(3): 609–610. 1086: 1059: 1040:(6): 423–437. 1024: 1013:(3): 221–230. 997: 976: 931:(3): 312–318. 910: 831: 830: 828: 825: 824: 823: 818: 813: 808: 801: 798: 553: 550: 520: 517: 464: 461: 458: 457: 452: 448: 447: 442: 438: 437: 432: 428: 427: 422: 409: 406: 403: 402: 397: 394: 390: 389: 384: 381: 377: 376: 371: 368: 364: 363: 358: 355: 351: 350: 345: 342: 326: 323: 318: 315: 279: 276: 228: 225: 178: 175: 174: 173: 166: 159: 152: 145: 138: 123: 116: 104: 101: 95: 92: 78: 75: 73: 70: 26: 24: 14: 13: 10: 9: 6: 4: 3: 2: 4696: 4685: 4682: 4680: 4677: 4675: 4672: 4670: 4667: 4665: 4662: 4661: 4659: 4650: 4647: 4645: 4642: 4640: 4637: 4636: 4632: 4623: 4610: 4602: 4598: 4594: 4590: 4586: 4579: 4576: 4571: 4567: 4562: 4557: 4552: 4547: 4543: 4539: 4536:(4): 181351. 4535: 4531: 4527: 4520: 4517: 4511: 4506: 4502: 4498: 4494: 4487: 4484: 4479: 4466: 4458: 4454: 4450: 4446: 4442: 4435: 4432: 4427: 4423: 4419: 4415: 4411: 4407: 4403: 4396: 4394: 4390: 4385: 4381: 4377: 4373: 4369: 4365: 4361: 4354: 4351: 4346: 4342: 4337: 4332: 4328: 4324: 4320: 4312: 4309: 4304: 4300: 4296: 4292: 4287: 4282: 4278: 4274: 4270: 4263: 4260: 4249: 4245: 4241: 4237: 4233: 4229: 4222: 4219: 4214: 4210: 4206: 4202: 4198: 4194: 4190: 4183: 4180: 4175: 4171: 4166: 4161: 4156: 4151: 4147: 4143: 4139: 4132: 4129: 4124: 4120: 4115: 4110: 4106: 4102: 4098: 4091: 4088: 4083: 4079: 4075: 4071: 4066: 4061: 4056: 4051: 4047: 4043: 4039: 4032: 4030: 4026: 4021: 4017: 4010: 4003: 4000: 3997: 3995: 3990: 3983: 3979: 3975: 3971: 3966: 3961: 3957: 3953: 3946: 3944: 3940: 3928: 3924: 3917: 3915: 3911: 3905: 3900: 3893: 3891: 3887: 3883:(3): 281–295. 3882: 3878: 3874: 3867: 3864: 3859: 3855: 3850: 3845: 3840: 3835: 3831: 3827: 3823: 3816: 3813: 3808: 3804: 3800: 3796: 3791: 3786: 3782: 3778: 3774: 3767: 3764: 3759: 3755: 3751: 3747: 3743: 3739: 3735: 3731: 3727: 3720: 3718: 3714: 3709: 3696: 3688: 3684: 3680: 3673: 3670: 3665: 3661: 3656: 3651: 3647: 3640: 3633: 3631: 3627: 3622: 3618: 3614: 3610: 3606: 3602: 3595: 3592: 3587: 3583: 3578: 3573: 3569: 3565: 3561: 3554: 3551: 3546: 3542: 3537: 3532: 3527: 3522: 3518: 3514: 3510: 3503: 3501: 3499: 3497: 3493: 3488: 3475: 3467: 3463: 3459: 3455: 3451: 3444: 3441: 3429: 3425: 3418: 3415: 3410: 3406: 3402: 3398: 3394: 3390: 3386: 3379: 3376: 3371: 3367: 3362: 3357: 3353: 3349: 3345: 3338: 3335: 3329: 3324: 3320: 3316: 3312: 3305: 3303: 3299: 3294: 3290: 3286: 3282: 3278: 3274: 3267: 3264: 3259: 3255: 3250: 3245: 3241: 3237: 3232: 3227: 3223: 3219: 3215: 3211: 3207: 3200: 3197: 3192: 3186: 3182: 3175: 3172: 3167: 3163: 3159: 3155: 3151: 3147: 3143: 3135: 3132: 3127: 3123: 3118: 3113: 3109: 3105: 3101: 3097: 3093: 3089: 3085: 3078: 3075: 3070: 3066: 3062: 3058: 3050: 3047: 3043:(3): 221–230. 3042: 3038: 3031: 3024: 3021: 3016: 3012: 3008: 3004: 3000: 2996: 2992: 2988: 2984: 2977: 2975: 2971: 2959: 2953: 2950: 2945: 2941: 2936: 2931: 2927: 2923: 2918: 2913: 2909: 2905: 2901: 2894: 2891: 2886: 2882: 2877: 2872: 2868: 2864: 2859: 2854: 2850: 2846: 2842: 2835: 2832: 2827: 2821: 2818: 2813: 2809: 2804: 2799: 2795: 2791: 2787: 2780: 2777: 2772: 2768: 2764: 2760: 2755: 2750: 2746: 2742: 2738: 2731: 2728: 2723: 2719: 2715: 2711: 2706: 2701: 2697: 2693: 2689: 2682: 2679: 2674: 2667: 2664: 2659: 2655: 2650: 2645: 2641: 2637: 2633: 2629: 2625: 2621: 2617: 2610: 2607: 2602: 2598: 2593: 2588: 2584: 2580: 2575: 2570: 2566: 2562: 2558: 2554: 2550: 2543: 2540: 2535: 2531: 2526: 2521: 2517: 2513: 2509: 2505: 2501: 2497: 2493: 2486: 2483: 2478: 2474: 2469: 2464: 2460: 2456: 2451: 2446: 2442: 2438: 2434: 2427: 2424: 2419: 2415: 2410: 2405: 2401: 2397: 2393: 2389: 2385: 2378: 2375: 2370: 2366: 2359: 2356: 2351: 2347: 2342: 2337: 2333: 2329: 2325: 2321: 2317: 2310: 2307: 2302: 2298: 2293: 2288: 2284: 2280: 2277:(10): 871–5. 2276: 2272: 2268: 2261: 2258: 2253: 2249: 2245: 2241: 2237: 2233: 2229: 2225: 2221: 2214: 2211: 2206: 2202: 2197: 2192: 2188: 2184: 2180: 2176: 2172: 2165: 2162: 2157: 2153: 2149: 2145: 2141: 2137: 2133: 2129: 2122: 2119: 2114: 2110: 2104: 2101: 2096: 2092: 2088: 2084: 2080: 2076: 2072: 2068: 2064: 2057: 2054: 2049: 2045: 2039: 2036: 2025:on 2011-08-30 2024: 2020: 2014: 2011: 2000:on 2010-07-06 1999: 1995: 1989: 1986: 1981: 1977: 1971: 1968: 1963: 1959: 1955: 1951: 1947: 1943: 1936: 1933: 1928: 1924: 1920: 1916: 1908: 1905: 1900: 1896: 1892: 1888: 1884: 1880: 1873: 1870: 1865: 1861: 1857: 1853: 1849: 1845: 1841: 1837: 1830: 1827: 1822: 1818: 1814: 1808: 1805: 1793: 1789: 1782: 1779: 1767: 1763: 1759: 1753: 1750: 1738: 1734: 1730: 1724: 1721: 1716: 1712: 1707: 1702: 1698: 1694: 1689: 1684: 1680: 1676: 1672: 1665: 1662: 1657: 1653: 1648: 1643: 1638: 1633: 1629: 1625: 1621: 1614: 1611: 1606: 1602: 1597: 1592: 1588: 1584: 1577: 1574: 1569: 1565: 1560: 1555: 1550: 1545: 1541: 1537: 1533: 1526: 1523: 1518: 1514: 1509: 1504: 1501:(1): 95–112. 1500: 1496: 1492: 1485: 1482: 1477: 1473: 1468: 1463: 1459: 1455: 1451: 1444: 1441: 1436: 1432: 1427: 1422: 1417: 1412: 1408: 1404: 1400: 1393: 1390: 1385: 1381: 1377: 1373: 1368: 1363: 1358: 1353: 1349: 1345: 1341: 1334: 1331: 1326: 1322: 1317: 1312: 1308: 1304: 1300: 1293: 1290: 1285: 1272: 1264: 1260: 1256: 1252: 1248: 1244: 1240: 1236: 1229: 1226: 1221: 1217: 1212: 1207: 1202: 1197: 1193: 1189: 1185: 1178: 1175: 1170: 1166: 1162: 1158: 1151: 1148: 1143: 1139: 1135: 1131: 1124: 1121: 1116: 1112: 1108: 1104: 1097: 1090: 1087: 1082: 1078: 1074: 1070: 1063: 1060: 1055: 1051: 1047: 1043: 1039: 1035: 1028: 1025: 1020: 1016: 1012: 1008: 1001: 998: 986: 980: 977: 972: 968: 964: 960: 956: 952: 947: 942: 938: 934: 930: 926: 922: 914: 911: 906: 902: 898: 894: 889: 884: 879: 874: 870: 866: 862: 858: 854: 847: 845: 843: 841: 839: 837: 833: 826: 822: 819: 817: 814: 812: 809: 807: 804: 803: 799: 797: 794: 790: 786: 782: 778: 774: 769: 767: 763: 759: 754: 750: 746: 742: 738: 734: 730: 726: 722: 718: 714: 710: 706: 702: 698: 694: 690: 686: 682: 678: 673: 671: 667: 663: 659: 655: 651: 647: 643: 639: 635: 631: 627: 626:Navarro, 2020 623: 619: 615: 611: 610:Dehaven, 2017 607: 603: 599: 595: 591: 587: 583: 579: 575: 571: 567: 563: 559: 551: 549: 547: 546: 540: 536: 534: 530: 526: 518: 516: 514: 509: 505: 502: 501: 496: 494: 493: 488: 486: 482: 481: 476: 474: 470: 462: 456: 453: 450: 449: 446: 443: 440: 439: 436: 433: 430: 429: 426: 423: 420: 419: 414: 407: 401: 398: 395: 392: 391: 388: 385: 382: 379: 378: 375: 372: 369: 366: 365: 362: 359: 356: 353: 352: 349: 346: 343: 340: 339: 336: 332: 324: 322: 316: 314: 311: 306: 304: 299: 297: 293: 289: 285: 277: 275: 273: 270: 267:In 2007, the 265: 263: 258: 256: 252: 251:Eliot Spitzer 247: 245: 241: 237: 233: 226: 224: 222: 216: 214: 210: 207:, run by the 206: 201: 199: 195: 191: 187: 183: 176: 171: 167: 164: 163:Dirnagl, 2020 160: 157: 153: 150: 146: 143: 139: 136: 132: 128: 124: 121: 117: 114: 110: 109: 108: 102: 100: 93: 91: 89: 85: 76: 71: 69: 67: 63: 59: 55: 54:data dredging 51: 47: 42: 40: 36: 32: 19: 4679:Open science 4649:As Predicted 4609:cite journal 4578: 4533: 4529: 4519: 4500: 4496: 4486: 4465:cite journal 4434: 4409: 4405: 4367: 4363: 4353: 4326: 4322: 4311: 4276: 4272: 4262: 4251:. Retrieved 4231: 4221: 4196: 4192: 4182: 4145: 4141: 4131: 4104: 4100: 4090: 4045: 4041: 4019: 4015: 4002: 3986: 3955: 3930:. Retrieved 3926: 3880: 3876: 3866: 3829: 3825: 3815: 3780: 3776: 3766: 3736:(2): 94–95. 3733: 3729: 3695:cite journal 3672: 3645: 3604: 3594: 3567: 3563: 3553: 3516: 3512: 3474:cite journal 3443: 3433:25 September 3431:. Retrieved 3427: 3422:Dehaven, A. 3417: 3392: 3388: 3378: 3354:(3): 81–98. 3351: 3347: 3337: 3318: 3314: 3276: 3266: 3213: 3209: 3199: 3180: 3174: 3149: 3145: 3134: 3091: 3087: 3077: 3060: 3056: 3049: 3040: 3036: 3023: 2990: 2986: 2962:. Retrieved 2952: 2907: 2903: 2893: 2848: 2844: 2834: 2820: 2793: 2789: 2779: 2744: 2740: 2730: 2695: 2691: 2681: 2666: 2623: 2619: 2609: 2556: 2552: 2542: 2499: 2495: 2485: 2440: 2437:PLOS Biology 2436: 2426: 2391: 2387: 2377: 2368: 2358: 2323: 2319: 2309: 2274: 2270: 2260: 2227: 2223: 2213: 2178: 2174: 2164: 2131: 2127: 2121: 2112: 2103: 2070: 2066: 2056: 2047: 2038: 2027:. Retrieved 2023:the original 2013: 2002:. Retrieved 1998:the original 1988: 1979: 1970: 1945: 1941: 1935: 1918: 1914: 1907: 1882: 1878: 1872: 1839: 1835: 1829: 1821:the original 1816: 1807: 1795:. Retrieved 1791: 1781: 1770:. Retrieved 1766:the original 1761: 1752: 1741:. Retrieved 1737:the original 1732: 1723: 1678: 1675:PLOS Biology 1674: 1664: 1627: 1623: 1613: 1586: 1576: 1539: 1535: 1525: 1498: 1494: 1484: 1457: 1453: 1443: 1406: 1402: 1392: 1347: 1343: 1333: 1306: 1302: 1292: 1271:cite journal 1238: 1234: 1228: 1191: 1188:PLOS Biology 1187: 1177: 1160: 1156: 1150: 1133: 1129: 1123: 1106: 1102: 1089: 1072: 1068: 1062: 1037: 1033: 1027: 1010: 1006: 1000: 989:. Retrieved 979: 928: 924: 913: 860: 856: 821:Open science 770: 752: 748: 745:Rubin (2020) 740: 676: 674: 638:(Rubin, 2020 634:open science 629: 613: 574:confirmatory 573: 569: 555: 543: 541: 537: 525:Lakens, 2019 522: 510: 506: 498: 497: 490: 489: 478: 477: 466: 445:OSF Registry 435:As Predicted 411: 399: 386: 373: 360: 347: 334: 320: 307: 300: 281: 266: 259: 248: 238: 234: 230: 217: 202: 189: 181: 180: 106: 97: 80: 43: 38: 34: 30: 29: 4674:Metascience 4664:Peer review 4503:: 163–176. 4101:Anaesthesia 3395:: 179–191. 2134:: 106–113. 1817:www.who.int 816:Metascience 791:; see also 711:; see also 654:Rubin, 2020 588:; see also 582:Rubin, 2020 570:exploratory 357:EU register 88:AsPredicted 18:Preregister 4658:Categories 4412:: 105061. 4253:2023-11-12 3790:2107.02947 3526:2010.10513 2964:2018-11-28 2698:(1): 4–5. 2224:The Lancet 2029:2010-09-02 2004:2010-07-23 1772:2017-06-23 1743:2017-06-23 1280:|url= 991:2015-11-13 946:2292/62865 827:References 753:historical 679:-hacking ( 552:Criticisms 329:See also: 4601:242155160 4457:236855127 4426:0261-5177 4384:1057-7408 4345:2003-2714 4295:0898-9621 4248:242644091 4213:230629031 4082:240688291 3994:CC BY 4.0 3974:1554-3528 3826:PLOS Biol 3807:235755301 3758:209500379 3664:218466913 3545:221821323 3466:236797452 3409:234848511 3293:2832-9368 3240:1932-6203 3166:2515-2459 2926:1664-1078 2867:1662-5161 2763:0956-7976 2640:2398-8703 2583:1932-6203 2516:1546-1696 2459:1545-7885 2252:210704225 2156:202582999 1697:1545-7885 1624:PLOS Biol 1605:236657420 1542:: 52–63. 1517:204363608 1476:2003-2714 1384:201844047 1263:236655778 971:247025114 955:2397-3374 806:AllTrials 508:studies. 46:p-hacking 4669:Research 4570:32431853 4303:30741570 4174:30946427 4123:29292498 4074:34729209 3996:license. 3982:37950113 3927:PsyArXiv 3858:33296358 3777:Synthese 3750:31892461 3621:86539993 3605:PsyArXiv 3586:27694465 3370:18163762 3258:30161249 3210:PLOS ONE 3126:35814910 3007:26168122 2944:28443044 2885:28979201 2812:28976450 2796:: 0034. 2771:26553013 2722:58645509 2714:30584679 2658:35047690 2601:31770377 2553:PLOS ONE 2534:22678379 2477:27832101 2418:23396544 2350:26563214 2320:BMJ Open 2244:31958402 2205:25760355 2148:31521723 2095:29203085 2087:15924966 2044:"ANZCTR" 1962:22550202 1927:10146333 1864:10184671 1856:12876095 1715:31613875 1656:32214315 1587:PsyArXiv 1568:33676957 1435:32190814 1376:31497308 1325:30741570 1255:34807636 1220:31042704 963:35190714 897:29531091 800:See also 519:Benefits 4561:7211853 4538:Bibcode 4165:6512264 4065:8548785 3932:17 July 3899:medRxiv 3849:7725296 3646:bioRxiv 3249:6117074 3218:Bibcode 3117:9257590 3096:Bibcode 3015:5096417 2935:5387793 2910:: 523. 2876:5611708 2851:: 468. 2649:8647586 2592:6879110 2561:Bibcode 2525:4516408 2468:5104355 2409:3715364 2341:4654354 2301:2684057 2292:1003898 2196:4508873 1899:2282137 1762:Who.int 1733:Who.int 1706:6793840 1647:7098547 1426:7079740 1367:6706998 1282:value ( 1211:6513108 1054:5974619 905:4639380 888:5856500 865:Bibcode 749:current 624:(e.g., 348:150,551 62:HARKing 4599:  4568:  4558:  4455:  4424:  4382:  4343:  4301:  4293:  4246:  4232:osf.io 4211:  4172:  4162:  4121:  4080:  4072:  4062:  4048:(10). 3980:  3972:  3901:  3856:  3846:  3805:  3756:  3748:  3662:  3619:  3584:  3543:  3464:  3407:  3368:  3291:  3256:  3246:  3238:  3187:  3164:  3124:  3114:  3013:  3005:  2942:  2932:  2924:  2883:  2873:  2865:  2810:  2769:  2761:  2720:  2712:  2656:  2646:  2638:  2599:  2589:  2581:  2532:  2522:  2514:  2475:  2465:  2457:  2416:  2406:  2348:  2338:  2299:  2289:  2250:  2242:  2203:  2193:  2154:  2146:  2093:  2085:  2067:Lancet 1960:  1925:  1897:  1862:  1854:  1797:22 May 1713:  1703:  1695:  1654:  1644:  1603:  1566:  1515:  1474:  1433:  1423:  1382:  1374:  1364:  1323:  1278:Check 1261:  1253:  1218:  1208:  1103:Cortex 1052:  969:  961:  953:  903:  895:  885:  387:11,794 383:ISRCTN 374:12,728 361:21,060 60:, and 4597:S2CID 4453:S2CID 4244:S2CID 4228:"OSF" 4209:S2CID 4078:S2CID 4020:27250 4012:(PDF) 3803:S2CID 3785:arXiv 3754:S2CID 3660:S2CID 3642:(PDF) 3617:S2CID 3541:S2CID 3521:arXiv 3462:S2CID 3405:S2CID 3366:S2CID 3152:(4). 3094:(7). 3033:(PDF) 3011:S2CID 2808:S2CID 2718:S2CID 2248:S2CID 2152:S2CID 2091:S2CID 1895:JSTOR 1860:S2CID 1601:S2CID 1513:S2CID 1380:S2CID 1259:S2CID 1099:(PDF) 1075:(1). 967:S2CID 901:S2CID 743:. As 400:8,216 253:sued 72:Types 4622:help 4566:PMID 4478:help 4422:ISSN 4380:ISSN 4341:ISSN 4299:PMID 4291:ISSN 4170:PMID 4119:PMID 4070:PMID 3978:PMID 3970:ISSN 3934:2021 3854:PMID 3746:PMID 3708:help 3582:PMID 3487:help 3435:2020 3289:ISSN 3254:PMID 3236:ISSN 3185:ISBN 3162:ISSN 3122:PMID 3003:PMID 2940:PMID 2922:ISSN 2881:PMID 2863:ISSN 2767:PMID 2759:ISSN 2710:PMID 2654:PMID 2636:ISSN 2597:PMID 2579:ISSN 2530:PMID 2512:ISSN 2473:PMID 2455:ISSN 2414:PMID 2346:PMID 2297:PMID 2240:PMID 2201:PMID 2144:PMID 2083:PMID 1958:PMID 1942:JAMA 1923:PMID 1852:PMID 1836:JAMA 1799:2019 1711:PMID 1693:ISSN 1652:PMID 1564:PMID 1472:ISSN 1431:PMID 1372:PMID 1321:PMID 1284:help 1251:PMID 1216:PMID 1050:PMID 959:PMID 951:ISSN 893:PMID 672:). 666:2021 662:2020 282:The 196:and 4589:doi 4556:PMC 4546:doi 4505:doi 4445:doi 4414:doi 4410:107 4372:doi 4331:doi 4281:doi 4236:doi 4201:doi 4160:PMC 4150:doi 4146:137 4109:doi 4060:PMC 4050:doi 3960:doi 3844:PMC 3834:doi 3795:doi 3781:199 3738:doi 3683:doi 3650:doi 3609:doi 3572:doi 3531:doi 3454:doi 3397:doi 3393:164 3356:doi 3323:doi 3281:doi 3244:PMC 3226:doi 3154:doi 3112:PMC 3104:doi 3065:doi 2995:doi 2930:PMC 2912:doi 2871:PMC 2853:doi 2798:doi 2749:doi 2700:doi 2644:PMC 2628:doi 2587:PMC 2569:doi 2520:PMC 2504:doi 2463:PMC 2445:doi 2404:PMC 2396:doi 2336:PMC 2328:doi 2287:PMC 2279:doi 2232:doi 2228:395 2191:PMC 2183:doi 2179:372 2136:doi 2132:116 2075:doi 2071:365 1950:doi 1946:307 1887:doi 1844:doi 1840:290 1701:PMC 1683:doi 1642:PMC 1632:doi 1591:doi 1554:hdl 1544:doi 1540:164 1503:doi 1462:doi 1421:PMC 1411:doi 1362:PMC 1352:doi 1311:doi 1243:doi 1206:PMC 1196:doi 1165:doi 1138:doi 1111:doi 1077:doi 1042:doi 1015:doi 941:hdl 933:doi 883:PMC 873:doi 861:115 475:). 451:4. 441:3. 431:2. 421:1. 86:or 4660:: 4613:: 4611:}} 4607:{{ 4595:. 4587:. 4564:. 4554:. 4544:. 4532:. 4528:. 4501:31 4499:. 4495:. 4469:: 4467:}} 4463:{{ 4451:. 4443:. 4420:. 4408:. 4404:. 4392:^ 4378:. 4368:33 4366:. 4362:. 4339:. 4329:. 4325:. 4321:. 4297:. 4289:. 4277:26 4275:. 4271:. 4242:. 4234:. 4230:. 4207:. 4197:31 4195:. 4191:. 4168:. 4158:. 4144:. 4140:. 4117:. 4105:73 4103:. 4099:. 4076:. 4068:. 4058:. 4044:. 4040:. 4028:^ 4018:. 4014:. 3976:. 3968:. 3958:. 3954:. 3942:^ 3925:. 3913:^ 3889:^ 3881:62 3879:. 3875:. 3852:. 3842:. 3830:18 3828:. 3824:. 3801:. 3793:. 3779:. 3775:. 3752:. 3744:. 3734:24 3732:. 3728:. 3716:^ 3699:: 3697:}} 3693:{{ 3681:. 3658:. 3644:. 3629:^ 3615:. 3607:. 3603:. 3580:. 3568:11 3566:. 3562:. 3539:. 3529:. 3517:16 3515:. 3511:. 3495:^ 3478:: 3476:}} 3472:{{ 3460:. 3452:. 3426:. 3403:. 3391:. 3387:. 3364:. 3352:29 3350:. 3346:. 3319:45 3317:. 3313:. 3301:^ 3287:. 3279:. 3275:. 3252:. 3242:. 3234:. 3224:. 3214:13 3212:. 3208:. 3160:. 3148:. 3144:. 3120:. 3110:. 3102:. 3090:. 3086:. 3061:36 3059:. 3041:62 3039:. 3035:. 3009:. 3001:. 2989:. 2985:. 2973:^ 2938:. 2928:. 2920:. 2906:. 2902:. 2879:. 2869:. 2861:. 2849:11 2847:. 2843:. 2806:. 2792:. 2788:. 2765:. 2757:. 2745:26 2743:. 2739:. 2716:. 2708:. 2696:49 2694:. 2690:. 2652:. 2642:. 2634:. 2622:. 2618:. 2595:. 2585:. 2577:. 2567:. 2557:14 2555:. 2551:. 2528:. 2518:. 2510:. 2500:30 2498:. 2494:. 2471:. 2461:. 2453:. 2441:14 2439:. 2435:. 2412:. 2402:. 2392:20 2390:. 2386:. 2367:. 2344:. 2334:. 2322:. 2318:. 2295:. 2285:. 2275:48 2273:. 2269:. 2246:. 2238:. 2226:. 2222:. 2199:. 2189:. 2177:. 2173:. 2150:. 2142:. 2130:. 2111:. 2089:. 2081:. 2069:. 2065:. 2046:. 1978:. 1956:. 1944:. 1919:28 1917:. 1893:. 1883:54 1881:. 1858:. 1850:. 1838:. 1815:. 1790:. 1760:. 1731:. 1709:. 1699:. 1691:. 1679:17 1677:. 1673:. 1650:. 1640:. 1628:18 1626:. 1622:. 1599:. 1589:. 1585:. 1562:. 1552:. 1538:. 1534:. 1511:. 1499:86 1497:. 1493:. 1470:. 1460:. 1456:. 1452:. 1429:. 1419:. 1405:. 1401:. 1378:. 1370:. 1360:. 1348:59 1346:. 1342:. 1319:. 1307:26 1305:. 1301:. 1275:: 1273:}} 1269:{{ 1257:. 1249:. 1239:77 1237:. 1214:. 1204:. 1192:17 1190:. 1186:. 1159:. 1134:45 1132:. 1107:49 1105:. 1101:. 1073:10 1071:. 1048:. 1038:66 1036:. 1011:62 1009:. 965:. 957:. 949:. 939:. 927:. 923:. 899:. 891:. 881:. 871:. 859:. 855:. 835:^ 783:; 779:; 775:; 764:; 760:; 719:; 715:; 707:; 703:; 695:; 691:; 687:; 683:; 668:; 664:, 656:; 652:; 640:; 600:; 596:; 531:; 527:; 393:5. 380:4. 367:3. 354:2. 341:1. 274:. 133:; 129:; 68:. 52:, 48:, 4624:) 4620:( 4603:. 4591:: 4572:. 4548:: 4540:: 4534:7 4513:. 4507:: 4480:) 4476:( 4459:. 4447:: 4428:. 4416:: 4386:. 4374:: 4347:. 4333:: 4327:5 4305:. 4283:: 4256:. 4238:: 4215:. 4203:: 4176:. 4152:: 4125:. 4111:: 4084:. 4052:: 4046:8 4022:. 3984:. 3962:: 3936:. 3907:. 3860:. 3836:: 3809:. 3797:: 3787:: 3760:. 3740:: 3710:) 3706:( 3689:. 3685:: 3666:. 3652:: 3623:. 3611:: 3588:. 3574:: 3547:. 3533:: 3523:: 3489:) 3485:( 3468:. 3456:: 3437:. 3411:. 3399:: 3372:. 3358:: 3331:. 3325:: 3295:. 3283:: 3260:. 3228:: 3220:: 3193:. 3168:. 3156:: 3150:6 3128:. 3106:: 3098:: 3092:9 3071:. 3067:: 3017:. 2997:: 2991:7 2967:. 2946:. 2914:: 2908:8 2887:. 2855:: 2814:. 2800:: 2794:1 2773:. 2751:: 2724:. 2702:: 2675:. 2660:. 2630:: 2624:4 2603:. 2571:: 2563:: 2536:. 2506:: 2479:. 2447:: 2420:. 2398:: 2371:. 2352:. 2330:: 2324:5 2303:. 2281:: 2254:. 2234:: 2207:. 2185:: 2158:. 2138:: 2115:. 2097:. 2077:: 2050:. 2032:. 2007:. 1982:. 1964:. 1952:: 1929:. 1901:. 1889:: 1866:. 1846:: 1801:. 1775:. 1746:. 1717:. 1685:: 1658:. 1634:: 1607:. 1593:: 1570:. 1556:: 1546:: 1519:. 1505:: 1478:. 1464:: 1458:5 1437:. 1413:: 1407:2 1386:. 1354:: 1327:. 1313:: 1286:) 1265:. 1245:: 1222:. 1198:: 1171:. 1167:: 1161:4 1144:. 1140:: 1117:. 1113:: 1083:. 1079:: 1056:. 1044:: 1021:. 1017:: 994:. 973:. 943:: 935:: 929:6 907:. 875:: 867:: 677:p 630:p 614:p 172:) 165:) 158:) 151:) 144:) 137:) 122:) 115:) 20:)

Index

Preregister
p-hacking
publication bias
data dredging
post hoc analysis
HARKing
replication crisis
Open Science Framework
AsPredicted
Bosnjak et al., 2021
Haven & Van Grootel, 2019
Mertens & Krypotosm, 2019
Weston et al., 2019
van den Akker et al., 2021
Johnson & Cook, 2019
Paul et al., 2021
Kirtley et al., 2019
Dirnagl, 2020
Bert et al., 2019
clinical trials
publication bias
selective reporting
ClinicalTrials.gov
United States National Library of Medicine
contract research organization
World Health Organization
ClinicalTrials.gov
FDA Modernization Act of 1997
Eliot Spitzer
GlaxoSmithKline

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑