Real Clear Politics Real Clear Science Newton Blog How to Make Scientists Publish the Truth Posted by _Alex B. Berezow_ (http://www.realclearscience.com/authors/alex_b_berezow/) October 21, 2014 John Ioannidis is (in)famous in the scientific community. Using straightforward logic and statistics, he convincingly demonstrated that _most published research articles are wrong_ (http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.0020124) . This is not because scientists are liars and crooks, but because studies often do not have large enough sample sizes or are testing unlikely hypotheses. Ioannidis's revelation sent a shock wave through the biomedical community. Partially in response to his findings, biomedical scientists began to embrace reforms in scientific publishing, such as using more open access journals and publishing replications and negative data. Now, in a new paper in PLoS Medicine, Dr. Ioannidis proposes additional reforms. Some of the more interesting ones include: Registration of studies. Clinical trials already do this. (See _ClinicalTrials.gov_ (http://clinicaltrials.gov/) .) This would allow researchers to monitor ongoing studies. Others have proposed that _all registered studies should be accepted for publication upon their completion_ (http://www.theguardian.com/science/blog/2013/jun/05/trust-in-science-study-pre-registration) , regardless of the outcome of the experiment. This would eliminate "publication bias," the phenomenon in which only "sexy" results are published and negative (or uninteresting) results are ignored. Adoption of better statistical methods. It is not a big secret that _biologists are bad at math_ (http://www.realclearscience.com/articles/2012/09/11/biologists_have_a_serious_math_problem_106369.html) . (Well, except for John Ioannidis.) Papers with a lot of mathematical equations are _avoided by biologists_ (http://blogs.sciencemag.org/sciencecareers/2012/06/too-many-equati.html) . The heavy mathematical lifting required in some biomedical fields, such as epidemiology and genomics, is outsourced to biostatisticans. Dr. Ioannidis suggests more stringent thresholds for statistical significance. That is certainly necessary, but there also should be a requirement for all biomedical PhD students to take courses in biostatistics. Improvements in peer review. Though Dr. Ioannidis does not offer specific details, one group is strongly advocating post-publication peer review. _F1000Research_ (http://www.realclearscience.com/articles/2014/09/04/f1000_will_make_science_faster_and_transparent_108822.html) publishes papers along with their expert reviews, which are not allowed to be anonymous. Consideration of stakeholder interests and modification of incentives. Members of the scientific community place different values on research. For example, professors want research that is publishable, while industry wants research that is profitable. Dr. Ioannidis identifies four interests that need to be considered: publishability, fundability, translatability, and profitability. Furthermore, he proposes a radical change in incentives, such as eliminating _academic ranks_ (http://en.wikipedia.org/wiki/Academic_ranks_(United_States)) (e.g., tenure). Scientific publications are on the cusp of a dramatic shift. Thanks to the efforts of Dr. Ioannidis and others like him, the monolithic biomedical establishment is beginning to embrace change. If only the rest of academia was so reflective and self-critical. --- _Source_ (http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.1001747) : Ioannidis JPA (2014). "How to Make More Published Research True." PLoS Med 11(10): e1001747. doi:10.1371/journal.pmed.1001747 -- -- Centroids: The Center of the Radical Centrist Community <[email protected]> Google Group: http://groups.google.com/group/RadicalCentrism Radical Centrism website and blog: http://RadicalCentrism.org --- You received this message because you are subscribed to the Google Groups "Centroids: The Center of the Radical Centrist Community" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
[RC] How to Make Scientists Publish the Truth
BILROJ via Centroids: The Center of the Radical Centrist Community Wed, 22 Oct 2014 12:26:11 -0700
- [RC] Ho... BILROJ via Centroids: The Center of the Radical Centrist Community
- Re... Dr. Ernie Prabhakar
