May 24, 2019 Last Updated 10:12 AM, May 22, 2019

The significance of statistical significance

Published in Head news
Read 164 times
Rate this item
(0 votes)

I believe that there is at least one moment (to say the least) in the life of a scientist in which he thought to his data as a sort of superposition between "statistically significant" and something more like "well... there's definitelly a trend there", the latter definition often used when the difference observed in the data sets didn't reach the statistical threshold to be deemed "non-casual". When the second case occurs, the only conclusion is that the two (or more) mean values belong to samples of the same population that happened to be different only by sheer chance, and not due to our experimental hypothesis. Usually, in bio-medical sciences, this threshold is represented by alpha=0.05 and, quite unfortunately it has gradually become the magical door that divides undignified results from striking discoveries -some sort of holy grail of scientific literature, and has transformed several scientifical endeavors in trivial search for a p-value that was lower of 0.05. Things, however, might be mature enough for a "surgical strike on thoughtless testing of statistical significance".

 

However, according to a recent Comment appeared last week on Nature website, the dichotomous use of p values might represent a tremendously limited approach when it comes to discuss scientific data. The paper also tested a sample of 791 papers from 5 journals finding a 51% ratio of wrong interpretations from incorrect use of p-value. When it comes to data sets - and the conclusions to which they must lead - strict and absolute categorization might not really be the best approach in that all statistics can naturally vary, even in an unexpected measure, between different studies. As a matter of fact we should stop using "non significant" as a synonym for "not-true" and start embracing a little degree of uncertainty in our data, discussing data in terms of compatibility with an assumption, rather than define as "irrelevant" any result that diverts even a little bit from significancy boundaries. The paper gives four advices to understand the caveats of statistical categorizing approaches and avoid them.

Source: Nature Website 

Last modified on Thursday, 28 March 2019 15:45
Login to post comments

Registered area

Thanks to the support of
merck serono biogen sanofi

Conferences & Courses

17° Corso CRNI Viva la differenza: sesso e neuroimmunologia

March 7-10, 2018 
Bergamo - Bergamo Science Center

READ MORE

Encefaliti Autoimmuni e Malattie Demielinizzanti Atipiche

16 febbraio 2018
Aula Magna Giorgio De Sandre
POLICLINICO UNIVERSITARIO G.B. ROSSI - Verona

READ MORE

JNIInternational Brain Research Organization
Bringing Neuroscience to the World
JNIJournal of Neuroimmunology
Studies on all branches of neurosciences covering both research and clinical problems of neuroscientific interest.

This website or its third party tools use cookies, which are necessary to its functioning and required to achieve the purposes illustrated in the cookie policy. If you want to know more or withdraw your consent to all or some of the cookies, please refer to the cookie policy. By closing this banner, scrolling this page, clicking a link or continuing to browse otherwise, you agree to the use of cookies. To find out more about the cookies we use and how to delete them, see our Cookie Policy