--- In [email protected], "authfriend" <[EMAIL PROTECTED]> wrote: > > --- In [email protected], "sparaig" <sparaig@> wrote: > > > > --- In [email protected], "authfriend" <jstein@> wrote: > <snip> > > > They concluded that results that were null or did > > > did not *quite* achieve significance had often been > > > tweaked to push them just over the line. > > > > Sounds plausible, but as I suggested, those that weren't submitted > may have made up the > > difference and they were never submitted in the first place. > > Well, I guess I can't get you to look at the study. > > Here's the money quote: > > It is sometimes suggested that insignificant findings end up in "file > drawers," but we observe many results with z-statistics between zero > and the critical value. There is, however, no way to know how many > studies are "missing." If scholars "tweak" regression specifications > and samples to move barely insignificant results above conventional > thresholds, then there may be many z-statistics below the critical > value, but an inordinate number barely above the critical value and > not very many barely below it. We see that pattern in the data. >
Yes, and that doesn't change my point. Even after sme tweaking, if the study can't be made to show significance, it gets filed away. We still can't conclude much from their findings since we don't know the rejection patterns of the journals. What's the rejection pattern when plotted against statistical significance? I'm not sure the editors would want to release that information for various reasons but it's a glaring bit of missing info. To subscribe, send a message to: [EMAIL PROTECTED] Or go to: http://groups.yahoo.com/group/FairfieldLife/ and click 'Join This Group!' Yahoo! Groups Links <*> To visit your group on the web, go to: http://groups.yahoo.com/group/FairfieldLife/ <*> Your email settings: Individual Email | Traditional <*> To change settings online go to: http://groups.yahoo.com/group/FairfieldLife/join (Yahoo! ID required) <*> To change settings via email: mailto:[EMAIL PROTECTED] mailto:[EMAIL PROTECTED] <*> To unsubscribe from this group, send an email to: [EMAIL PROTECTED] <*> Your use of Yahoo! Groups is subject to: http://docs.yahoo.com/info/terms/
