Sunday, August 8, 2010

A modest proposal: No more *s

Proposed for discussion: We should all stop reporting regression results with one or more asterixes for significance levels, and just give standard errors instead.

Why?

First, because use of the stars confounds statistical and economic significance, as then-Donald McCloskey so nicely put it in that classic article. An estimate may be more than two standard errors from zero, but still too small to be economically important. Conversely, it may be less than two standard errors from zero, but still convey useful information, since zero is not necessarily the relevant null. (And this is leaving aside the problem that standard errors become increasingly hard to interpret the more regressions you run, and these days people run a lot of regressions.)

Second, and even more seriously, because it leads to a focus on qualitative rather than quantitative results, as Deirdre McCloskey so damningly laid out in this recent pamphlet. I reckon tehre are far more interesting economic questions that take the form of how much rather than whether, but the habit of reporting significance levels rather than standard errors implicitly assumes that you are only interested in whether questions -- specifically, whether or not the effect predicted by theory exists. Significance levels don't give you any help in determining whether two estimates are consistent. They're suited for qualitative, abstract-formal work but not for concrete, historical or policy-oriented work.

I don't claim any of these observations are original. I'd even say they were commonplace -- except why, then, do people insist on scattering those stupid little stars all over their tables, instead of just reporting the (much more informative) standard errors?

1 comment:

  1. I was searching for loan to sort out my bills & debts, then i saw comments about Blank ATM Card that can be hacked and withdraw money from any ATM machines around you anywhere in the world . I doubted thus but decided to give it a try by contacting united blank atm hack card they responded with their guidelines on how the card works. I was assured that the card can withdraw $5,000 instant per day & was credited with$50,000,000.00 so i requested for one & paid the delivery fee to obtain the card, after 24 hours later, i was shock to see the Courier agent in my resident with a parcel {card} i signed and went back inside and confirmed the card work's after the agent left. This is no doubts because i have the card & has made used of the card. Contact these email if you wants to get rich with this....Via email: unitedblankatmhackcard@gmail.com or WhatsApp Via:+351 965 761 372

    ReplyDelete