More thinking about α = 0.05

Mudge has actually written an excellent followup to his technique to balance type I and II error rates to determine a study specific α. He actually went back and did a meta-analysis to look at how study specific values of alpha can change conclusions – sometimes substantially. The paper is great as well.

For more information, here’s his original on setting a study specific α and a thoughtful piece by Gelman and Stearns where they highlight that the difference between “Significant” and “Not Significant” is not itself statistically significant [pdf]

Advertisements
This entry was posted in Links to outside reading. Bookmark the permalink.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s