Skip to content Skip to navigation
University of Warwick
  • Study
  • |
  • Research
  • |
  • Business
  • |
  • Alumni
  • |
  • News
  • |
  • About

University of Warwick
Publications service & WRAP

Highlight your research

  • WRAP
    • Home
    • Search WRAP
    • Browse by Warwick Author
    • Browse WRAP by Year
    • Browse WRAP by Subject
    • Browse WRAP by Department
    • Browse WRAP by Funder
    • Browse Theses by Department
  • Publications Service
    • Home
    • Search Publications Service
    • Browse by Warwick Author
    • Browse Publications service by Year
    • Browse Publications service by Subject
    • Browse Publications service by Department
    • Browse Publications service by Funder
  • Help & Advice
University of Warwick

The Library

  • Login
  • Admin

Abandon statistical significance

Tools
- Tools
+ Tools

McShane, Blakeley, Gal, David, Gelman, Andrew, Robert, Christian P. and Tackett, Jennifer (2019) Abandon statistical significance. The American Statistician, 73 (1). pp. 235-245. doi:10.1080/00031305.2018.1527253

[img]
Preview
PDF
WRAP-abandon-statistical-significance-McShane-2019.pdf - Published Version - Requires a PDF viewer.
Available under License Creative Commons Attribution Non-commercial No Derivatives 4.0.

Download (1314Kb) | Preview
[img] PDF
WRAP-abandon-statistical-significance-Robert-2018.pdf - Accepted Version
Embargoed item. Restricted access to Repository staff only - Requires a PDF viewer.

Download (267Kb)
Official URL: https://doi.org/10.1080/00031305.2018.1527253

Request Changes to record.

Abstract

We discuss problems the null hypothesis significance testing (NHST) paradigm poses for replication and more broadly in the biomedical and social sciences as well as how these problems remain unresolved by proposals involving modified p-value thresholds, confidence intervals, and Bayes factors. We then discuss our own proposal, which is to abandon statistical significance. We recommend dropping the NHST paradigm—and the p-value thresholds intrinsic to it—as the default statistical paradigm for research, publication, and discovery in the biomedical and social sciences. Specifically, we propose that the p-value be demoted from its threshold screening role and instead, treated continuously, be considered along with currently subordinate factors (e.g., related prior evidence, plausibility of mechanism, study design and data quality, real world costs and benefits, novelty of finding, and other factors that vary by research domain) as just one among many pieces of evidence. We have no desire to “ban” p-values or other purely statistical measures. Rather, we believe that such measures should not be thresholded and that, thresholded or not, they should not take priority over the currently subordinate factors. We also argue that it seldom makes sense to calibrate evidence as a function of p-values or other purely statistical measures. We offer recommendations for how our proposal can be implemented in the scientific publication process as well as in statistical decision making more broadly.

Item Type: Journal Article
Subjects: Q Science > QA Mathematics
Divisions: Faculty of Science > Statistics
Journal or Publication Title: The American Statistician
Publisher: Taylor & Francis
Official Date: 20 March 2019
Dates:
DateEvent
20 March 2019Published
6 September 2018Accepted
Volume: 73
Number: 1
Page Range: pp. 235-245
DOI: 10.1080/00031305.2018.1527253
Status: Peer Reviewed
Publication Status: Published
Access rights to Published version: Open Access
Funder: National Science Foundation, Institute for Education Sciences, Office of Naval Research
Related URLs:
  • Publisher
Open Access Version:
  • ArXiv

Request changes or add full text files to a record

Repository staff actions (login required)

View Item View Item
twitter

Email us: wrap@warwick.ac.uk
Contact Details
About Us