In the wake of the replication crisis, statistical power has become a hotly debated topic in discussions about the quality of research. Low power is often named as one of the main factors why studies do not replicate, and the assessment of a finding’s credibility based on the underlying test’s power has become common. In our new paper, we discuss that this practice has little theoretical support in the dominant frameworks of statistical inference. Moreover, we explain that concerns about low power may mask more general concerns about the integrity of the research process, such as the possible use of questionable research practices. Finally, we provide recommendations on how findings can be critiqued based on their power in a constructive and transparent way
Lengersdorff, L., & Lamm, C. (2025). With low power comes low credibility? Towards a principled critique of results from underpowered tests. Advances in Methods and Practices in Psychological Science, 8(1). https://doi.org/10.1177/25152459241296397
