Tuesday, 25 April 2023

Questionable Metascience Practices

›
In this new article , I consider questionable research practices in the field of metascience. A questionable metascience practice (QMP) is ...
Saturday, 27 August 2022

Exploratory hypothesis tests can be more compelling than confirmatory hypothesis tests

›
Researchers often distinguish between: (1) Exploratory hypothesis tests - unplanned tests of post hoc hypotheses that may be based on the cu...
Monday, 4 April 2022

Two-Sided Significance Tests

›
In this paper ( Rubin, 2022 ), I make two related points: (1) researchers should halve two-sided p values if they wish to use them to make ...
Wednesday, 7 July 2021

When to Adjust Alpha During Multiple Testing

›
In this new paper (Rubin, 2021), I consider when researchers should adjust their alpha level (significance threshold) during multiple testin...
Sunday, 27 September 2020

“Repeated sampling from the same population?” A critique of Neyman and Pearson’s responses to Fisher

›
In a new paper in the European Journal for Philosophy of Science , I consider Fisher's criticism that the Neyman-Pearson approach to hyp...
Sunday, 20 September 2020

Does Preregistration Improve the Interpretablity and Credibility of Research Findings?

›
Preregistration entails researchers registering their planned research hypotheses, methods, and analyses in a time-stamped document before t...
Friday, 13 March 2020

What Type of Type I Error?

›
In a recent paper ( Rubin, 2021 ), I consider two types of replication in relation to two types of Type I error probability. First, I c...
Thursday, 12 March 2020

Do p Values Lose their Meaning in Exploratory Analyses?

›
In  Rubin (2017) , I consider the idea that  p  values lose their meaning (become invalid) in exploratory analyses (i.e., non-preregistered...
Wednesday, 11 March 2020

The Costs of HARKing: Does it Matter if Researchers Engage in Undisclosed Hypothesizing After the Results are Known?

›
While no-one's looking, a Texas sharpshooter fires his gun at a barn wall, walks up to his bullet holes, and paints targets around them....