This app visualizes the Vovk-Sellke maximum p-ratio: the maximum diagnosticity of a two-sided p-value (Vovk, 1993; Sellke et al., 2001). For example, a p-value of .05 (“reject the null”) is only 2.46 times more likely under the best H₁ than under H₀. The Vovk-Sellke ratio is available in the free statistical software package JASP.

References:

• Vovk, V. G. (1993). A logic of probability, with application to the foundations of statistics. Journal of the Royal Statistical Society Series B, 55, 317-351.
• Sellke, T., Bayarri, M., and Berger, J. O. (2001). Calibration of p values for testing precise null hypotheses. The American Statistician, 55, 62-71.