Advanced search
Start date
Betweenand


Adding imprecision to hypotheses: A Bayesian framework for testing practical significance in nonparametric settings

Full text
Author(s):
Lassance, Rodrigo F. L. ; Izbicki, Rafael ; Stern, Rafael B.
Total Authors: 3
Document type: Journal article
Source: INTERNATIONAL JOURNAL OF APPROXIMATE REASONING; v. 178, p. 25-pg., 2024-11-29.
Abstract

Instead of testing solely a precise hypothesis, it is often useful to enlarge it with alternatives deemed to differ negligibly from it. For instance, in a bioequivalence study one might test if the concentration of an ingredient is exactly the same in two drugs. In such a context, it might be more relevant to test the enlarged hypothesis that the difference in concentration between them is of no practical significance. While this concept is not alien to Bayesian statistics, applications remain mostly confined to parametric settings and strategies that effectively harness experts' intuitions are often scarce or nonexistent. To resolve both issues, we introduce the Pragmatic Region Oriented Test ( PROTEST ), an accessible nonparametric testing framework based on distortion models that can seamlessly integrate with Markov Chain Monte Carlo (MCMC) methods and is available as an R package. We develop expanded versions of model adherence, goodness-of-fit, quantile and two-sample tests. To demonstrate how PROTEST operates, we use examples, simulated studies that critically evaluate features of the test and an application on neuron spikes. Furthermore, we address the crucial issue of selecting the threshold-which controls how much a hypothesis is to be expanded-even when intuitions are limited or challenging to quantify. (AU)

FAPESP's process: 13/07699-0 - Research, Innovation and Dissemination Center for Neuromathematics - NeuroMat
Grantee:Oswaldo Baffa Filho
Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC
FAPESP's process: 19/11321-9 - Neural networks in statistical inference problems
Grantee:Rafael Izbicki
Support Opportunities: Regular Research Grants
FAPESP's process: 23/07068-1 - Statistical machine learning: toward better uncertainty quantification
Grantee:Rafael Izbicki
Support Opportunities: Regular Research Grants