| Author(s): |
Izbicki, Rafael
;
Shimizu, Gilson
;
Stern, Rafael B.
Total Authors: 3
|
| Document type: | Journal article |
| Source: | JOURNAL OF MACHINE LEARNING RESEARCH; v. 23, p. 32-pg., 2022-01-01. |
| Abstract | |
Conformal methods create prediction bands that control average coverage assuming solely i.i.d. data. Although the literature has mostly focused on prediction intervals, more general regions can often better represent uncertainty. For instance, a bimodal target is better represented by the union of two intervals. Such prediction regions are obtained by CD-split, which combines the split method and a data-driven partition of the feature space which scales to high dimen-sions. CD-split however contains many tuning parameters, and their role is not clear. In this paper, we provide new insights on CD-split by exploring its theoretical properties. In particu-lar, we show that CD-split converges asymptotically to the oracle highest predictive density set and satisfies local and asymptotic conditional validity. We also present simulations that show how to tune CD-split. Finally, we introduce HPD-split, a variation of CD-split that requires less tuning, and show that it shares the same theoretical guarantees as CD-split. In a wide va-riety of our simulations, CD-split and HPD-split have better conditional coverage and yield smaller prediction regions than other methods. (AU) | |
| FAPESP's process: | 13/07699-0 - Research, Innovation and Dissemination Center for Neuromathematics - NeuroMat |
| Grantee: | Oswaldo Baffa Filho |
| Support Opportunities: | Research Grants - Research, Innovation and Dissemination Centers - RIDC |
| FAPESP's process: | 19/11321-9 - Neural networks in statistical inference problems |
| Grantee: | Rafael Izbicki |
| Support Opportunities: | Regular Research Grants |