Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RegrKm SE prediction for epistemic uncertainty #173

Open
mb706 opened this issue Feb 1, 2021 · 1 comment
Open

RegrKm SE prediction for epistemic uncertainty #173

mb706 opened this issue Feb 1, 2021 · 1 comment

Comments

@mb706
Copy link
Contributor

mb706 commented Feb 1, 2021

RegrKm SE prediction with nugget currently predicts the epistemic uncertainty (uncertainty of the mean prediction) + aleatoric uncertainty (nugget SE, uncertainty that the model sees as random error). E.g. sampling lots of points with SE 0.1 noise and fitting a GP through them gives us

image

Where the GP goes through the points, the epistemic uncertainty is relatively low (it is the mean of a large sample) but the aleatoric uncertainty has SE 0.1 (nugget estimate).

What instead would be interesting would be the epistemic uncertainty alone

image

This is just

sqrt(pmax(p$sd^2 - self$model@covariance@nugget, 0))

I suggest we introduce a hyperparameter that gives the option to predict this, could be interesting for MBO.

@mllg
Copy link
Member

mllg commented Mar 6, 2021

PR would be welcome.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants