Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sebastian.p/orth dgp #88

Open
wants to merge 56 commits into
base: develop
Choose a base branch
from
Open

Conversation

SebastianPopescu
Copy link
Collaborator

@SebastianPopescu SebastianPopescu commented Nov 24, 2022

Implementation of "Sparse Orthogonal Variational Inference for Gaussian Processes".

Created the following folders:
-- conditionals: needs a specialized form to account for the two different GPs that have to be summed g() and h() as in the paper.
--covariances: needed to compute Cvv and Cvf as in the paper. These covariances rely on the other set of inducing points.
--posteriors.py: different conditionals are needed here.
-- conditionals.util.conditional_GP_maths might have to be re-designed or at least have its name changed to something more sensible.

@hstojic
Copy link
Collaborator

hstojic commented Nov 25, 2022

cleaned up a bit, mypy still complains on quite a few things, but content wise good enough for a review

@avullo avullo requested a review from hstojic November 30, 2022 18:05
@avullo
Copy link
Collaborator

avullo commented Dec 2, 2022

@SebastianPopescu the PR is now failing on test coverage, mainly due to the untested GPflow customisations.
With a closer look, it seems there are components which have exact duplicates on GPflow, e.g. https://github.com/GPflow/GPflow/blob/develop/gpflow/kullback_leiblers.py

Why do we need to add them here?

Copy link
Collaborator

@hstojic hstojic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

provided some quick comments...
not sure what to do about testing those conditionals, posteriors etc

docs/notebooks/plotting_functions.py Show resolved Hide resolved
docs/notebooks/plotting_functions.py Show resolved Hide resolved
docs/notebooks/deep_cde.ipynb Show resolved Hide resolved
gpflux/architectures/factory.py Show resolved Hide resolved
gpflux/architectures/config.py Outdated Show resolved Hide resolved
gpflux/architectures/factory.py Show resolved Hide resolved
@@ -291,6 +311,12 @@ def as_prediction_model(
return model_class(self.inputs, outputs)


class OrthDeepGP(DeepGP):
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@avullo I'm a bit confused, do we really need this class at the end?

@avullo
Copy link
Collaborator

avullo commented Dec 12, 2022

provided some quick comments... not sure what to do about testing those conditionals, posteriors etc

I'm waiting for what @sc336 has to say, if he manages to move all this stuff to GPflow in GPflow/GPflow#2027

Comment on lines +193 to +204
"""
lista = [
>>>>>>> 53dae0f597e5aa12eea4bc13839a3c94807acd36
Cvv(ind_var_u, ind_var_v, k, L_Kuu=l_kuu)
for ind_var_u, ind_var_v, l_kuu, k in zip(
inducing_variable_u.inducing_variable_list,
inducing_variable_v.inducing_variable_list,
L_Kuu,
kernel.kernels,
)
]
"""
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of this block of text?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it's a leftover from a previous attempt, can be removed.

@uri-granta uri-granta removed their request for review March 16, 2023 09:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants