Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fallback of jit compilation #2

Open
MBPhys opened this issue Aug 5, 2022 · 3 comments
Open

Fallback of jit compilation #2

MBPhys opened this issue Aug 5, 2022 · 3 comments

Comments

@MBPhys
Copy link

MBPhys commented Aug 5, 2022

Hi,

first of all, congratulation to this amazing project 😄
Unfortunately the jit compilation doesn't work. There is a fallback.

image

It seems that the Bound_class is the problem, because it is not a tensor directly.

Do you have an idea how we can fix them?

Best regards

Marc

@balbasty
Copy link
Owner

balbasty commented Aug 9, 2022

Hi Marc

Thanks for reporting this. Could you please tell me which version of PyTorch (and which platform) you are using?

(edit: and how you call the function: inputs, etc)

Thanks
Yael

@balbasty
Copy link
Owner

balbasty commented Sep 2, 2022

This issue seems to be related to pytorch/pytorch#82889
It only happens in recent versions of pytorch (I reproduced it on 1.12, but I don't know when it was introduced).

In the meantime, the suggested workaround (set the environment variable PYTORCH_JIT_USE_NNC_NOT_NVFUSER=1) seems to work.
I could set it from inside torch-interpol (on import) but I am not sure it's the best solution.

@ZacharyVarley
Copy link

Too add, I also was having some issues with NVFUSER but torch 2.0.X seems to have fixed whatever the issue was.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants