Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error bootstrapping model shown in example #349

Open
devpramod opened this issue Apr 18, 2024 · 0 comments
Open

Error bootstrapping model shown in example #349

devpramod opened this issue Apr 18, 2024 · 0 comments

Comments

@devpramod
Copy link

devpramod commented Apr 18, 2024

I get the following error when I try to run the bootstrapping code shown in the example that uses google/flan-t5-small

<function register_backend_type at 0x7f14529c7130> is still in the BETA phase and subject to change!
Exception ignored in: <function TextGeneration.__del__ at 0x7f12f291b880>
Traceback (most recent call last):
  File "/home/pramod/projects/embeddings_server/wrapped_sentence_transformer/PR/caikit-nlp/caikit_nlp/modules/text_generation/text_generation_local.py", line 120, in __del__
TypeError: 'NoneType' object is not callable
  • Interpreter version: Python 3.10.14
  • Library version: caikit-nlp-0.4.9.dev2+gc12cb82

Code snippet used:

import os
# The env var ALLOW_DOWNLOADS has to be set to allow model downloads before importing caikit_nlp
os.environ['ALLOW_DOWNLOADS'] = "1"

import caikit_nlp

model_name = "google/flan-t5-small"
model = caikit_nlp.text_generation.TextGeneration.bootstrap(model_name)
model.save(f"{model_name}-caikit") # optionally save the model
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant