Skip to content

Commit

Permalink
Fix: cannot find kv_cache
Browse files Browse the repository at this point in the history
  • Loading branch information
JinBridger committed Nov 6, 2023
1 parent d475d6a commit 01b2e87
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions python/llm/portable-zip/chat.py
Original file line number Diff line number Diff line change
Expand Up @@ -43,6 +43,8 @@
import argparse
import sys

sys.path.append(".")

# todo: support more model class
from transformers import AutoModel, AutoModelForCausalLM, AutoTokenizer, AutoConfig
from transformers import TextIteratorStreamer
Expand Down

0 comments on commit 01b2e87

Please sign in to comment.