Skip to content

Commit

Permalink
Remove unnecessary verbose
Browse files Browse the repository at this point in the history
  • Loading branch information
EricLBuehler committed Feb 20, 2024
1 parent e53725e commit c74a3cf
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions src/xlora/xlora_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -88,15 +88,13 @@ def load_model(
device_map=device,
torch_dtype=dtype,
use_flash_attention_2=use_flash_attention_2,
verbose=verbose,
)
if hasattr(model.config, "use_cache"):
model.config.use_cache = False
tokenizer = AutoTokenizer.from_pretrained(
model_name,
trust_remote_code=True,
device_map=device,
verbose=verbose,
)
tokenizer.pad_token = tokenizer.eos_token
tokenizer.padding_side = "right"
Expand Down

0 comments on commit c74a3cf

Please sign in to comment.