Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

[LLM Runtime]Fixed straightforward-API issues #80

Merged
merged 3 commits into from
Jan 22, 2024
Merged

Conversation

Zhenzhong1
Copy link
Contributor

@Zhenzhong1 Zhenzhong1 commented Jan 22, 2024

Type of Change

Bug fixed.

Description

  • Fixed tokenizer issues of straightforward APIs. (Only Qwen & Baichuan will be affected)
  • Fixed the quantize & inference path of one-click run.

image

Expected Behavior & Potential Risk

N/A

How has this PR been tested?

Manually

Dependency Change?

N/A

@VincyZhang VincyZhang added bug Something isn't working v0.2 labels Jan 22, 2024
Copy link
Contributor

@a32543254 a32543254 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Zhenzhong1 Zhenzhong1 changed the title [LLM Runtime]Fixed tokenizer issues of straightforward APIs [LLM Runtime]Fixed straightforward-API issues Jan 22, 2024
@VincyZhang VincyZhang merged commit 4c082b7 into main Jan 22, 2024
5 checks passed
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants