This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

Migrate SQ and WOQ to INC 3.x API. #5023

Job	Run time
call-inference-llama-2-7b-chat-hf / inference test	4m 0s
call-inference-mpt-7b-chat / inference test	14m 33s
	18m 33s

Provide feedback