add chat support for nvidia/usdcode-llama-3.1-70b-instruct and meta/llama-3.3-70b-instruct #492

Job	Run time
build	29s
build	29s
cd libs/ai-endpoints / make lint #3.8	36s
cd libs/ai-endpoints / make lint #3.8	40s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.8	33s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.8	33s
cd libs/ai-endpoints / make lint #3.11	39s
cd libs/ai-endpoints / make lint #3.11	39s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.9	25s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.9	25s
cd libs/ai-endpoints / make test #3.8	17s
cd libs/ai-endpoints / make test #3.8	17s
cd libs/ai-endpoints / make test #3.9	27s
cd libs/ai-endpoints / make test #3.9	27s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.10	27s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.10	27s
cd libs/ai-endpoints / make test #3.10	26s
cd libs/ai-endpoints / make test #3.10	26s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.11	23s
cd libs/ai-endpoints / poetry run pytest -m compile tests/integration_tests #3.11	23s
cd libs/ai-endpoints / make test #3.11	17s
cd libs/ai-endpoints / make test #3.11	17s
CI Success	1s
CI Success	1s
	10m 4s

Provide feedback