Upgrade Granite Model Template to granite-3.1

[maysunfaisal]

What does this PR do?:

• Upgrades granite model to granite-3.1
• adopts vllm 0.6.6 image as it supports granite-3.1
• vllm 0.6.6 image PR vllm 0.6.6 developer-images#26
• vllm 0.6.6 image repo https://quay.io/repository/redhat-ai-dev/vllm-openai-ubi9?tab=tags

Which issue(s) this PR fixes:

https://issues.redhat.com/browse/RHDHPAI-494

PR acceptance criteria:

Testing and documentation do not need to be complete in order for this PR to be approved. We just need to ensure tracking issues are opened and linked to this PR, if they are not in the PR scope due to various constraints.

• Tested and Verified

• Documentation (READMEs, Product Docs, Blogs, Education Modules, etc.)

How to test changes / Special notes to the reviewer:

Use the template for testing https://github.com/maysunfaisal/ai-lab-template/blob/494-1_temp1_PRTEST/templates/model-server/template.yaml

[Jdubrick]

lgtm, I will review the PR on dev images as well once the PR check passes. We should think about merging dev images first before this so that the image is present in the quay repo

[maysunfaisal]

lgtm, I will review the PR on dev images as well once the PR check passes. We should think about merging dev images first before this so that the image is present in the quay repo

@Jdubrick I manually pushed the image to the repo as I had to test the image

[Jdubrick]

lgtm, I will review the PR on dev images as well once the PR check passes. We should think about merging dev images first before this so that the image is present in the quay repo

@Jdubrick I manually pushed the image to the repo as I had to test the image

Ah yeah I see it in the repo now, this should be good then