glm-4v, A770, got error " RuntimeError: probability tensor contains either inf, nan or element < 0"

[aixiwangintel]

glm-4v, A770, got error " RuntimeError: probability tensor contains either inf, nan or element < 0"

test sample image:

[aixiwangintel]

prompt: describe the image. sample image is from internet.

[qiuxin2012]

I try your prompt and image with https://github.com/intel/ipex-llm/tree/main/python/llm/example/GPU/HuggingFace/Multimodal/glm-4v, it works fine.

Our glm-4v model is downloaded in Aug 6 2024. I will try the latest glm-4v later.

[qiuxin2012]

@aixiwangintel I have tried the latest glm-4v-9b. It works fine too. Are you using https://github.com/intel/ipex-llm/blob/main/python/llm/example/GPU/HuggingFace/Multimodal/glm-4v/generate.py?

[aixiwangintel]

New update:
-n-predict 128 works, but other configurations meet fails.