Error: DspTransport.openSession qnn_open failed

[jds250]

Hello, I follow the tutorial https://github.com/quic/ai-hub-apps/tree/main/tutorials/llm_on_genie to deploy a Llama-2-7B-chat model on My Oneplus12 (24GB+1TB), and I met the error below:

01-05 15:23:12.072 29837 29837 E genie-t2t-run: vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:4247: Error 0x80000416: apps_dev_init failed for domain 3, errno Success, ioErr -2147482602
01-05 15:23:12.072 29837 29837 E genie-t2t-run: vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:4456: Error 0x80000416: open_dev (-1) failed for domain 3 (errno Success)
01-05 15:23:12.073 29837 29837 E genie-t2t-run: vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:1740: Error 0x80000416: remote_handle64_open failed for file:///libQnnHtpV75Skel.so?qnn_skel_handle_invoke&_modver=1.0&_dom=cdsp (errno Success)
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> DspTransport.openSession qnn_open failed, 0x80000416
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> IDspTransport: Unknown rpc status 0x00000016
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> DspTransport failed,cannot open session, error 0xffffffff
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Error from rpc transport. transportStatus = -1
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Failed to retrieve skel build id: err: 1003
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Failed to create transport for device, error: 4000
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Failed to load skel, error: 4000
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Transport layer setup failed: 14001
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Failed to parse default platform info: 14001
01-05 15:23:12.073 29837 29837 E QnnDsp  :  <E> Failed to parse platform config: 14001
01-05 15:23:12.188  6034  6072 E horae   : Entering notifyAmbientTemp, binder clients size 11

Since I run the command

./genie-t2t-run -c genie_config.json -p "<|begin_of_text|><|start_header_id|>user<|end_header_id|>\n\nWhat is France's capital?<|eot_id|><|start_header_id|>assistant<|end_header_id|>"

I guess I met some environment setup issue, my QNN SDK version is 2.27.0.240926 and ANDROID_NDK version is r26d.

[gustavla]

Hi @jds250, sorry about that! Let's take a look. A few things:

• What is your Android version (and build, if you know)?
• In your app bundle, make sure libQnnHtpV75Skel.so was copied over correctly.
• Double check your genie_config.json. Make sure both tokenizer.json and whatever your htp extension json file is called both exist and are in the same folder. Make sure the htp extension file has the right soc_model and dsp_arch set. If you want, you can post the content of these files here so that we can lend another pair of eyes to confirm.

If all those things check out, we'll have to keep digging. Thank you for your patience.

[jds250]

Hi @jds250, sorry about that! Let's take a look. A few things:

• What is your Android version (and build, if you know)?
• In your app bundle, make sure libQnnHtpV75Skel.so was copied over correctly.
• Double check your genie_config.json. Make sure both tokenizer.json and whatever your htp extension json file is called both exist and are in the same folder. Make sure the htp extension file has the right soc_model and dsp_arch set. If you want, you can post the content of these files here so that we can lend another pair of eyes to confirm.

If all those things check out, we'll have to keep digging. Thank you for your patience.

Hi, my Android NDK version is r26d, and I am sure libQnnHtpV75Skel.so is in my bundle. I am sorry I can't show the details at this moment , because I changed my device and It takes a bit long time to convert the model again.

I found that when I use another device like xiaomi 14 (I used a oneplus 12 before), this error didn't occur (not using ai hub, but executorch which I believe you both utilize the QNN), I think it's probably my device problem , but I didn't figure out the deeper reasons, maybe you can tell us and we can avoid this error when somebody else met.

[gustavla]

Hi @jds250, sorry for the late response. The key is what Android OS version you have. Genie SDK requires Android 15. Can you confirm that you have Android 15?

I wish we reported a better error if this requirement is not met. I am not even sure this is the error message it typically leads to, so there could be something else going on. If you are indeed on Android 15, we will have to keep digging.