Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rnllama/rn-llama.h file not found in new 0.5.0 version #115

Closed
MekkCyber opened this issue Jan 24, 2025 · 5 comments
Closed

rnllama/rn-llama.h file not found in new 0.5.0 version #115

MekkCyber opened this issue Jan 24, 2025 · 5 comments

Comments

@MekkCyber
Copy link

MekkCyber commented Jan 24, 2025

Hi ! With the new 0.5.0 version I have the following error :

Image

Any idea what could be the reason ? Thanks for the help

PS : seems related to this update : #112

@jhen0409
Copy link
Member

jhen0409 commented Jan 24, 2025

Could you able to check if rnllama.xcframework is correctly imported in your project? Usually it will be imported by pod install.

Pods:
Image

@MekkCyber
Copy link
Author

Yes it was a pod install problem ! sorry i'm new to this 😅 and thank you for the help ! However I am getting gibberish from the model when i use it in my app any idea why ?

@jhen0409
Copy link
Member

Yes it was a pod install problem ! sorry i'm new to this 😅 and thank you for the help ! However I am getting gibberish from the model when i use it in my app any idea why ?

Which device and model & quantization do you use?

@MekkCyber
Copy link
Author

MekkCyber commented Jan 24, 2025

I am using an ios simulator with an fp16 gguf deepseek-r1-qwen 1.5B model

@jhen0409
Copy link
Member

OK, I did see the issue with the model on iOS simulator (it skipped Metal), but it works on real device.

Also, the main issue seems be caused by llama.cpp, I can reproduce with -DGGML_METAL=OFF on llama-cli. I'll open another issue to track it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants