Can Unsloth support be expected soon ?

[Cognitus-Stuti]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain.llms

Description

I'm trying to use langchain with unsloth Fastmodel but it's not working

System Info

na

[sepiatone]

Are you trying to use a Unsloth finetuned model for inference? Perhaps you could run them through LangChain's LLamaCpp interface?

[slavanorm]

Not my code but have a look.

https://github.com/shahidul034/LLM-and-Langchain-Tutorial-and-resources