Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ai 对话搜索结果太少, 答非所问, 润色功能添加奇怪符号, 希望可以自定义 prompt || ai There are too few dialogue search results, and the answers are incorrect. The polish function adds strange symbols. I hope the prompt can be customized. #217

Closed
LiangWei88 opened this issue Dec 1, 2024 · 5 comments
Labels
bug Something isn't working

Comments

@LiangWei88
Copy link

LiangWei88 commented Dec 1, 2024

ai 连接的是千问32b的模型, 嵌入是网易 b3m 模型
使用ai提问搜索的时候, 答非所问, 然后给出的相关记录太少.

另外在输出润色的功能上老是给出一些转义字符, 保存后形成 /Blinko/ 之类的斜杠符号
说不定是模型问题, 希望可以自己自定义 prompt 进行调试

目前最好用的功能是 ai 标签
另外一个就是占用的 内存越来越高了, 数据库 50-70m正常
本体目测基本超过200, 如果能少一些就好了

不过这的确是一个很好的软件. 辛苦大佬了.

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.


The ai is connected to the Qianwen 32b model, and the embedded model is the NetEase b3m model.
When using AI to ask questions and search, the answers are incorrect and too few relevant records are given.

In addition, the output polishing function always provides some escape characters, which form slash symbols such as /Blinko/ after saving.
Maybe it's a model problem. I hope I can customize the prompt for debugging.

The best feature currently is the ai tag
The other thing is that the memory occupied is getting higher and higher. The database is 50-70m normal.
The visual inspection of the main body is basically over 200. It would be better if it could be less.

But this is indeed a very good software. Thank you for your hard work.

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior
A clear and concise description of what you expect to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Version [e.g. 22]

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

@github-actions github-actions bot changed the title ai 对话搜索结果太少, 答非所问, 润色功能添加奇怪符号, 希望可以自定义 prompt ai 对话搜索结果太少, 答非所问, 润色功能添加奇怪符号, 希望可以自定义 prompt || ai There are too few dialogue search results, and the answers are incorrect. The polish function adds strange symbols. I hope the prompt can be customized. Dec 1, 2024
@dosubot dosubot bot added the bug Something isn't working label Dec 1, 2024
@BryceWG
Copy link

BryceWG commented Dec 2, 2024

设置有topk和score阈值设置,你可以自己改一下


There are topk and score threshold settings, you can change them yourself

@LiangWei88
Copy link
Author

设置有topk和score阈值设置,你可以自己改一下

There are topk and score threshold settings, you can change them yourself

感谢回复,经测试的确发挥了作用,现在已经能够顺利搜索到内容了。

我尝试使用了千问 2.5 14b 和 google gemma 27b 模型,在此过程中主要遇到了两个虽有些纠结但能使用的问题:

  • 当我仅想找到相关笔记时,它会给出大量其他建议。
  • 在扩写的时候,会添加许多 符号。

我对代码进行了克隆并查看,发现这些问题似乎都是在 prompt 层面注入的。我在想,如果能够提供选择使用默认 prompt 或者自定义 prompt 的功能就更好了。另外,想了解一下目前是否有第三方插件的功能或者相关的预期计划呢?这样或许就能够按照自身需求进行改动了。

image
image
image
image

@BryceWG
Copy link

BryceWG commented Dec 2, 2024

我觉得你可以试试更好的问答模型,embedding模型也可以更换,比如bge-m3


I think you can try a better question and answer model, and the embedding model can also be changed, such as bge-m3

@blinko-space
Copy link
Owner

blinko-space commented Dec 5, 2024

v17.0.1已经优化ai写作


v17.0.1 has optimized ai writing

@LiangWei88
Copy link
Author

v17.0.1已经优化ai写作

v17.0.1 has optimized ai writing

太厉害了, 感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants