why so slow when I run rag_stragegyQA

[yubin1991]

llm: llama3
rap strageqa

the first question takes more than 1 hours runing on A100

[Ber666]

Hi,

It's possible that llama3 doesn't stop generation in time due to the tokenization change. Though we have updated several examples (e.g., CoT), we haven't got time to go through every example in our library. Could you try looking at the tokenization if it's urgent?

[yubin1991]

Hi,

It's possible that llama3 doesn't stop generation in time due to the tokenization change. Though we have updated several examples (e.g., CoT), we haven't got time to go through every example in our library. Could you try looking at the tokenization if it's urgent?

yes, the problem fixed when i replace the eos_id. thanks

[Ber666]

Glad to hear that! Let me know if there are any other problems.