You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hey , first of all thank you for your time and your energy.
I'm wondering why did you paste the 5 loop steps in your code to generate the response knowing that this loop is used only for terminal interaction with the user ?
thank you
my suggestion to your code
def get_Chat_response(text):
# encode the new user input, add the eos_token and return a tensor in Pytorch
new_user_input_ids = tokenizer.encode(str(text) + tokenizer.eos_token, return_tensors='pt')
# append the new user input tokens to the chat history
bot_input_ids = torch.cat([chat_history_ids, new_user_input_ids], dim=-1)
# generated a response while limiting the total chat history to 1000 tokens,
chat_history_ids = model.generate(bot_input_ids, max_length=1000, pad_token_id=tokenizer.eos_token_id)
# pretty print last ouput tokens from bot
return tokenizer.decode(chat_history_ids[:, bot_input_ids.shape[-1]:][0], skip_special_tokens=True)
The text was updated successfully, but these errors were encountered:
Hey , first of all thank you for your time and your energy.
I'm wondering why did you paste the 5 loop steps in your code to generate the response knowing that this loop is used only for terminal interaction with the user ?
thank you
my suggestion to your code
The text was updated successfully, but these errors were encountered: