Is there any Python solution for a multi round history aware chat-based function?

[daibi]

Greetings.

Recently I was using Semantic Kernel to build an app for me. Basically with the help of the semantic function, I achieved a relatively low coupling project with independent semantic function that can be combined together. Thanks for the great job the team has done!

Now I am wondering if sk offers solution for a multi-round chat-based function? To be more specific, the semantic functions are independent with each other regarding to the conversation context with gpt-api. Consider a two step chat-based function that need the context awareness with some initial system instruction denoted as ${instruction}:

• At the first round the user asks a question ${user_Q} which may contain some sk functions for prompt rendering, the messages field sent to the gpt-3.5-turbo api should be like:

{
    "system": ${instruction},
    "user": ${user_Q}
}

Then the api returns an answer denoted as ${Round_1_answer} for as result of the first round query, the message recorded becomes:

{
    "system": ${instruction},
    "user": ${user_Q},
    "assistant": ${Round_1_answer}
}

Now for the second round, the prompt is hard coded in system with the placeholder blalalal {{$input}} blalala which is the default key as the last function's result in the chain-of-function implementation. Now the messages field sent to the gpt-3.5-turbo api becomes:

{
    "system": ${instruction},
    "user": ${user_Q},
    "assistant": ${Round_1_answer},
    "user": "blalalal {{$input}} blalala"
}

Finally the api's result in this round will be treated as result which will be returned to the user.

I tried with some walk arounds with the skfunction and ChatPromptTemplate but feel uncomfortable for the implementation.

Also maybe one can use a {{$history}} place holder update the history of the prompt, but this will easily transcend the token limitation. The split message list history can somehow escape the limitation.

Is there any more elegant solution for this problem?

Many thanks! :)

[glahaye]

Are you looking for something like the Copilot Chat: https://github.com/microsoft/semantic-kernel/tree/main/samples/apps/copilot-chat-app

[daibi]

Yeah something like this. But maybe the function is based on a two-round conversation where the second round consumes the output of the first round with some skfunction, without user's interference.

[evchaki]

@alexchaomander can you take a look at this one.