Problem with ZeroShotAgent.create_prompt()

[mattia-bolognesi]

I have a problem when running this script, basically gives an error on the ZeroAgent class:

prompt = ZeroShotAgent.create_prompt(
            tools,
            prefix=prefix,
            suffix=suffix,
            input_variables=["input", "chat_history", "agent_scratchpad"],
        )

The error is:

"ValidationError: 1 validation error for PromptTemplate _root_ Invalid prompt schema; check for mismatched or missing input parameters. {'input', 'agent_scratchpad', 'chat_history'} (type=value_error)".

[courtney-wright]

I am trying to do something similar by creating a custom prompt, but for a chat agent and am also having some trouble.

I don't think this function is meant to be accessed directly. If you trace it back, you can see that prompt is set to be created using this function in from_llm_and_tools. This means that the prompt for a ZeroShotAgent is always created from the template in prompt.py and calling the create_prompt function will not change this.

My guess on what is actually the issue here based on your error though, is that you didn't provide the proper variables in your template.

[courtney-wright]

to followup, maybe try something like this:

    agent = ZeroShotAgent.from_llm_and_tools(
        llm=ChatOpenAI(temperature=0, model_name="gpt-3.5-turbo"),
        tools=tools,
        verbose=True, 
        prefix=prefix,
        suffix=suffix
    )

[mattia-bolognesi]

Hey, thanks for your reply. I tried your code but actually I get the same error

ValidationError: 1 validation error for PromptTemplate __root__ Invalid prompt schema; check for mismatched or missing input parameters. {'input', 'agent_scratchpad'} (type=value_error)

[courtney-wright]

are you creating a prompt somewhere still? It's kind of difficult to say without seeing more of your code but my guess would be you either have a prompt defined somewhere else or you have added extra parameters in your prefix or suffix that cannot be handled by the create_prompt function.

Can you please provide more of your code including your prefix and suffix definition?

[mattia-bolognesi]

Here the code I am trying to run:

qa = RetrievalQA.from_chain_type(
            llm=OpenAI(openai_api_key=api),
            chain_type="stuff",
            retriever=index.as_retriever(),
        )

tools = [
            Tool(
                name="State of Union QA System",
                func=qa.run,
                description="Useful for when you need to answer questions about the aspects asked. Input may be a partial or fully formed question.",
            )
        ]

prefix = """Have a conversation with a human, answering the following questions as best you can based on the context and memory available. 
                You have access to a single tool:"""
suffix = """Begin!"""

prompt = ZeroShotAgent.from_llm_and_tools(
        llm=ChatOpenAI(temperature=0, model_name="gpt-3.5-turbo"),
        tools=tools,
        verbose=True, 
        prefix=prefix,
        suffix=suffix
    )