Skip to content

Commit

Permalink
Update backtesting.mdx
Browse files Browse the repository at this point in the history
  • Loading branch information
isahers1 authored Dec 19, 2024
1 parent 2488288 commit 88de03a
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions docs/evaluation/tutorials/backtesting.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -226,7 +226,6 @@ gpt_4o = ChatOpenAI(model="gpt-4o")
new_agent = create_react_agent(gpt_4o, tools=tools, state_modifier=modifier)

def new_target(inputs):
rate_limiter.acquire()
raw = new_agent.invoke(inputs)
return {"messages": convert_to_openai_messages(raw['messages'])}

Expand Down Expand Up @@ -255,4 +254,4 @@ which GPT-4o is better than GPT-3.5:
This was a simple example to show how you could backtest your production system against a new system.
There are many different ways to do this backtesting, including using targeted filters
to select the production runs you want to improve on, or using human preference
data instead of evlautors defined in code.
data instead of evlautors defined in code.

0 comments on commit 88de03a

Please sign in to comment.