You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[x] I checked the documentation and related resources and couldn't find an answer to my question.
Your Question
Running the example code for LLM based metric, I run into issues with await. Not sure if this is a bug or not. Running a non-async version works fine.
Code Examples
metric=AspectCritic(
name="summary_accuracy",
llm=evaluator_llm,
definition="Verify if the summary is accurate.",
)
test_data=SingleTurnSample(**test_data)
awaitmetric.single_turn_score(test_data) <---SyntaxError: 'await'outsidefunctionmetric.single_turnscore(test_data) <---Thisworksfine
The text was updated successfully, but these errors were encountered:
[x] I checked the documentation and related resources and couldn't find an answer to my question.
Your Question
Running the example code for LLM based metric, I run into issues with await. Not sure if this is a bug or not. Running a non-async version works fine.
Code Examples
The text was updated successfully, but these errors were encountered: