You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have searched the Issue Tracker that this hasn't already been reported. (+1 or comment there if it has.)
Motivation
Current Benchmark class in coupled with GraphEvaluator and Multiple Environment features. While uses may want to use the environments only without evaluation.
Solution
The Benchmark should be divided into two classs:
Benchmark class is reponsible for organizing Tasks and Evaluators
MultiEnvironment class is responsible for manage agent intreaction with multiple environments
Users can use MultiEnvironment class with agents to operate environments without evaluators.
Additional context
No response
The text was updated successfully, but these errors were encountered:
Required prerequisites
Motivation
Current
Benchmark
class in coupled withGraphEvaluator
and MultipleEnvironment
features. While uses may want to use the environments only without evaluation.Solution
The
Benchmark
should be divided into two classs:Benchmark
class is reponsible for organizing Tasks and EvaluatorsMultiEnvironment
class is responsible for manage agent intreaction with multiple environmentsUsers can use
MultiEnvironment
class with agents to operate environments without evaluators.Additional context
No response
The text was updated successfully, but these errors were encountered: