Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Jul 9, 2024
1 parent 429424f commit 8ba28b8
Showing 1 changed file with 2 additions and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -538,7 +538,7 @@ def evaluate(
_higher_is_better[m] = h
if m in _higher_is_better and _higher_is_better[m] is not None and _higher_is_better[m] != h:
eval_logger.warning(
f"Higher_is_better values for metric {m} in group {group} are not consistent." +
f"Higher_is_better values for metric {m} in group {group} are not consistent." +
f"Defaulting to None."
)
_higher_is_better[m] = None
Expand Down Expand Up @@ -571,7 +571,7 @@ def evaluate(
# TODO: allow GroupConfigs to choose which variance formula is used, for back-compatibility
# To use the old (likely incorrect) variance formula,
# comment out the above and uncomment this line:
# results[group][stderr] = lm_eval.api.metrics.combined_sample_stderr(stderrs,
# results[group][stderr] = lm_eval.api.metrics.combined_sample_stderr(stderrs,
# sizes, metrics=metrics)

results[group]["samples"] = sum(sizes)
Expand Down

0 comments on commit 8ba28b8

Please sign in to comment.