Skip to content

Commit

Permalink
fix(test): expected result is different when model is compiled
Browse files Browse the repository at this point in the history
Compiled model results are not always very good. While this should be
better investigated later on, current solution is just to use the
non-compiled version. This results in some tests generating different
results, so expectations has been updated accordingly.
  • Loading branch information
tengomucho committed Jul 8, 2024
1 parent ff2a1a5 commit 50a4513
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion text-generation-inference/tests/test_decode.py
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ def test_decode_single(params):
DecodeTestParams(
model_id="google/gemma-7b",
sequence_length=128,
expected_text="\n\nThe time is 1984. The place is Airstrip One, the British",
expected_text="\n\nThe first line of George Orwell’s <em>1984</em> is a perfect example",
),
DecodeTestParams(
model_id="mistralai/Mistral-7B-v0.3",
Expand Down

0 comments on commit 50a4513

Please sign in to comment.