Skip to content

Commit

Permalink
chore: enable input compression in llm use case
Browse files Browse the repository at this point in the history
  • Loading branch information
RomanBredehoft committed Apr 26, 2024
1 parent 9726072 commit 19d62c8
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion use_case_examples/llm/qgpt2_class.py
Original file line number Diff line number Diff line change
Expand Up @@ -183,7 +183,9 @@ def compile(self, configuration: Optional[Configuration] = None) -> Circuit:
compiler = fhe.Compiler(self.run_numpy, {"q_inputs": "encrypted"})

# Compile the circuit on the calibration quantized data
self.circuit = compiler.compile(inputset, configuration=configuration)
self.circuit = compiler.compile(
inputset, configuration=configuration, compress_input_ciphertexts=True
)

# Print the maximum bit-width reached in the circuit
print(
Expand Down

0 comments on commit 19d62c8

Please sign in to comment.