Skip to content

Commit

Permalink
fix TP crashes
Browse files Browse the repository at this point in the history
  • Loading branch information
kzawora-intel committed Jan 17, 2025
1 parent ce50b1a commit a128878
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion vllm/worker/hpu_worker.py
Original file line number Diff line number Diff line change
Expand Up @@ -222,7 +222,6 @@ def execute_model(
self,
execute_model_req: Optional[ExecuteModelRequest] = None,
) -> Optional[List[SamplerOutput]]:
assert execute_model_req is not None
# VLLM_HPU_LOG_STEP_GRAPH_COMPILATION - will log graph compilations per engine step, only when there was any - highly recommended to use alongside PT_HPU_METRICS_GC_DETAILS! # noqa:E501
# VLLM_HPU_LOG_STEP_GRAPH_COMPILATION_ALL - will log graph compilations per engine step, always, even if there were none # noqa:E501
# VLLM_HPU_LOG_STEP_CPU_FALLBACKS - will log cpu fallbacks per engine step, only when there was any # noqa:E501
Expand Down

0 comments on commit a128878

Please sign in to comment.