Skip to content

Commit

Permalink
remove pdb
Browse files Browse the repository at this point in the history
  • Loading branch information
grimoire committed Mar 5, 2024
1 parent 5983223 commit 8476f5b
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions lmdeploy/pytorch/engine/engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -671,8 +671,6 @@ async def __long_context_forward(inputs):
while idx < batch_size:
slen = seq_len[idx]
if token_count == 0 and slen > max_prefill_token_num:
import pdb
pdb.set_trace()
tmp_out = await __long_context_single_forward(inputs, idx)
logits_gather.gather(tmp_out)
del tmp_out
Expand Down

0 comments on commit 8476f5b

Please sign in to comment.