Skip to content

Commit

Permalink
fix bug
Browse files Browse the repository at this point in the history
  • Loading branch information
POI-WX committed Mar 19, 2024
1 parent 266e13d commit 08ae42d
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions deeplink_ext/internlm_ops/mha/mha.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,6 @@ def forward(self, qkv, causal=None, cu_seqlens=None, max_seqlen=None):
self.dropout_p if self.training else 0.0,
self.softmax_scale,
causal if causal is not None else self.causal,
False,
)
# else:
# # unpadded
Expand Down Expand Up @@ -89,7 +88,6 @@ def forward(
self.dropout_p if self.training else 0.0,
self.softmax_scale,
causal if causal is not None else self.causal,
False,
)
# else:
# # unpadded
Expand Down

0 comments on commit 08ae42d

Please sign in to comment.