Skip to content

Default to SDPA for faster VLlama PP T/s#927

Merged
EricLBuehler merged 2 commits intomasterfrom sdpa_use_vllamaNov 23, 2024
+15-3

Commits

Commits on Nov 22, 2024

Commits on Nov 23, 2024