Skip to content

v0.3.0

Compare
Choose a tag to compare
@baijumeswani baijumeswani released this 21 Jun 21:23
· 1 commit to rel-0.3.0 since this release
964eb65

Release Notes

  • Phi-3 Vision model support for DML EP.
  • Addressed DML memory leak issue and crashes on long prompts.
  • Addressed crashes and slowness on CPU EP GQA on long prompts due to integer overflow issues.
  • Added the import lib for windows C API package.
  • Addressed a bug with get_output('logits') so that it returns the logits for the entire prompt and not for the last generated token.
  • Addressed a bug with querying the device type of the model so that it won't crash.
  • Added NetStandard 2.0 compatibility.