Code

feat: support QNN#1

Code

Open

hans00 wants to merge 27 commits intomainmybigday/llama.node:mainfrom qnnmybigday/llama.node:qnnCopy head branch name to clipboard

+5,757-3

Commits

Commits on Apr 30, 2024

• feat: trying support QNN

  hans00

  committed
  5e9ac90

• fix: fix parameter fill

  hans00

  committed
  d5a62f7

Commits on May 1, 2024

• fix: fix windows build

  hans00

  committed
  a7a3099

• fix: fix binary copy files

  hans00

  committed
  71eefd4

• feat: setup env before binding load

  hans00

  committed
  a044dbc

Commits on May 3, 2024

• feat: increase limit to capable Llama 7B

  hans00

  committed
  6058861

• chore: reduce log

  hans00

  committed
  e0693de

• chore: change backend order

  hans00

  committed
  2b7cd15

• ci: test all platforms

  hans00

  committed
  6a7ed61

• fix: fix missing file for Metal

  hans00

  committed
  03571c7

• fix: only copy libqnnhtpv73.cat for Windows

  hans00

  committed
  e1c07b8

• fix: force GGML artifacts output to bin dir

  hans00

  committed
  6467e34

• fix: fix lib output

  hans00

  committed
  7b0a5ad

• chore: remove set CMAKE_RUNTIME_OUTPUT_DIRECTORY

  hans00

  committed
  7d2a054

• fix: fix metal binary deploy

  hans00

  committed
  b65e516

• test: change test model to bypass OP problem

  hans00

  committed
  478cc73

• feat: support multiple variant load

  hans00

  committed
  3a4c2ef

• test: disable GPU to fixed test result

  hans00

  committed
  149ba90

• Revert "test: change test model to bypass OP problem"

  Show description for e507eae
  hans00

  committed
  e507eae

• revert: use post build command to copy binary

  hans00

  committed
  fa7321f

• feat: support auto setup Windows env

  hans00

  committed
  3fd2471

• refactor: let system auto find so/dll

  hans00

  committed
  12d1e3a

• refactor: make QNN log to stderr (sync behavior with llama.cpp)

  hans00

  committed
  d4d4e97

Commits on May 4, 2024

• Merge branch 'main' into qnn

  hans00

  committed
  38d4de9

Commits on May 5, 2024

• Merge branch 'main' into qnn

  hans00

  authored
  225c7c6

Commits on May 7, 2024

• Merge branch 'main' into qnn

  hans00

  authored
  0777434

• fix: fix patch step

  hans00

  authored
  575219e