Code

reduce inference memory of vit#819

Code

Merged

hiworldwzj merged 12 commits intomainModelTC/lightllm:mainfrom

vit_memoryModelTC/lightllm:vit_memoryCopy head branch name to clipboard

Apr 9, 2025

Commits

Commits on Apr 9, 2025

• add mps for multimodal

  

  baishihao

  committed
  d478151

  Copy full SHA for d478151

• update

  

  baishihao

  committed
  7371792

  Copy full SHA for 7371792

• fix

  hiworldwzj

  authored
  08d8960

  Copy full SHA for 08d8960

• reformat

  

  baishihao

  committed
  4f81039

  Copy full SHA for 4f81039

• reduce vit gpu memory

  

  baishihao

  committed
  a721cfb

  Copy full SHA for a721cfb

• vit memory

  

  baishihao

  committed
  da102a2

  Copy full SHA for da102a2

• Merge branch 'main' into vit_memory

  

  baishihao

  committed
  8066492

  Copy full SHA for 8066492

• fix

  

  baishihao

  committed
  e875e75

  Copy full SHA for e875e75

• fix

  hiworldwzj

  authored
  c73e968

  Copy full SHA for c73e968

• modify default value for cache tensor

  

  baishihao

  committed
  550f2a7

  Copy full SHA for 550f2a7

• Merge branch 'vit_memory' of https://github.com/ModelTC/lightllm into vit_memory

  

  baishihao

  committed
  453172a

  Copy full SHA for 453172a

• fix

  hiworldwzj

  authored
  a08a4a6

  Copy full SHA for a08a4a6