Code

Enable qwen2vl video#2756

Code

Open

drbh wants to merge 54 commits intomainhuggingface/text-generation-inference:mainfrom enable-qwen2vl-videohuggingface/text-generation-inference:enable-qwen2vl-videoCopy head branch name to clipboard

+743-65

Commits

Commits on Dec 23, 2024

• WIP video support

  

  mfarre

  authored and

  drbh

  committed
  18c9f06

  Copy full SHA for 18c9f06

• router changes

  

  mfarre

  authored and

  drbh

  committed
  7c67939

  Copy full SHA for 7c67939

• adopting video url

  

  mfarre

  authored and

  drbh

  committed
  5ced960

  Copy full SHA for 5ced960

• connecting video to qwen2

  

  mfarre

  authored and

  drbh

  committed
  05464d2

  Copy full SHA for 05464d2

• fix

  

  mfarre

  authored and

  drbh

  committed
  c7c2fda

  Copy full SHA for c7c2fda

• downloading videos

  

  mfarre

  authored and

  drbh

  committed
  b9c8152

  Copy full SHA for b9c8152

• fix

  

  mfarre

  authored and

  drbh

  committed
  464609f

  Copy full SHA for 464609f

• refactoring

  

  mfarre

  authored and

  drbh

  committed
  a25c3ec

  Copy full SHA for a25c3ec

• fix

  

  mfarre

  authored and

  drbh

  committed
  3c07391

  Copy full SHA for 3c07391

• feat: support video input chunks and enable qwen2 vl to process video

  drbh

  committed
  b2c5575

  Copy full SHA for b2c5575

• fix: add protobuf update and mp4parse dep

  drbh

  committed
  83a7f18

  Copy full SHA for 83a7f18

• fix: remove unused deps and imports

  drbh

  committed
  322165d

  Copy full SHA for 322165d

• moving video sampling and resize to validation. downstream we receive frames

  

  mfarre

  authored and

  drbh

  committed
  e65ead1

  Copy full SHA for e65ead1

• flatten frames to data block when needed

  

  mfarre

  authored and

  drbh

  committed
  36e095b

  Copy full SHA for 36e095b

• fix: adjust video process, reduce to 1 fps and adjust tensor shape

  drbh

  committed
  bc5e202

  Copy full SHA for bc5e202

• fix: adjust deps after rebase

  drbh

  committed
  1afaa69

  Copy full SHA for 1afaa69

• feat: adjust impure shell deps and autodocs workflow

  drbh

  committed
  16007b6

  Copy full SHA for 16007b6

• fix: include more deps for ffmpeg as docs suggest

  drbh

  committed
  39fac7e

  Copy full SHA for 39fac7e

• fix: add ffmpeg deps to test build

  drbh

  committed
  b508b10

  Copy full SHA for b508b10

• fix: debug ffmpeg install in tests workflow

  drbh

  committed
  4a3a724

  Copy full SHA for 4a3a724

• fix: debug ffmpeg deps in tests II

  drbh

  committed
  ac7483c

  Copy full SHA for ac7483c

• fix: adjust dependencies and bump pip along with python

  drbh

  committed
  137f3bb

  Copy full SHA for 137f3bb

• fix: adjust pkg config in test

  drbh

  committed
  daf83a9

  Copy full SHA for daf83a9

• fix: ensure pip is installed after installing deps in test workflow

  drbh

  committed
  d5cc670

  Copy full SHA for d5cc670

• fix: add libavfilter dep to test

  drbh

  committed
  4a76e8b

  Copy full SHA for 4a76e8b

• fix: add libavdevice dep to tests workflow

  drbh

  committed
  f0c3841

  Copy full SHA for f0c3841

• fix: add ffmpeg overlay and enable build

  drbh

  committed
  96968a0

  Copy full SHA for 96968a0

• fix: include ffmpeg deps in autodocs workflow

  drbh

  committed
  167c6f0

  Copy full SHA for 167c6f0

• Cleanup impure Nix shell

  

  danieldk

  authored and

  drbh

  committed
  98392a7

  Copy full SHA for 98392a7

• Make the pure build work

  

  danieldk

  authored and

  drbh

  committed
  05004a6

  Copy full SHA for 05004a6

• Fix test devshell

  

  danieldk

  authored and

  drbh

  committed
  063104c

  Copy full SHA for 063104c

• fix: bump deps in other dockerfiles

  drbh

  committed
  2dc078a

  Copy full SHA for 2dc078a

• fix: add ffmpeg to final layer of container

  drbh

  committed
  50b5399

  Copy full SHA for 50b5399

• fix: include usr lib in ld path

  drbh

  committed
  b5b2184

  Copy full SHA for b5b2184

• fix: copy shared libraries from builder

  drbh

  committed
  75ab887

  Copy full SHA for 75ab887

• installing ssl requirements prior to rust building stage

  

  mfarre

  authored and

  drbh

  committed
  cbf1d98

  Copy full SHA for cbf1d98

• fixing ssl issue

  

  mfarre

  authored and

  drbh

  committed
  af77a0c

  Copy full SHA for af77a0c

• working version

  

  mfarre

  authored and

  drbh

  committed
  19e1c8d

  Copy full SHA for 19e1c8d

• cleanup prints

  

  mfarre

  authored and

  drbh

  committed
  db97d97

  Copy full SHA for db97d97

• fix: pre commit and clippy lints

  drbh

  committed
  71ed75a

  Copy full SHA for 71ed75a

• fix: resolve rebase issues and add test

  drbh

  committed
  e2b75a5

  Copy full SHA for e2b75a5

• fix: remove unnecessary cast

  drbh

  committed
  1d6bf24

  Copy full SHA for 1d6bf24

• fix: update all vlm forward args, pass shared libraries to final layer in docker and doc bump

  drbh

  committed
  2ae152a

  Copy full SHA for 2ae152a

• fix: adjust batch_tokenized_inputs output in mllama

  drbh

  committed
  5c7bc91

  Copy full SHA for 5c7bc91

• fix: update lints after rebase

  drbh

  committed
  bb00fb3

  Copy full SHA for bb00fb3

• fix: update trtllm dockefile after rebase

  drbh

  committed
  91ed362

  Copy full SHA for 91ed362

• fix: adjust whitespace lint

  drbh

  committed
  5322abd

  Copy full SHA for 5322abd

• fix: feature flag video and remove from non cuda dockerfiles

  drbh

  committed
  b4da6ad

  Copy full SHA for b4da6ad

• fix: make ffmpeg-next dep optional with feature

  drbh

  committed
  27f758d

  Copy full SHA for 27f758d

• fix: include the video feature in cargo chef command

  drbh

  committed
  4f42d0c

  Copy full SHA for 4f42d0c

• fix: adjust trtllm looper for video chunk enum

  drbh

  committed
  dcc1194

  Copy full SHA for dcc1194

Commits on Jan 3, 2025

• fix: small refactor and cleanups

  drbh

  committed
  b27749e

  Copy full SHA for b27749e

Commits on Jan 16, 2025

• fix: improve video processing and update unsupported paths

  drbh

  committed
  78cd756

  Copy full SHA for 78cd756

Commits on Jan 17, 2025

• fix: remove test debug params

  drbh

  committed
  17192c9

  Copy full SHA for 17192c9