Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 21, 2024

• [V1] Make AsyncLLMEngine v1-v0 opaque (vllm-project#11383)

  Show description for 584f0ae
  rickyyx

  authored
  584f0ae

• [Bugfix] update should_ignore_layer (vllm-project#11354)

  Show description for 51ff216
  horheynm

  authored
  51ff216

• [V1][Bugfix] Skip hashing empty or None mm_data (vllm-project#11386)

  Show description for dd2b563
  WoosukKwon

  authored
  dd2b563

Commits on Dec 20, 2024

• Add ray[default] to wget to run distributed inference out of box (vllm-project#11265)

  Show description for 47a0b61
  Jeffwan

  authored
  47a0b61

• [doc] explain nccl requirements for rlhf (vllm-project#11381)

  Show description for 5d2248d
  youkaichao

  authored
  5d2248d

• [Bugfix] Don't log OpenAI field aliases as ignored (vllm-project#11378)

  Show description for d573aea
  mgoin

  authored
  d573aea

• [Core] Loading model from S3 using RunAI Model Streamer as optional loader (vllm-project#10192)

  Show description for 995f562
  omer-dayan

  authored
  995f562

• [CI/Build] fix pre-compiled wheel install for exact tag (vllm-project#11373)

  Show description for 7c7aa37
  dtrifiro

  authored
  7c7aa37

• [V1] Fix profiling for models with merged input processor (vllm-project#11370)

  Show description for 04139ad
  ywang96

  authored
  04139ad

• [doc] backward compatibility for 0.6.4 (vllm-project#11359)

  Show description for 1ecc645
  youkaichao

  authored
  1ecc645

• [misc] add early error message for custom ops (vllm-project#11355)

  Show description for c954f21
  youkaichao

  authored
  c954f21

• [Bugfix] Fix spec decoding when seed is none in a batch (vllm-project#10863)

  Show description for 86c2d8f
  wallashss

  authored
  86c2d8f

• [Misc] Add tqdm progress bar during graph capture (vllm-project#11349)

  Show description for b880ffb
  mgoin

  authored
  b880ffb

• [ci][gh200] dockerfile clean up (vllm-project#11351)

  Show description for 7801f56
  

  3 peopleauthored
  7801f56

• [Bugfix][Hardware][POWERPC] Fix auto dtype failure in case of POWER10 (vllm-project#11331)

  Show description for 48edab8
  Akashcodes732

  authored
  48edab8

Commits on Dec 19, 2024

• [CI] Adding CPU docker pipeline (vllm-project#11261)

  Show description for a985f7a
  

  zhouyuan

  and

  khluu

  authored
  a985f7a

• [Misc] Remove unused vllm/block.py (vllm-project#11336)

  Ghjk94522

  authored
  e461c26

• [Bugfix] Fix broken CPU compressed-tensors test (vllm-project#11338)

  Show description for 276738c
  Isotr0py

  authored
  276738c

• [Misc] Clean up and consolidate LRUCache (vllm-project#11339)

  Show description for cdf22af
  DarkLight1337

  authored
  cdf22af

• [Model] Refactor Qwen2-VL to use merged multimodal processor (vllm-project#11258)

  Show description for e24113a
  

  Isotr0py

  and

  DarkLight1337

  authored
  e24113a

• [V1] Fix multimodal profiling for Molmo (vllm-project#11325)

  Show description for 7379b3d
  

  ywang96

  and

  ywang96

  authored
  7379b3d

• [Model] Add JambaForSequenceClassification model (vllm-project#10860)

  Show description for 6c7f881
  

  3 peopleauthored
  6c7f881

• [Bugfix] Cleanup Pixtral HF code (vllm-project#11333)

  Show description for a0f7d53
  DarkLight1337

  authored
  a0f7d53

• [Feature] Add load generation config from model (vllm-project#11164)

  Show description for 5aef498
  

  liuyanyi

  and

  DarkLight1337

  authored
  5aef498

• [misc] benchmark_throughput : Add LoRA (vllm-project#11267)

  Show description for 9835673
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  9835673

• [Misc] Optimize ray worker initialization time (vllm-project#11275)

  Show description for f26c4ae
  

  ruisearch42

  and

  comaniac

  authored
  f26c4ae

• [Kernel] Refactor Cutlass c3x (vllm-project#10049)

  Show description for 8936316
  

  varun-sundar-rabindranath

  and

  Varun Sundar Rabindranath

  authored
  8936316

• [VLM] Merged multimodal processor for Qwen2-Audio (vllm-project#11303)

  Show description for 6142ef0
  DarkLight1337

  authored
  6142ef0

• [V1] Simplify prefix caching logic by removing num_evictable_computed_blocks (vllm-project#11310)

  heheda12345

  authored
  c6b0a7d

• [CI] Expand test_guided_generate to test all backends (vllm-project#11313)

  Show description for a30482f
  mgoin

  authored
  a30482f

• [Model] IBM Granite 3.1 (vllm-project#11307)

  Show description for 17ca964
  tjohnson31415

  authored
  17ca964

• [Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (vllm-project#11311)

  Show description for 5a9da2e
  tlrmchlsmth

  authored
  5a9da2e

Commits on Dec 18, 2024

• [V1] VLM - enable processor cache by default (vllm-project#11305)

  Show description for fdea8ec
  alexm-neuralmagic

  authored
  fdea8ec

• [Bugfix] fix minicpmv test (vllm-project#11304)

  Show description for ca5f54a
  joerunde

  authored
  ca5f54a

• [FIX] update openai version (vllm-project#11287)

  Show description for f954fe0
  jikunshang

  authored
  f954fe0

Pagination

PreviousNext