Code

Added flux demo#3418

Code

Open

cehongwang wants to merge 17 commits intomainpytorch/TensorRT:mainfrom flux-demopytorch/TensorRT:flux-demoCopy head branch name to clipboard

Commits

Commits on Mar 26, 2025

• Added CPU offloading

  cehongwang

  committed
  1bcb34c

  Copy full SHA for 1bcb34c

Commits on Mar 27, 2025

• Chagned CPU offload to default

  cehongwang

  committed
  44b0709

  Copy full SHA for 44b0709

• Added support to module with graph break

  cehongwang

  committed
  8b92866

  Copy full SHA for 8b92866

• Added flux demo

  cehongwang

  committed
  f080265

  Copy full SHA for f080265

• changed the file place and deleted unnecessary code

  cehongwang

  committed
  3d5d814

  Copy full SHA for 3d5d814

• Fixed memory overhead and enabled Flux with Mutable Module

  cehongwang

  committed
  3782102

  Copy full SHA for 3782102

• Supported LoRA

  cehongwang

  committed
  dee27e6

  Copy full SHA for dee27e6

• Refined Flux demo, solved a bug of device mismatch, and prototyped CudaGraph and Weight streaming

  cehongwang

  committed
  f601850

  Copy full SHA for f601850

• Enabled Cuda Graph

  cehongwang

  committed
  efb1edc

  Copy full SHA for efb1edc

• Enabled weight streaming and CudaGraph. Supported MTTM saving with dynamic shapes.

  cehongwang

  committed
  60ef5c1

  Copy full SHA for 60ef5c1

• Changed the Refitting test to disable CPU offload

  cehongwang

  committed
  0787221

  Copy full SHA for 0787221

• Fixed Cuda Error

  cehongwang

  committed
  9f3e27e

  Copy full SHA for 9f3e27e

• Fixed the bug of SDXL Cuda Error

  cehongwang

  committed
  415adea

  Copy full SHA for 415adea

• Changed the way to enable CudaGraph for MTTM

  cehongwang

  committed
  b9768d5

  Copy full SHA for b9768d5

• Finalize the refit revision

  cehongwang

  committed
  4cd089f

  Copy full SHA for 4cd089f

• Fixed the comments

  cehongwang

  committed
  ffd4463

  Copy full SHA for ffd4463

• Correct the flux export example

  cehongwang

  committed
  a8ffa2a

  Copy full SHA for a8ffa2a