Skip to content

Pull requests: pytorch/TensorRT

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Sort

Pull requests list

fix: Fix additional mem copy of the model during re-export cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#3302 opened Nov 22, 2024 by peri044 Loading…
7 tasks
Feat: Initial implementation for automatic plugin cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: conversion Issues re: Conversion stage component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3301 opened Nov 22, 2024 by bowang007 Loading…
7 tasks
fix: attribute error caused by trt.BuilderFlag.STRICT_TYPES cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3300 opened Nov 20, 2024 by jiwoong-choi Loading…
7 tasks done
Torch TRT ngc container changes cla signed component: core Issues re: The core compiler component: tests Issues re: Tests
#3299 opened Nov 19, 2024 by apbose Draft
Get decompositions only for CIA ops cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes
#3297 opened Nov 18, 2024 by HolyWu Loading…
2 of 7 tasks
Replace scaled_dot_product_attention lowering pass with decomposition cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#3296 opened Nov 17, 2024 by HolyWu Loading…
4 of 7 tasks
full_like to full decomposition moving to decomposition.py for dynami… cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#3289 opened Nov 11, 2024 by apbose Loading…
upgrade tensorrt dependency to >=10.3.0,<=10.6.0 build-release-artifacts Build the release artifacts cla signed component: build system Issues re: Build system
#3286 opened Nov 9, 2024 by lanluo-nvidia Loading…
7 tasks
allow null arg_inputs if kwarg_inputs is set cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3282 opened Nov 6, 2024 by technillogue Loading…
5 of 7 tasks
feat: Runtime output buffer optimization cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime
#3276 opened Nov 4, 2024 by keehyuna Loading…
3 of 7 tasks
Use INormalizationLayer for GroupNorm cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#3273 opened Nov 4, 2024 by HolyWu Loading…
4 of 7 tasks
Fix LayerNorm fp16 precision cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#3272 opened Nov 3, 2024 by HolyWu Loading…
3 of 7 tasks
Wrapper module around TRT + pytorch subgraphs cla signed component: api [Python] Issues re: Python API component: core Issues re: The core compiler component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests
#3270 opened Oct 31, 2024 by keehyuna Loading…
7 tasks
fix: cumsum add_constant bug fix (add dtype for np zeros) cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3258 opened Oct 22, 2024 by chohk88 Loading…
6 of 7 tasks
using nccl ops from TRT-LLM namespace cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: torch_compile
#3250 opened Oct 19, 2024 by apbose Loading…
chore: adding additional logging to the converter registry system cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths
#3199 opened Oct 1, 2024 by narendasan Loading…
7 tasks done
chore: example fixes cla signed component: api [Python] Issues re: Python API component: build system Issues re: Build system component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: torch_compile
#3176 opened Sep 24, 2024 by peri044 Loading…
7 tasks
feat: Support weight-stripped engine and REFIT_IDENTICAL flag cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime component: tests Issues re: Tests component: torch_compile
#3167 opened Sep 19, 2024 by zewenli98 Loading…
7 tasks
scatter reduce lowering with include_self=False cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: lowering Issues re: The lowering / preprocessing passes component: tests Issues re: Tests
#3153 opened Sep 11, 2024 by apbose Loading…
chore: bug fixes cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#3065 opened Aug 6, 2024 by peri044 Loading…
7 tasks
Enabled python runtime saving cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: runtime
#2999 opened Jul 11, 2024 by cehongwang Loading…
7 tasks
feat: support aten._local_scalar_dense converter Blocked Issue cannot be resolved until a change in a dependency cla signed component: api [Python] Issues re: Python API component: conversion Issues re: Conversion stage component: converters Issues re: Specific op converters component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: tests Issues re: Tests
#2752 opened Apr 16, 2024 by chohk88 Loading…
5 of 7 tasks
feat: Add toggle for fallback to Inductor cla signed component: api [Python] Issues re: Python API component: dynamo Issues relating to the `torch.compile` or `torch._dynamo.export` paths component: torch_compile
#2301 opened Sep 7, 2023 by gs-olive Draft
7 tasks
ProTip! Add no:assignee to see everything that’s not assigned.