NVIDIA/TensorRT-LLM v1.3.0
Comments
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Ranked by a public rubric, not by votes: what a comment adds counts, not who wrote it. How comments are ranked · Comment rules
Summary
NVIDIA's TensorRT-LLM v1.3.0 adds preview Rubin (SM107) support, new models such as DeepSeek-V4, Kimi K3 and Qwen3.5, and VisualGen for image and video generation served through trtllm-serve. It also removes the TensorRT backend, trtllm-build and the legacy C++ Executor, leaving PyTorch as the only backend, so existing engine-based deployments need migration. Telemetry is on by default, KV transfer timeouts now default to 60 seconds, and the TRITON MoE backend is deprecated. The release notes are the only source, and several claims remain unverified.