⌘Ctrlk

GitBook Assistant

Working...Thinking...

Good morning

I'm here to help you with the docs.

⌘Ctrli

AI Based on your context

a. 基础知识
b. PyTorch
c. LLM 基础
d. 分布式训练
e. Pre-Training
f. Post-Training
g. LLM Inference
h. Agent
i. 主流大模型技术
j. 其他

Powered by GitBook

On this page

g. LLM Inference

9. TensorRT-LLM

介绍 TensorRT-LLM 框架及其在大规模语言模型推理中的应用

Previous8. Text Generation Inference (TGI)Nexth. Agent

Last updated 46 minutes ago

Was this helpful?

Created By Ruida

Was this helpful?