Function torch_tensorrt::torchscript::compile ¶
-
Defined in File torch_tensorrt.h
Function Documentation ¶
-
TORCHTRT_API
torch
::
jit
::
Module
torch_tensorrt
::
torchscript
::
compile
(
const
torch
::
jit
::
Module
&
module
,
CompileSpec
info
)
¶
-
Compile a TorchScript module for NVIDIA GPUs using TensorRT.
Takes a existing TorchScript module and a set of settings to configure the compiler and will convert methods to JIT Graphs which call equivalent TensorRT engines
Converts specifically the forward method of a TorchScript Module
- Parameters
-
-
module – torch::jit::Module - Existing TorchScript module
-
info – torch_tensorrt::CompileSpec - Compilation settings
-
- Returns
-
: A new module trageting a TensorRT engine