Function torch_tensorrt::torchscript::compile ¶
-
Defined in File torch_tensorrt.h
Function Documentation ¶
-
TORCHTRT_API torch::jit::Module
torch_tensorrt::torchscript
::
compile
( const torch::jit::Module & module , CompileSpec info ) ¶
-
Compile a TorchScript module for NVIDIA GPUs using TensorRT.
Takes a existing TorchScript module and a set of settings to configure the compiler and will convert methods to JIT Graphs which call equivalent TensorRT engines
- Parameters
-
-
module
: torch::jit::Module - Existing TorchScript module -
info
: torch_tensorrt::CompileSpec - Compilation settings
-
Converts specifically the forward method of a TorchScript Module
- Return
-
: A new module trageting a TensorRT engine