Function torch_tensorrt::torchscript::convert_method_to_trt_engine ¶
-
Defined in File torch_tensorrt.h
Function Documentation ¶
-
TORCHTRT_API
std
::
string
torch_tensorrt
::
torchscript
::
convert_method_to_trt_engine
(
const
torch
::
jit
::
Module
&
module
,
std
::
string
method_name
,
CompileSpec
info
)
¶
-
Compile a TorchScript method for NVIDIA GPUs using TensorRT.
Takes a existing TorchScript module and a set of settings to configure the compiler and will convert selected method to a serialized TensorRT engine which can be run with TensorRT
- Parameters
-
-
module – torch::jit::Module - Existing TorchScript module
-
method_name – std::string - Name of method to compile
-
info – torch_tensorrt::CompileSpec - Compilation settings
-
- Returns
-
: std::string: Serialized TensorRT engine equivilant to the method graph