Function torch_tensorrt::torchscript::compile

Function Documentation

TORCHTRT_API torch :: jit :: Module torch_tensorrt :: torchscript :: compile ( const torch :: jit :: Module & module , CompileSpec info )

Compile a TorchScript module for NVIDIA GPUs using TensorRT.

Takes a existing TorchScript module and a set of settings to configure the compiler and will convert methods to JIT Graphs which call equivalent TensorRT engines

Converts specifically the forward method of a TorchScript Module

Parameters
  • module – torch::jit::Module - Existing TorchScript module

  • info – torch_tensorrt::CompileSpec - Compilation settings

Returns

: A new module trageting a TensorRT engine