Function trtorch::CompileGraph

Function Documentation

TRTORCH_API torch::jit::Module trtorch :: CompileGraph ( const torch::jit::Module & module , ExtraInfo info )

Compile a TorchScript module for NVIDIA GPUs using TensorRT.

Takes a existing TorchScript module and a set of settings to configure the compiler and will convert methods to JIT Graphs which call equivalent TensorRT engines

Parameters
  • module : torch::jit::Module - Existing TorchScript module

  • info : trtorch::ExtraInfo - Compilation settings

Converts specifically the forward method of a TorchScript Module

Return

: A new module trageting a TensorRT engine