Struct ExtraInfo::InputRange

Nested Relationships

This struct is a nested type of Struct ExtraInfo .

Struct Documentation

struct trtorch:: ExtraInfo :: InputRange

A struct to hold an input range (used by TensorRT Optimization profile)

This struct can either hold a single vector representing an input shape, signifying a static input shape or a set of three input shapes representing the min, optiminal and max input shapes allowed for the engine.

Public Functions

InputRange ( std::vector<int64_t> opt )

Construct a new Input Range object for static input size from vector.

Parameters
  • opt :

InputRange ( c10::ArrayRef<int64_t> opt )

Construct a new Input Range object static input size from c10::ArrayRef (the type produced by tensor.sizes())

Parameters
  • opt :

InputRange ( std::vector<int64_t> min , std::vector<int64_t> opt , std::vector<int64_t> max )

Construct a new Input Range object dynamic input size from vectors for min, opt, and max supported sizes.

Parameters
  • min :

  • opt :

  • max :

InputRange ( c10::ArrayRef<int64_t> min , c10::ArrayRef<int64_t> opt , c10::ArrayRef<int64_t> max )

Construct a new Input Range object dynamic input size from c10::ArrayRef (the type produced by tensor.sizes()) for min, opt, and max supported sizes.

Parameters
  • min :

  • opt :

  • max :

Public Members

std::vector<int64_t> min

Minimum acceptable input size into the engine.

std::vector<int64_t> opt

Optimal input size into the engine (gets best performace)

std::vector<int64_t> max

Maximum acceptable input size into the engine.