Struct CompileSpec::Device ¶
-
Defined in File trtorch.h
Nested Relationships ¶
This struct is a nested type of Struct CompileSpec .
Nested Types ¶
Struct Documentation ¶
-
struct
trtorch:: CompileSpec
::
Device
-
Public Functions
-
Device
( )
-
Constructor for Device structure
Public Members
-
DeviceType
device_type
-
Setting data structure for device This struct will hold Target device related parameters such as device_type, gpu_id, dla_core.
-
int64_t
gpu_id
-
int64_t
dla_core
-
bool
allow_gpu_fallback
-
(Only used when targeting DLA (device)) Lets engine run layers on GPU if they are not supported on DLA
-
class
DeviceType
-
Supported Device Types that can be used with TensorRT engines
This class is compatable with c10::DeviceTypes (but will check for TRT support) but the only applicable value is at::kCUDA, which maps to DeviceType::kGPU
To use the DataType class itself, interface using the enum vs. normal instatination
ex. trtorch::DeviceType type = DeviceType::kGPU ;
Public Types
-
enum
Value
-
Underlying enum class to support the DeviceType Class
In the case that you need to use the DeviceType class itself, interface using this enum vs. normal instatination
ex. trtorch::DeviceType type = DeviceType::kGPU ;
Values:
-
enumerator
kGPU
-
Target GPU to run engine.
-
enumerator
kDLA
-
Target DLA to run engine.
-
enumerator
Public Functions
-
DeviceType
( ) = default
-
Construct a new Device Type object.
-
DeviceType
( c10::DeviceType t )
-
Construct a new Device Type object from torch device enums Note: The only valid value is torch::kCUDA (torch::kCPU is not supported)
- Parameters
-
-
t
:
-
-
operator Value
( ) const
-
Get the internal value from the Device object.
- Return
-
Value
-
operator bool
( ) = delete
-
constexpr
bool
operator==
( DeviceType other ) const
-
Comparison operator for DeviceType .
- Return
-
true
- Return
-
false
- Parameters
-
-
other
:
-
-
constexpr
bool
operator!=
( DeviceType other ) const
-
Comparison operator for DeviceType .
- Return
-
true
- Return
-
false
- Parameters
-
-
other
:
-
-
enum
-