Welcome to our Support Center
Updated

Inputs CPU Raw Data (data outside cluster)

Description

Run the model with the raw input data from the CPU, the output buffer is allocated automatically. The raw data are passed outside the cluster, since very large clusters may reduce performance.

Input parameters

 

 Inference in : object, inference session.

Inputs Info : cluster

inputs_shapes : array, specifies the shape of the input tensor. Since the data is stored as a flattened 1D buffer, this shape is necessary to reconstruct the original dimensions.
inputs string length : array, used when the tensor type is string. If the tensor has shape [5,3], this field contains 15 values, each representing the length of a corresponding string element. This ensures that the actual size of inputs_data is known despite variable string lengths.
inputs_ranks : array, indicates the rank of the tensor, i.e. the number of dimensions (Scalar = 0, 1D = 1, 2D = 2, etc.).
inputs_types : array, defines the ONNX tensor type as an enumerated value (e.g. FLOAT, INT64, STRING).

inputs_data : array, contains the raw byte representation of the input tensor data, stored as a 1D flattened buffer.

 

Output parameters

 

 Inference out : object, inference session.

Outputs Info : cluster

output_shapes_array : array, specifies the shape of the input tensor. Since the data is stored as a flattened 1D buffer, this shape is necessary to reconstruct the original dimensions.
output_strings_length_array : array, used when the tensor type is string. If the tensor has shape [5,3], this field contains 15 values, each representing the length of a corresponding string element. This ensures that the actual size of inputs_data is known despite variable string lengths.
output_ranks_array : array, indicates the rank of the tensor, i.e. the number of dimensions (Scalar = 0, 1D = 1, 2D = 2, etc.).
output_types_array : array, defines the ONNX tensor type as an enumerated value (e.g. FLOAT, INT64, STRING).

outputs_raw_data : array, contains the raw byte representation of the input tensor data, stored as a 1D flattened buffer.

 

Example

All these exemples are snippets PNG, you can drop these Snippet onto the block diagram and get the depicted code added to your VI (Do not forget to install Deep Learning library to run it).
Table of Contents