Welcome to our Support Center

Copy Tokenized Text to U8 Array

Description

Copy Tokenized Data stored in local to an U8 LabVIEW Array.

 

Input parameters

 

ONNX in : object, tokenizer session.

Output parameters

 

ONNX out : object, tokenizer session.
token_array : array, the output of the tokenization, where each integer represents a token ID from the model’s vocabulary.

Example

All these exemples are snippets PNG, you can drop these Snippet onto the block diagram and get the depicted code added to your VI (Do not forget to install Deep Learning library to run it).
Table of Contents