Welcome to our Support Center
Updated

Tokenize Text

Description

Tokenize input text and store it in a ptr.

 

Input parameters

 

ONNX in : object, tokenizer session.
text : string, the raw text input that will be transformed into a sequence of tokens by the tokenizer.

Output parameters

 

ONNX out : object, tokenizer session.

Example

All these exemples are snippets PNG, you can drop these Snippet onto the block diagram and get the depicted code added to your VI (Do not forget to install Deep Learning library to run it).
Table of Contents