fastsentencepiecetokenizer

https://www.tensorflow.org/text/api_docs/python/text/FastSentencepieceTokenizer?authuser=2 text.FastSentencepieceTokenizer | Text | TensorFlow Sentencepiece tokenizer with tf.text interface. text tensorflow

Robuta