ailia_tokenizer  1.3.0.0
ailiaTokenizer.AiliaTokenizerModel Member List

This is the complete list of members for ailiaTokenizer.AiliaTokenizerModel, including all inherited members.

Close()ailiaTokenizer.AiliaTokenizerModelinlinevirtual
Create(int type, int flag)ailiaTokenizer.AiliaTokenizerModelinline
Decode(int[] tokens)ailiaTokenizer.AiliaTokenizerModelinline
DecodeWithSpecialTokens(int[] tokens)ailiaTokenizer.AiliaTokenizerModelinline
Dispose()ailiaTokenizer.AiliaTokenizerModelinlinevirtual
Dispose(bool disposing)ailiaTokenizer.AiliaTokenizerModelinlineprotectedvirtual
Encode(string utf8)ailiaTokenizer.AiliaTokenizerModelinline
EncodeWithSpecialTokens(string utf8)ailiaTokenizer.AiliaTokenizerModelinline
GetVocab(int token)ailiaTokenizer.AiliaTokenizerModelinline
GetVocabSize()ailiaTokenizer.AiliaTokenizerModelinline
Open(string model_path=null, string dictionary_path=null, string vocab_path=null)ailiaTokenizer.AiliaTokenizerModelinline
Generated by   doxygen 1.8.17