tokenization
Jump to navigation
Jump to search
English
[edit]Etymology
[edit]Noun
[edit]tokenization (countable and uncountable, plural tokenizations)
- The act or process of tokenizing.
- Something tokenized.
- This was an unlikely tokenization of the input string.