tokenization

From Wiktionary, the free dictionary
Jump to navigation Jump to search

English

[edit]
English Wikipedia has an article on:
Wikipedia

Etymology

[edit]

From token +‎ -ization.

Noun

[edit]

tokenization (countable and uncountable, plural tokenizations)

  1. The act or process of tokenizing.
  2. Something tokenized.
    This was an unlikely tokenization of the input string.

Anagrams

[edit]