retokenize

English

Etymology

Pronunciation

(General American) IPA^(key): /ɹiˈtoʊ.kən.aɪz/

Verb

retokenize (third-person singular simple present retokenizes, present participle retokenizing, simple past and past participle retokenized)

(transitive, computing) To tokenize again.