tokenize
Verb
Meaning
(transitive, computing) To reduce to a set of tokens by lexical analysis.
(transitive, computing) To substitute sensitive data with meaningless placeholders.
(transitive) To treat as a token minority.
Source: en.wiktionary.orgVerb
(transitive, computing) To reduce to a set of tokens by lexical analysis.
(transitive, computing) To substitute sensitive data with meaningless placeholders.
(transitive) To treat as a token minority.
Source: en.wiktionary.org