Word info

tokenizer

Noun

Meaning

tokenizer (plural tokenizers)

(computing) A system that parses an input stream into its component tokens.

Source: en.wiktionary.org

Close letter words and terms