Meaning tokener
What does tokener mean? Here you find 2 meanings of the word tokener. You can also add a definition of tokener yourself
1 |
0
0
tokenerA module that breaks a program text into a sequence of tokens for later analysis by a parser.
|
2 |
0
0
tokenerA module that breaks a program text into a sequence of tokens
|
| << TMTOWTDI | tokenizing >> |