Lexicon is a group of lexical words that can be tokenized by a single tokenizer.
| Modifier and Type | Field and Description |
|---|---|
| pack-priv final Parser | tokenizer
The scanner that recognizes any of the lexical word. |
| pack-priv final Function | words
Maps lexical word name to token value. |
| Access | Constructor and Description |
|---|---|
| pack-priv |
| Modifier and Type | Method and Description |
|---|---|
| pack-priv static <F, T> Function | |
| public Parser | |
| public Parser | |
| public Parser | |
| public Parser | tokenizer()
Returns the tokenizer that tokenizes all terminals (operators, keywords, identifiers etc.) managed in this instance. |
| pack-priv Lexicon | |
| pack-priv Object |
| tokenizer | back to summary |
|---|---|
| pack-priv final Parser<?> tokenizer The scanner that recognizes any of the lexical word. | |
| words | back to summary |
|---|---|
| pack-priv final Function<String, Object> words Maps lexical word name to token value. | |
| Lexicon | back to summary |
|---|---|
| pack-priv Lexicon(Function<String, Object> words, Parser<?> tokenizer) | |
| fallback | back to summary |
|---|---|
| pack-priv static <F, T> Function Returns a | |
| phrase | back to summary |
|---|---|
| public Parser A | |
| token | back to summary |
|---|---|
| public Parser A | |
| token | back to summary |
|---|---|
| public Parser A | |
| tokenizer | back to summary |
|---|---|
| public Parser Returns the tokenizer that tokenizes all terminals (operators, keywords, identifiers etc.) managed in this instance. | |
| union | back to summary |
|---|---|
| pack-priv Lexicon union(Lexicon that) Returns a | |
| word | back to summary |
|---|---|
| pack-priv Object word(String name) Gets the token value identified by the token text. This text is the operator or the keyword.
| |