This is used as a contract between the lexer and the parser.
| Modifier and Type | Class and Description |
|---|---|
| pack-priv static enum |
| Modifier and Type | Field and Description |
|---|---|
| pack-priv final StringBuilder | content
The content buffer, never null. |
| private static final int | DEFAULT_CAPACITY
Length of the initial token (content-)buffer |
| pack-priv boolean | |
| pack-priv boolean | isReady
Token ready flag: indicates a valid token with content (ready for the parser). |
| pack-priv Token. | type
Token type |
| Access | Constructor and Description |
|---|---|
| pack-priv |
| Modifier and Type | Method and Description |
|---|---|
| pack-priv void | |
| public String | Returns: a string helpful for debugging.Overrides java. Converts the token state to a string to ease debugging. |
| content | back to summary |
|---|---|
| pack-priv final StringBuilder content The content buffer, never null. | |
| DEFAULT_CAPACITY | back to summary |
|---|---|
| private static final int DEFAULT_CAPACITY Length of the initial token (content-)buffer | |
| isQuoted | back to summary |
|---|---|
| pack-priv boolean isQuoted | |
| isReady | back to summary |
|---|---|
| pack-priv boolean isReady Token ready flag: indicates a valid token with content (ready for the parser). | |
| type | back to summary |
|---|---|
| pack-priv Token. Token type | |
| Token | back to summary |
|---|---|
| pack-priv Token() | |
| reset | back to summary |
|---|---|
| pack-priv void reset() | |
| toString | back to summary |
|---|---|
| public String toString() Overrides java. Converts the token state to a string to ease debugging. | |
| Modifier and Type | Field and Description |
|---|---|
| public static final Token. | COMMENT
Token is a comment line. |
| public static final Token. | EOF
Token (which can have content) when the end of file is reached. |
| public static final Token. | EORECORD
Token with content when the end of a line is reached. |
| public static final Token. | INVALID
Token has no valid content, that is, is in its initialized state. |
| public static final Token. | TOKEN
Token with content, at the beginning or in the middle of a line. |
| Access | Constructor and Description |
|---|---|
| private |
| Modifier and Type | Method and Description |
|---|---|
| public static Token. | |
| public static Token. |
| COMMENT | back to summary |
|---|---|
| public static final Token. Token is a comment line. | |
| EOF | back to summary |
|---|---|
| public static final Token. Token (which can have content) when the end of file is reached. | |
| EORECORD | back to summary |
|---|---|
| public static final Token. Token with content when the end of a line is reached. | |
| INVALID | back to summary |
|---|---|
| public static final Token. Token has no valid content, that is, is in its initialized state. | |
| TOKEN | back to summary |
|---|---|
| public static final Token. Token with content, at the beginning or in the middle of a line. | |
| Type | back to summary |
|---|---|
| private Type() | |
| valueOf | back to summary |
|---|---|
| public static Token. | |
| values | back to summary |
|---|---|
| public static Token. | |