Top Description Inners Fields Constructors Methods
com.amazon.ion.impl

pack-priv final Class IonTokenReader

extends Object
Class Inheritance
Static Imports
com.amazon.ion.util.IonTextUtils.isDigit, .IonTextUtils.isOperatorPart, .IonTextUtils.isWhitespace, .IonTextUtils.printCodePointAsString
This class is responsible for breaking the input stream into Tokens. It does both the token recognition (aka the scanner) and the state management needed to use the value underlying some of these tokens.

Nested and Inner Type Summary

Modifier and TypeClass and Description
public static enum
IonTokenReader.Context

pack-priv static class
IonTokenReader.LocalReader

pack-priv static enum
IonTokenReader.NumberType

public static enum
IonTokenReader.Type

Field Summary

Modifier and TypeField and Description
public IonTokenReader.Context
context

public Stack<IonTokenReader.Context>
contextStack

public Timestamp
dateValue

public BigDecimal
decimalValue

public Double
doubleValue

public int
embeddedSlash

pack-priv static final int
EMPTY_ESCAPE_SEQUENCE

Magic "character" to represent an escape sequence with an empty expansion.

public int
endquote

private IonCharacterReader
in

public boolean
inQuotedContent

public BigInteger
intValue

public static int
isConstant

public static int
isDecimal

public static int
isFloat

public boolean
isIncomplete

public static int
isKeyword

public boolean
isLongString

public boolean
isNegative

private static int
isNegInt

private static int
isPosInt

public static int
isPunctuation

public static int
isTag

public static int
isTypeName

public IonTokenReader.Type
keyword

private IonTokenReader.LocalReader
localReader

public IonTokenReader.NumberType
numberType

private PushbackReader
pushbackReader

public boolean
quotedIdentifier

public String
stringValue

public IonTokenReader.Type
t

public StringBuilder
value

Constructor Summary

AccessConstructor and Description
public
IonTokenReader(final Reader r)

Method Summary

Modifier and TypeMethod and Description
private void
checkAndUnreadNumericStopper(int c)

pack-priv void
closeLongString()

Closes parsing of a triple-quote string, remembering that there may be more to come.

pack-priv void
closeString()

pack-priv void
finishScanString(boolean is_in_expression)

Scans the rest of the string through endquote.

public int
getColumn()

public long
getConsumedAmount()

public int
getLineNumber()

public PushbackReader
getPushbackReader()

public String
getValueString(boolean is_in_expression)

private final boolean
isValueTerminatingCharacter(int c)

pack-priv void
leaveOpenString(int c, boolean longstring)

public boolean
makeValidNumeric(IonTokenReader.Type castto)

pack-priv static IonTokenReader.Type
matchKeyword(StringBuilder sb, int pos, int valuelen)

public IonTokenReader.Type
next(boolean is_in_expression)

private IonTokenReader.Type
next(int c, boolean is_in_expression)

public IonTokenReader.Context
popContext()

public String
position()

public void
pushContext(IonTokenReader.Context newcontext)

pack-priv final int

Returns:

-1 on end of stream.
read()

Reads the next character using the underlying stream.

public static int
readDigit(PushbackReader r, int radix, boolean isRequired)

pack-priv int
readDigits(int limit, String field)

public static int

Returns:

the translated escape sequence. Will not return -1 since EOF is not legal in this context. May return EMPTY_ESCAPE_SEQUENCE to indicate a zero-length sequence such as BS-NL.
readEscapedCharacter(PushbackReader r, boolean inClob)

pack-priv boolean
readIdentifierContents(int c)

pack-priv int
readIdentifierContents(int c, int max_length)

pack-priv int
readIgnoreWhitespace()

public IonTokenReader.Type
readNumber(int c)

pack-priv void
resetValue()

pack-priv IonTokenReader.Type
scanHexNumber()

public IonTokenReader.Type
scanIdentifier(int c)

public IonTokenReader.Type
scanLongString()

public IonTokenReader.Type
scanOperator(int c)

public IonTokenReader.Type
scanString(int c, int maxlookahead)

pack-priv IonTokenReader.Type

Returns:

Type#constTime
scanTimestamp(int
the last character scanned; must be '-'.
c)

Scans a timestamp after reading yyyy-.

public IonTokenReader.Type
setNullType(StringBuilder sb, int pos, int valuelen)

private boolean

Returns:

true when there are two pending single quotes.
twoMoreSingleQuotes()

If two single quotes are next on the input, consume them and return true.

pack-priv void
unread(int c)

Inherited from java.lang.Object:
cloneequalsfinalizegetClasshashCodenotifynotifyAlltoStringwaitwaitwait