Top Description Fields Constructors Methods
com.ibm.icu.impl

public Class PatternTokenizer

extends Object
Class Inheritance
Imports
com.ibm.icu.text.UTF16, .UnicodeSet

A simple parsing class for patterns and rules. Handles '...' quotations, \\uxxxx and \\Uxxxxxxxx, and symple syntax. The '' (two quotes) is treated as a single quote, inside or outside a quote

Field Summary

Modifier and TypeField and Description
private static final int
public static final char
public static final int
public static final int
public static final int
private UnicodeSet
private UnicodeSet
private static final int
private UnicodeSet
private static int
private int
public static final int
private transient UnicodeSet
private static int
private static final int
private static final int
private String
public static final char
private static final int
private int
private static final int
public static final int
private UnicodeSet
public static final int
private boolean
private boolean

Constructor Summary

AccessConstructor and Description
public

Method Summary

Modifier and TypeMethod and Description
private void
appendEscaped(StringBuffer result, int cp)

public UnicodeSet
public UnicodeSet
public UnicodeSet
public int
public int
public UnicodeSet
public boolean
public boolean
public int
public String
public String
public String

Returns:

A string using the available settings will place syntax, quote, or ignorable characters into quotes.
quoteLiteral
(String
String passed to quote a literal string.
string
)

Quote a literal string, using the available settings.

public PatternTokenizer

Returns:

A PatternTokenizer object in which characters are specified as escape characters.
setEscapeCharacters
(UnicodeSet
Characters to be set as escape characters.
escapeCharacters
)

Set characters to be escaped in literals, in quoteLiteral and normalize, eg new UnicodeSet("[^\\u0020-\\u007E]");

public PatternTokenizer

Returns:

A PatternTokenizer object in which characters are specified as extra quoting characters.
setExtraQuotingCharacters
(UnicodeSet
Characters to be set as extra quoting characters.
syntaxCharacters
)

Sets the extra characters to be quoted in literals

public PatternTokenizer

Returns:

A PatternTokenizer object in which characters are specified as ignored characters.
setIgnorableCharacters
(UnicodeSet
Characters to be ignored.
ignorableCharacters
)

Sets the characters to be ignored in parsing, eg new UnicodeSet("[:pattern_whitespace:]");

public PatternTokenizer
setLimit(int limit)

public PatternTokenizer
public PatternTokenizer
setPattern(String pattern)

public PatternTokenizer
setStart(int start)

public PatternTokenizer

Returns:

A PatternTokenizer object in which characters are specified as syntax characters.
setSyntaxCharacters
(UnicodeSet
Characters to be set as syntax characters.
syntaxCharacters
)

Sets the characters to be interpreted as syntax characters in parsing, eg new UnicodeSet("[:pattern_syntax:]")

public PatternTokenizer
setUsingQuote(boolean usingQuote)

public PatternTokenizer
setUsingSlash(boolean usingSlash)

Inherited from java.lang.Object:
cloneequalsfinalizegetClasshashCodenotifynotifyAlltoStringwaitwaitwait

Field Detail

AFTER_QUOTEback to summary
private static final int AFTER_QUOTE
BACK_SLASHback to summary
public static final char BACK_SLASH
BROKEN_ESCAPEback to summary
public static final int BROKEN_ESCAPE
BROKEN_QUOTEback to summary
public static final int BROKEN_QUOTE
DONEback to summary
public static final int DONE
escapeCharactersback to summary
private UnicodeSet escapeCharacters
extraQuotingCharactersback to summary
private UnicodeSet extraQuotingCharacters
HEXback to summary
private static final int HEX
ignorableCharactersback to summary
private UnicodeSet ignorableCharacters
IN_QUOTEback to summary
private static int IN_QUOTE
limitback to summary
private int limit
LITERALback to summary
public static final int LITERAL
needingQuoteCharactersback to summary
private transient UnicodeSet needingQuoteCharacters
NO_QUOTEback to summary
private static int NO_QUOTE
NONEback to summary
private static final int NONE
NORMAL_QUOTEback to summary
private static final int NORMAL_QUOTE
patternback to summary
private String pattern
SINGLE_QUOTEback to summary
public static final char SINGLE_QUOTE
SLASH_STARTback to summary
private static final int SLASH_START
startback to summary
private int start
START_QUOTEback to summary
private static final int START_QUOTE
SYNTAXback to summary
public static final int SYNTAX
syntaxCharactersback to summary
private UnicodeSet syntaxCharacters
UNKNOWNback to summary
public static final int UNKNOWN
usingQuoteback to summary
private boolean usingQuote
usingSlashback to summary
private boolean usingSlash

Constructor Detail

PatternTokenizerback to summary
public PatternTokenizer()

Method Detail

appendEscapedback to summary
private void appendEscaped(StringBuffer result, int cp)
getEscapeCharactersback to summary
public UnicodeSet getEscapeCharacters()
getExtraQuotingCharactersback to summary
public UnicodeSet getExtraQuotingCharacters()
getIgnorableCharactersback to summary
public UnicodeSet getIgnorableCharacters()
getLimitback to summary
public int getLimit()
getStartback to summary
public int getStart()
getSyntaxCharactersback to summary
public UnicodeSet getSyntaxCharacters()
isUsingQuoteback to summary
public boolean isUsingQuote()
isUsingSlashback to summary
public boolean isUsingSlash()
nextback to summary
public int next(StringBuffer buffer)
normalizeback to summary
public String normalize()
quoteLiteralback to summary
public String quoteLiteral(CharSequence string)
quoteLiteralback to summary
public String quoteLiteral(String string)

Quote a literal string, using the available settings. Thus syntax characters, quote characters, and ignorable characters will be put into quotes.

Parameters
string:String

String passed to quote a literal string.

Returns:String

A string using the available settings will place syntax, quote, or ignorable characters into quotes.

setEscapeCharactersback to summary
public PatternTokenizer setEscapeCharacters(UnicodeSet escapeCharacters)

Set characters to be escaped in literals, in quoteLiteral and normalize, eg new UnicodeSet("[^\\u0020-\\u007E]");

Parameters
escapeCharacters:UnicodeSet

Characters to be set as escape characters.

Returns:PatternTokenizer

A PatternTokenizer object in which characters are specified as escape characters.

setExtraQuotingCharactersback to summary
public PatternTokenizer setExtraQuotingCharacters(UnicodeSet syntaxCharacters)

Sets the extra characters to be quoted in literals

Parameters
syntaxCharacters:UnicodeSet

Characters to be set as extra quoting characters.

Returns:PatternTokenizer

A PatternTokenizer object in which characters are specified as extra quoting characters.

setIgnorableCharactersback to summary
public PatternTokenizer setIgnorableCharacters(UnicodeSet ignorableCharacters)

Sets the characters to be ignored in parsing, eg new UnicodeSet("[:pattern_whitespace:]");

Parameters
ignorableCharacters:UnicodeSet

Characters to be ignored.

Returns:PatternTokenizer

A PatternTokenizer object in which characters are specified as ignored characters.

setLimitback to summary
public PatternTokenizer setLimit(int limit)
setPatternback to summary
public PatternTokenizer setPattern(CharSequence pattern)
setPatternback to summary
public PatternTokenizer setPattern(String pattern)
setStartback to summary
public PatternTokenizer setStart(int start)
setSyntaxCharactersback to summary
public PatternTokenizer setSyntaxCharacters(UnicodeSet syntaxCharacters)

Sets the characters to be interpreted as syntax characters in parsing, eg new UnicodeSet("[:pattern_syntax:]")

Parameters
syntaxCharacters:UnicodeSet

Characters to be set as syntax characters.

Returns:PatternTokenizer

A PatternTokenizer object in which characters are specified as syntax characters.

setUsingQuoteback to summary
public PatternTokenizer setUsingQuote(boolean usingQuote)
setUsingSlashback to summary
public PatternTokenizer setUsingSlash(boolean usingSlash)