public final Class Tokenizer

Class Inheritance

extends Object

Annotations

Imports

This class extracts valid token forms from the given string Note that this class will ignore malformed tags and print them as is

Field Summary

Access	Constructor and Description
private	Tokenizer()

Modifier and Type	Method and Description
private static void	addValidStyles(String s, List<AnsiCode> list, StyleContext context, boolean enableStrictParsing)
private static boolean	charNotEquals(String input, int i, char c)
private static List<AnsiCode>	getValidStyles(String tag, String delimiterPattern, StyleContext context, boolean esp)
private static String	removeForms(String s)
public static ParseResult	tokenize(String input, String delimiter, boolean enableStrictParsing)
public static ParseResult	Returns: A parse result containing the form tags and the parser tokens tokenize(String The string to parse input, String delimiter, boolean enableStrictParsing, StyleContext context) Extracts valid tokens and form tags from the given string

Inherited from java.lang.Object:: clone equals finalize getClass hashCode notify notifyAll toString wait wait wait

ESCAPE_SEQUENCE	back to summary
private static final char ESCAPE_SEQUENCE

FORM_CLOSE	back to summary
private static final char FORM_CLOSE

FORM_START	back to summary
private static final char FORM_START

Tokenizer	back to summary
private Tokenizer()

addValidStyles	back to summary
private static void addValidStyles(String s, List<AnsiCode> list, StyleContext context, boolean enableStrictParsing)

charNotEquals	back to summary
private static boolean charNotEquals(String input, int i, char c)

getValidStyles	back to summary
private static List<AnsiCode> getValidStyles(String tag, String delimiterPattern, StyleContext context, boolean esp)

removeForms	back to summary
private static String removeForms(String s)

tokenize	back to summary
public static ParseResult tokenize(String input, String delimiter, boolean enableStrictParsing)

tokenize	back to summary
public static ParseResult tokenize(String input, String delimiter, boolean enableStrictParsing, StyleContext context) Extracts valid tokens and form tags from the given string Parameters input:String The string to parse Returns:ParseResult A parse result containing the form tags and the parser tokens

tokenize

public static ParseResult tokenize(String input, String delimiter, boolean enableStrictParsing, StyleContext context)

Extracts valid tokens and form tags from the given string

Parameters

A parse result containing the form tags and the parser tokens