org.bitbucket.jrsofty.parser.logging.util

Class Tokenizer

java.lang.Object

org.bitbucket.jrsofty.parser.logging.util.Tokenizer

public class Tokenizer
extends Object

Helper class providing multiple ways to tokenize a String for parsing.

Author:

jrsofty

Constructor Summary

Constructors

Constructor and Description
Tokenizer()

Method Summary

Modifier and Type	Method and Description
String[]	quotedWhiteSpaceTokenizer(String value) Splits a given string into tokens based on white space.
String[]	simpleWhiteSpaceTokenizer(String value) Splits a given string into tokens based on white space.
String[]	tokenizeWithPattern(String regexPattern, String value) Split the value string with a custom regex pattern.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

simpleWhiteSpaceTokenizer

public String[] simpleWhiteSpaceTokenizer(String value)

Splits a given string into tokens based on white space. This ignores quotation marks. So in a line like

 The "dirty red" fish was here.
 

the tokens would be

• The
• "dirty
• red"
• fish
• was
• here.

Parameters:

value - The String to be tokenized.

Returns:

an array of String containing the tokens of the value.

quotedWhiteSpaceTokenizer

public String[] quotedWhiteSpaceTokenizer(String value)

Splits a given string into tokens based on white space. This function recognizes quotation marks and any white space there contained is kept. So in a line like

 The "dirty red" fish was here.
 

the tokens would be

• The
• dirty red
• fish
• was
• here.

Parameters:

value - the text line that should be split into tokens.

Returns:

an array of String containing the tokens of the value.

tokenizeWithPattern

public String[] tokenizeWithPattern(String regexPattern,
                                    String value)

Split the value string with a custom regex pattern. This method supports multiple groups in the regex pattern.

Parameters:

regexPattern - The RegEx pattern as String

value - the value to be split by the RegEx pattern.

Returns:

an array of String containing the tokens of the value.