Initializer
Tokenizer()
Attributes
columnSource Codeshared actual Integer column

The column number within the current line.

hasMoreSource Codeshared formal Boolean hasMore

Whether there is another character

lineSource Codeshared actual Integer line

The line number within the input.

positionSource Codeshared actual Integer position

The position (in characters) within the input.

unexpectedEndSource Codeshared ParseException unexpectedEnd
Inherited Attributes
Attributes inherited from: Object
Attributes inherited from: Positioned
Methods
characterSource Codeshared formal Character character()

The character at the current index, or throw

checkSource Codeshared Boolean check(Character c)

If the current character() is not the given character then return false. Otherwise moveOne() and return true.

eatSource Codeshared void eat(Character c)

If the current character is not the given character then throw, otherwise moveOne()

eatCharSource Codeshared Character eatChar()

The character at the current index, and move one

eatSpacesSource Codeshared void eatSpaces()

Consume characters until the first non-whitespace

eatSpacesUntilSource Codeshared void eatSpacesUntil(Character c)

Consume characters until the given character occurs

exceptionSource Codeshared ParseException exception(String message)
isDigitSource Codeshared Boolean isDigit(Character c)

true if the given character is 0, 1, 2, 3, 4, 5, 6, 7, 8 or 9.

isSpaceSource Codeshared Boolean isSpace(Character c)

true if the given character is a space, newline (\n), carriage return (\r) or a horizontal tab (\t).

moveOneSource Codeshared void moveOne()

Move to the next character

unexpectedCharacterSource Codeshared ParseException unexpectedCharacter(Character|String? expected)
Inherited Methods
Methods inherited from: Object