Class Tokenizer

moduleceylon.json1.3.2

Index
Search
Filter

Contract for a tokenizer

Anything
- Object
  - Basic ...and other supertypes
    Tokenizer ...and other supertypes

Tokenizer
- Basic
  - Identifiable
  - Object
    Anything
- Positioned

Tokenizer
- StringTokenizer

Initializer
`Tokenizer()`

Attributes
`column`	Source Code`shared actual Integer column` The column number within the current line. Refines `Positioned.column`
`hasMore`	Source Code`shared formal Boolean hasMore` Whether there is another character
`line`	Source Code`shared actual Integer line` The line number within the input. Refines `Positioned.line`
`position`	Source Code`shared actual Integer position` The position (in characters) within the input. Refines `Positioned.position`
`unexpectedEnd`	Source Code`shared ParseException unexpectedEnd`

Inherited Attributes
Attributes inherited from: `Object` `hash`, `string`
Attributes inherited from: `Positioned` `column`, `line`, `location`, `position`

Methods
`character`	Source Code`shared formal Character character()` The character at the current index, or throw
`check`	Source Code `shared Boolean check(Character c)` If the current `character()` is not the given character then return false. Otherwise `moveOne()` and return true.
`eat`	Source Code `shared void eat(Character c)` If the current character is not the given character then throw, otherwise `moveOne()`
`eatChar`	Source Code`shared Character eatChar()` The character at the current index, and move one
`eatSpaces`	Source Code`shared void eatSpaces()` Consume characters until the first non-whitespace
`eatSpacesUntil`	Source Code `shared void eatSpacesUntil(Character c)` Consume characters until the given character occurs
`exception`	Source Code `shared ParseException exception(String message)`
`isDigit`	Source Code `shared Boolean isDigit(Character c)` true if the given character is `0`, `1`, `2`, `3`, `4`, `5`, `6`, `7`, `8` or `9`.
`isSpace`	Source Code `shared Boolean isSpace(Character c)` true if the given character is a space, newline (`\n`), carriage return (`\r`) or a horizontal tab (`\t`).
`moveOne`	Source Code`shared void moveOne()` Move to the next character
`unexpectedCharacter`	Source Code `shared ParseException unexpectedCharacter(Character\|String?Go to Null abbreviations X? means Null\|X expected)`

Inherited Methods
Methods inherited from: `Object` `equals()`