TokenType

class TokenType

The possible types of token returned from each get_next_token() call.

Fields

class TokenType

BINARY

A binary integer

CHAR

A character

COMMA

A ‘,’ character

COMMENT_MULTI

Multi line comment

COMMENT_SINGLE

One line comment

EOF

The end of the file

EQUAL_SIGN

A ‘=’ character

ERROR

An error occurred

FLOAT

A floating point number

HEX

A hex integer

IDENTIFIER

An identifier

IDENTIFIER_NULL

A null identifier

INT

An integer

LEFT_BRACE

A ‘[’ character

LEFT_CURLY

A ‘{’ character

LEFT_PAREN

A ‘(’ character

NONE

Not a token

OCTAL

An octal integer

RIGHT_BRACE

A ‘]’ character

RIGHT_CURLY

A ‘}’ character

RIGHT_PAREN

A ‘)’ character

STRING

A string

SYMBOL

A symbol