TokenType

class TokenType

The possible types of token returned from each get_next_token() call.

Fields

class TokenType

BINARY

The type of the None singleton.

CHAR

The type of the None singleton.

COMMA

The type of the None singleton.

COMMENT_MULTI

The type of the None singleton.

COMMENT_SINGLE

The type of the None singleton.

EOF

The type of the None singleton.

EQUAL_SIGN

The type of the None singleton.

ERROR

The type of the None singleton.

FLOAT

The type of the None singleton.

HEX

The type of the None singleton.

IDENTIFIER

The type of the None singleton.

IDENTIFIER_NULL

The type of the None singleton.

INT

The type of the None singleton.

LEFT_BRACE

The type of the None singleton.

LEFT_CURLY

The type of the None singleton.

LEFT_PAREN

The type of the None singleton.

NONE

The type of the None singleton.

OCTAL

The type of the None singleton.

RIGHT_BRACE

The type of the None singleton.

RIGHT_CURLY

The type of the None singleton.

RIGHT_PAREN

The type of the None singleton.

STRING

The type of the None singleton.

SYMBOL

The type of the None singleton.