Lexer class

Method	Defined by
Lexer(string: string, delimiters: (Delimiter|string)[]) Constructor.	Lexer
consume(no: number = 1): IToken Consume and return token.	Lexer
lookahead(no: number = 1): IToken Get the token without consuming it.	Lexer
reset(): void Reset index back to beginning.	Lexer
setDelimiters(delimiters: (Delimiter|string)[]): void Set list of delimiters.	Lexer
tokenize(): IToken Tokenize the source into list of tokens.	Lexer