class   RonLexer

Base class for ron tokenizer

static   bool   TryTokenize  (string source,out TokenList<RonTokenKind> tokens,out Exception exception)

Try to tokenize the input.

source: The source code.
tokens: The token list if successful.
exception: The exception if failed.
returns: True if the tokenizer succeeds.

static   TokenList<RonTokenKind> Tokenize (string source)

Tokenize the ron document and return the token list

source: The source code to parse.
returns: The token list.