Base class for ron tokenizer
Try to tokenize the input.
Tokenize the ron document and return the token list