Cldr.Number.Format.Compiler.tokenize

You're seeing just the function tokenize, go back to Cldr.Number.Format.Compiler module for more information.

Scan a number format definition

Using a leex lexer, tokenize a rule definition