Given a lexeme, return a matching Elixir value (or an error).

Example

iex> Sammal.Tokenizer.lexeme_to_value(“12”)

iex> Sammal.Tokenizer.lexeme_to_value(“12.12”)

iex> Sammal.Tokenizer.lexeme_to_value(“\”12\””)

Split a line of raw input into a list of Node structs.

Example

iex> Sammal.Tokenizer.tokenize(“(define x 10)”) {:ok, [%Sammal.Expr{lex: “(“, line: 0, row: 0, val: :”(“, ctx: “(define x 10)”},

     %Sammal.Expr{lex: "define", line: 0, row: 1, val: :define, ctx: "(define x 10)"},
     %Sammal.Expr{lex: "x", line: 0, row: 8, val: :x, ctx: "(define x 10)"},
     %Sammal.Expr{lex: "10", line: 0, row: 10, val: 10, ctx: "(define x 10)"},
     %Sammal.Expr{lex: ")", line: 0, row: 12, val: :")", ctx: "(define x 10)"}]}