Paul Beckingham ff445c567e Unit Tests: Lexer now tests embedded and isolated tokens ...

- The tests are now defined in a static structure, simplifying maintenance of
  these tests.
- Instead of simply lexing large strings and checking the lexemes, the tests
  now take a single token and test it as-is ("token"), and surrounded by spaces
  (" token "), which yields surprising results.

2015-03-28 09:22:33 -04:00

24 KiB

Raw Blame History

View Raw