Package org.csveed.token

The package responsible for reading a CSV line from a Reader and converting this to tokens. The tokens are translated to lines by a separate process. The tokenizer is highly configurable with regards to the symbols, skipping instructions and the start line.