[jira] [Created] (ARROW-8828) [Rust] Implement SQL tokenizer

[Andy Grove (Jira)]

Andy Grove created ARROW-8828:
---------------------------------

             Summary: [Rust] Implement SQL tokenizer
                 Key: ARROW-8828
                 URL: https://issues.apache.org/jira/browse/ARROW-8828
             Project: Apache Arrow
          Issue Type: Sub-task
          Components: Rust, Rust - DataFusion
            Reporter: Andy Grove
            Assignee: Andy Grove
             Fix For: 1.0.0


Implement enum for all supported SQL tokens and implement a tokenizer that can 
tokenize a SQL string and produce a Vec<SQLToken>.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)