xudong963 commented on a change in pull request #1104: URL: https://github.com/apache/arrow-datafusion/pull/1104#discussion_r731440525
########## File path: docs/source/specification/roadmap.md ########## @@ -0,0 +1,93 @@ +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +# Roadmap + +This document describes high level goals of the DataFusion and +Ballista development community. It is not meant to restrict +possibilities, but rather help newcomers understand the broader +context of where the community is headed, and inspire +additional contributions. + +DataFusion and Ballista are part of the [Apache +Arrow](https://arrow.apache.org/) project and governed by the Apache +Software Foundation governance model. These projects are entirely +driven by volunteers, and we welcome contributions for items not on +this roadmap. However, before submitting a large PR, we strongly +suggest you start a coversation using a github issue or the [email protected] mailing list to make review efficient and avoid +surprises. + +# DataFusion + +DataFusion's goal is to become the embedded query engine of choice +for new analytic applications, by leveraging the unique features of +[Rust](https://www.rust-lang.org/) and [Apache Arrow](https://arrow.apache.org/) +to provide: + +1. Best-in-class single node query performance +2. A Declarative SQL query interface compatible with PostgreSQL +3. A Dataframe API, similar to those offered by Pandas and Spark +4. A Procedural API for programatically creating and running execution plans +5. High performance, data race free, erogonomic extensibility points at at every layer + +## Additional SQL Language Features + +- Complete support list on [status](https://github.com/apache/arrow-datafusion/blob/master/README.md#status) +- Timestamp Arithmetic [#194](https://github.com/apache/arrow-datafusion/issues/194) +- SQL Parser extension point [#533](https://github.com/apache/arrow-datafusion/issues/533) +- Support for nested structures (fields, lists, structs) [#119](https://github.com/apache/arrow-datafusion/issues/119) +- Remaining Set Operators (`INTERSECT` / `EXCEPT`) [#1082](https://github.com/apache/arrow-datafusion/issues/1082) +- Run all queries from the TPCH benchmark (see [milestone](https://github.com/apache/arrow-datafusion/milestone/2) for more details) + +## Query Optimizer + +- Additional constant folding / partial evaluation [#1070](https://github.com/apache/arrow-datafusion/issues/1070) +- More sophisticated cost based optimizer for join ordering +Implement advanced query optimization framework (Tokomak) #440 Review comment: ```suggestion - Implement advanced query optimization framework (Tokomak) #440 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
