sunjincheng created FLINK-10972:
-----------------------------------
Summary: Enhancements to Flink Table API
Key: FLINK-10972
URL: https://issues.apache.org/jira/browse/FLINK-10972
Project: Flink
Issue Type: Improvement
Components: Table API & SQL
Affects Versions: 1.7.1
Reporter: sunjincheng
Assignee: sunjincheng
With the continuous efforts from the community, the Flink system has been
continuously improved, which has attracted more and more users. Flink SQL is a
canonical, widely used relational query language. However, there are still some
scenarios where Flink SQL failed to meet user needs in terms of functionality
and ease of use, such as:
* In terms of functionality
Iteration, user-defined window, user-defined join, user-defined GroupReduce,
etc. Users cannot express them with SQL;
* In terms of ease of use
* Map - e.g. “dataStream.map(mapFun)”. Although “table.select(udf1(), udf2(),
udf3()....)” can be used to accomplish the same function., with a map()
function returning 100 columns, one has to define or call 100 UDFs when using
SQL, which is quite involved.
* FlatMap - e.g. “dataStrem.flatmap(flatMapFun)”. Similarly, it can be
implemented with “table.join(udtf).select()”. However, it is obvious that
datastream is easier to use than SQL.
Due to the above two reasons, In this JIRAs group, we will enhance the TableAPI
in stages.
-----------------------
The first state we seek to support (will describe the details in the sub issue)
:
* Table.map()
* Table.flatMap()
* GroupedTable.aggregate()
* GroupedTable.flatAggregate()
The design document and the discussion mail list can be find here:
Google doc:
[https://docs.google.com/document/d/1tnpxg31EQz2-MEzSotwFzqatsB4rNLz0I-l_vPa5H4Q/edit#|https://docs.google.com/document/d/1tnpxg31EQz2-MEzSotwFzqatsB4rNLz0I-l_vPa5H4Q/edit]
[DISCUSS] Enhancing the functionality and productivity of Table API :
[https://mail.google.com/mail/u/0/#search/xiaowe/QgrcJHsbcVCQqBxXcgCwnggdxDBljCvbbgQ]
[DISCUSS] Table API Enhancement Outline:
[https://mail.google.com/mail/u/0/#search/xiaowei/FMfcgxvzLWzfvCnmvMzzSfxHTSfdwLkB]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
