[
https://issues.apache.org/jira/browse/FLINK-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16957515#comment-16957515
]
Leonard Xu commented on FLINK-13611:
------------------------------------
[~godfreyhe] [~f.pompermaier]
The PR wasn’t reviewed until now, Could you help take some effort to merge this
feature?
Because it‘s really useful and necessary for batch program like TPC-DS queries,
some TPC-DS queries (i.e. query 18 ) can run success only if it obtained table
statistics.
BTW,we plan to support all TPC-DS query in flink 1.10.0 refer FLINK-11491
> Introduce analyze statistic utility to generate table & column statistics
> -------------------------------------------------------------------------
>
> Key: FLINK-13611
> URL: https://issues.apache.org/jira/browse/FLINK-13611
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / Planner
> Reporter: godfrey he
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.10.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> this issue aims to introduce a utility class to generate table & column
> statistics, the main steps include:
> 1. generate sql, like
> {code:sql}
> select approx_count_distinct(a) as ndv, count(1) - count(a) as nullCount,
> avg(char_length(a)) as avgLen, max(char_lenght(a)) as maxLen, max(a) as
> maxValue, min(a) as minValue, ... from MyTable
> {code}
> 2. execute the query
> 3. convert to the result to {{TableStats}} (maybe the source table is not a
> {{ConnectorCatalogTable}})
> 4. convert to {{TableStats}} to {{CatalogTableStatistics}} if needed
> This issue does not involve DDL(like {{ANALYZE TABLE XXX}}), however the DDL
> could use this utility class once it's supported.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)