[
https://issues.apache.org/jira/browse/FLINK-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009610#comment-17009610
]
Jingsong Lee commented on FLINK-15498:
--------------------------------------
Hi [~ykt836], we also have moved kafka examples to E2E tests too:
https://issues.apache.org/jira/browse/FLINK-10922 I don't think this is a
benchmark tool, it is just a e2e example.
But I am OK with example or flink-packages or flink-sql-benchmark.
> Using HiveCatalog in TPC-DS e2e
> -------------------------------
>
> Key: FLINK-15498
> URL: https://issues.apache.org/jira/browse/FLINK-15498
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Planner, Tests
> Reporter: Jingsong Lee
> Priority: Major
> Fix For: 1.11.0
>
>
> In 1.10, we have made great progress in the performance and function of
> batch. After our internal test, the performance is significantly ahead of
> hive.
> But it's hard for users to reproduce. They need to have some research on
> TPC-DS to write test code.
> We can consider changing the E2E test of TPC-DS to HiveCatalog, which is
> roughly divided into two stages:
> # The first stage is prepare of hive. Prepare the tables of TPC-DS. Insert
> the data and prepare the metastore. And analysis the tables.
> # The second stage is the analysis of Flink. Only select and check results.
> Users can play with it only by changing the data scale of the first stage.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
