[
https://issues.apache.org/jira/browse/FLINK-14736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973823#comment-16973823
]
Bowen Li commented on FLINK-14736:
----------------------------------
Seems it shows two problems.
1) Looks like HiveTableSource failed to init all partitions. [~Terry1897] I
remember you mentioned that you are doing some optimization on partition
listing?
2) The sql seems have not been optimized. Shouldn't "select count(1) from
ies_antispam_test.big_graph_white_seeds_20191101_lxb" just return 1 without
needing to list any partitions?
> Fail to connect Hive metastore
> ------------------------------
>
> Key: FLINK-14736
> URL: https://issues.apache.org/jira/browse/FLINK-14736
> Project: Flink
> Issue Type: Bug
> Components: Connectors / Hive
> Affects Versions: 1.9.0
> Reporter: Jiayi Liao
> Assignee: Terry Wang
> Priority: Major
> Attachments: hivelog
>
>
> I created a very simple flink program using hive connector. According to
> logs, it seems that the program failed to connect hive metastore but it's
> okay with Spark on the same machine.
> Codes:
> {code:java}
> val fbEnv = ExecutionEnvironment.getExecutionEnvironment
> fbEnv.setParallelism(10);
> val fbTableEnv = BatchTableEnvironment.create(fbEnv)
> val hiveCatalog = new HiveCatalog("hive", null,
> "/data00/tiger/spark_deploy/spark-stable/conf", "1.2.1")
> fbTableEnv.registerCatalog("hive", hiveCatalog)
> fbTableEnv.useCatalog("hive")
> val testTable = fbTableEnv.sqlQuery("select count(1) from
> ies_antispam_test.big_graph_white_seeds_20191101_lxb")
> val dataSet = fbTableEnv.toDataSet[Row](testTable)
> dataSet.print()
> fbTableEnv.execute("Hive Query");
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
