[
https://issues.apache.org/jira/browse/IMPALA-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18016508#comment-18016508
]
ASF subversion and git services commented on IMPALA-13947:
----------------------------------------------------------
Commit 048b5689fd6adbe7f7e7fda0f04bd95c6f510a45 in impala's branch
refs/heads/master from Steve Carlin
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=048b5689f ]
IMPALA-14080: Support LocalFsTable table types in Calcite planner.
IMPALA-13947 changes the use_local_catalog default to true. This causes
failure for when the use_calcite_planner query option is set to true.
The Calcite planner was only handling HdfsTable table types. It will
now handle LocalFsTable table types as well.
Currently, if table num rows is missing from table, Calcite planner will
load all partitions to estimate by iterating all partitions. This is
inefficent in local catalog mode and ideally should happen later after
partition prunning. Follow up work is needed to improve this.
Testing:
Reenable local catalog mode in
TestCalcitePlanner.test_calcite_frontend
TestWorkloadManagementSQLDetailsCalcite.test_tpcds_8_decimal
Co-authored-by: Riza Suminto
Change-Id: Ic855779aa64d11b7a8b19dd261c0164e65604e44
Reviewed-on: http://gerrit.cloudera.org:8080/23341
Reviewed-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
Tested-by: Impala Public Jenkins <impala-public-jenk...@cloudera.com>
> Turn on local-catalog mode by default
> -------------------------------------
>
> Key: IMPALA-13947
> URL: https://issues.apache.org/jira/browse/IMPALA-13947
> Project: IMPALA
> Issue Type: Task
> Components: Catalog
> Reporter: Quanlong Huang
> Assignee: Riza Suminto
> Priority: Major
> Fix For: Impala 5.0.0
>
>
> This aims to turn on local-catalog mode by default.
> One behavior change is FileSystem permission checks will be defered to the
> execution stage (IMPALA-7539). Note that in the legacy catalog mode,
> permission checks are done in planning stage so illegal queries can fail
> before execution. But preloading all the dir/file permissions is found to be
> a bottleneck of metadata loading on large tables. So we decided to skip it in
> IMPALA-12929.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
