[
https://issues.apache.org/jira/browse/HIVE-28596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17895247#comment-17895247
]
Stamatis Zampetakis commented on HIVE-28596:
--------------------------------------------
For some use-cases, the improvement here could avoid perf-issues such as the
OOM that appears in HIVE-28582.
> Skip ColumnAccessInfo collection when not needed to speed-up compilation
> ------------------------------------------------------------------------
>
> Key: HIVE-28596
> URL: https://issues.apache.org/jira/browse/HIVE-28596
> Project: Hive
> Issue Type: Improvement
> Security Level: Public(Viewable by anyone)
> Reporter: Stamatis Zampetakis
> Assignee: Stamatis Zampetakis
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> Avoid paying the perf-overhead of collecting {{ColumnAccessInfo}} via the
> {{HiveRelFieldTrimmer}} when it is not necessary.
> Currently, we only use the {{ColumnAccessInfo}} when we need to perform
> column based authorization or when it is requested explicitly by the user via
> the hive.stats.collect.scancols property.
> The field trimmer is an expensive operation and can become pretty slow for
> certain use-cases/queries so skipping some calls when it is not necessary is
> in general beneficial and can notably improve the compilation time for some
> queries.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
