Stamatis Zampetakis created HIVE-28596:
------------------------------------------
Summary: Skip ColumnAccessInfo collection when not needed to
speed-up compilation
Key: HIVE-28596
URL: https://issues.apache.org/jira/browse/HIVE-28596
Project: Hive
Issue Type: Improvement
Security Level: Public (Viewable by anyone)
Reporter: Stamatis Zampetakis
Assignee: Stamatis Zampetakis
Avoid paying the perf-overhead of collecting {{ColumnAccessInfo}} via the
{{HiveRelFieldTrimmer}} when it is not necessary.
Currently, we only use the {{ColumnAccessInfo}} when we need to perform column
based authorization or when it is requested explicitly by the user via the
hive.stats.collect.scancols property.
The field trimmer is an expensive operation and can become pretty slow for
certain use-cases/queries so skipping some calls when it is not necessary is in
general beneficial and can notably improve the compilation time for some
queries.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
