[
https://issues.apache.org/jira/browse/HIVE-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HIVE-11777:
------------------------------------
Description:
In case of metastore footer PPD we don't want to call PPD call with all
attendant SARG, MS and HBase overhead for each directory. If we wait for some
time (10ms? some fraction of inputs?) we can do one call without losing overall
perf.
For now make it time based.
NO PRECOMMIT TESTS
was:
In case of metastore footer PPD we don't want to call PPD call with all
attendant SARG, MS and HBase overhead for each directory. If we wait for some
time (10ms? some fraction of inputs?) we can do one call without losing overall
perf.
For now make it time based.
> implement an option to have single ETL strategy for multiple directories
> ------------------------------------------------------------------------
>
> Key: HIVE-11777
> URL: https://issues.apache.org/jira/browse/HIVE-11777
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-11777.patch
>
>
> In case of metastore footer PPD we don't want to call PPD call with all
> attendant SARG, MS and HBase overhead for each directory. If we wait for some
> time (10ms? some fraction of inputs?) we can do one call without losing
> overall perf.
> For now make it time based.
> NO PRECOMMIT TESTS
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
