[
https://issues.apache.org/jira/browse/HIVE-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HIVE-11777:
------------------------------------
Description:
In case of metastore footer PPD we don't want to call PPD call with all
attendant SARG, MS and HBase overhead for each directory. If we wait for some
time (10ms? some fraction of inputs?) we can do one call without losing overall
perf.
For now make it time based.
was:
In case of metastore footer PPD we don't want to call PPD call with all
attendant SARG, MS and HBase overhead for each directory. If we wait for some
time (10ms? some fraction of inputs?) we can do one call without losing overall
perf.
For now make it time based.
NO PRECOMMIT TESTS
> implement an option to have single ETL strategy for multiple directories
> ------------------------------------------------------------------------
>
> Key: HIVE-11777
> URL: https://issues.apache.org/jira/browse/HIVE-11777
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-11777.01.patch, HIVE-11777.02.patch,
> HIVE-11777.patch
>
>
> In case of metastore footer PPD we don't want to call PPD call with all
> attendant SARG, MS and HBase overhead for each directory. If we wait for some
> time (10ms? some fraction of inputs?) we can do one call without losing
> overall perf.
> For now make it time based.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
