[
https://issues.apache.org/jira/browse/HIVE-653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12732720#action_12732720
]
dhruba borthakur commented on HIVE-653:
---------------------------------------
The Hadoop JobClient class could be extended to check the following:
1. The total number of mappers/reduces that a job can use
2. The total size of data that the job will process
These are not strictly related to hive but might be useful for most warehouse
type of applications.
Another solution would be to use the Hive pre-query hook to check these
constraints.
> Limit job hive queries to conform to underlying hadoop capacities
> ------------------------------------------------------------------
>
> Key: HIVE-653
> URL: https://issues.apache.org/jira/browse/HIVE-653
> Project: Hadoop Hive
> Issue Type: Improvement
> Components: Clients
> Reporter: dhruba borthakur
>
> The Hive client should match underlying cluster capacity with cost estimates
> from a newly submitted job. The newly submitted job should be rejected if it
> exceeds the capacity of the cluster.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
