[
https://issues.apache.org/jira/browse/HIVE-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15378270#comment-15378270
]
Gunther Hagleitner commented on HIVE-13934:
-------------------------------------------
DagUtils has methods to retrieve container size and xmx. The patch as is
doesn't work if container size isn't set for instance.
It's also not clear to me why these tez settings would be available in the conf
object in the map join conversion. I don't think that works. [~sseth]?
[~hitesh] couldn't you have given us a proper api instead of having to set some
random config and hoping for the best? Instead we have to carry out these
non-sensical computations in hive that only depend on internal tez parameters
and hand them to you via configuration (adjustMemoryReserveFraction).
> Configure Tez to make nocondiional task size memory available for the
> Processor
> -------------------------------------------------------------------------------
>
> Key: HIVE-13934
> URL: https://issues.apache.org/jira/browse/HIVE-13934
> Project: Hive
> Issue Type: Bug
> Reporter: Wei Zheng
> Assignee: Wei Zheng
> Attachments: HIVE-13934.1.patch, HIVE-13934.2.patch,
> HIVE-13934.3.patch, HIVE-13934.4.patch, HIVE-13934.6.patch,
> HIVE-13934.7.patch, HIVE-13934.8.patch
>
>
> Currently, noconditionaltasksize is not validated against the container size,
> the reservations made in the container by Tez for Inputs / Outputs etc.
> Check this at compile time to see if enough memory is available, or set up
> the vertex to reserve additional memory for the Processor.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
