[
https://issues.apache.org/jira/browse/TEZ-4082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16916039#comment-16916039
]
Jonathan Eagles commented on TEZ-4082:
--------------------------------------
[~rajesh.balamohan], was hoping that since TezCommonUtils is marked private
that it wouldn't be used. Now that I look closely, Hive is using some of the
APIs in TezCommonUtils, but not getTezBaseStagingPath or callers at least that
I can see. As all clients need to call
TezClientUtils::createApplicationSubmissionContext (also private) under the
hood, we can ensure that TezClientUtils::ensureStagingDirExists is called in
every case. Pig and Hive have a separate framework staging dir IIRC.
{code}
@Private
public class TezCommonUtils {
...
}
{code}
> Reduce excessive getFileLinkInfo calls in Tez
> ---------------------------------------------
>
> Key: TEZ-4082
> URL: https://issues.apache.org/jira/browse/TEZ-4082
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Jonathan Eagles
> Assignee: Jonathan Eagles
> Priority: Major
> Attachments: TEZ-4082.001.patch, TEZ-4082.002.patch,
> TEZ-4082.003.patch, TEZ-4082.004.patch
>
>
> Tez benefits from the improvements MAPREDUCE-7232, but also has some
> redundancy with fileSystem usage of getFileLinkInfo (resolvePath)
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
