Extra call to the namenode in WeightedRangePartitioner
------------------------------------------------------
Key: PIG-1219
URL: https://issues.apache.org/jira/browse/PIG-1219
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.6.0
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.6.0
We call FileLocalizer.openDFSFile in WeightedRangePartitioner to open quantile
file. openDFSFile internally will check the existence of the quantile file,
which adds burden to hdfs namenode. We shall remove this extra check.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
