> On April 30, 2014, 2:30 p.m., Rohini Palaniswamy wrote: > > src/org/apache/pig/tools/pigstats/PigStatusReporter.java, line 54 > > <https://reviews.apache.org/r/20761/diff/2/?file=569672#file569672line54> > > > > Can you make a amend checkin renaming this to destroy?
Sure, I will. Thanks for catching that. > On April 30, 2014, 2:30 p.m., Rohini Palaniswamy wrote: > > shims/src/hadoop23/org/apache/pig/backend/hadoop/executionengine/shims/TaskContext.java, > > line 104 > > <https://reviews.apache.org/r/20761/diff/2/?file=569655#file569655line104> > > > > We could have avoided the if/else and the shims class as well by having > > this class as abstract and different context types as implementations. But > > I guess this is good for now and we can refactor it later in a separate > > jira. Good suggestion. I'll follow up with a new jira. - Cheolsoo ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/20761/#review41831 ----------------------------------------------------------- On April 28, 2014, 9:32 p.m., Cheolsoo Park wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/20761/ > ----------------------------------------------------------- > > (Updated April 28, 2014, 9:32 p.m.) > > > Review request for pig, Daniel Dai and Rohini Palaniswamy. > > > Bugs: PIG-3860 > https://issues.apache.org/jira/browse/PIG-3860 > > > Repository: pig-git > > > Description > ------- > > The patch includes the following changes- > > 1) Introduce a generic class called TaskContext<?>. > - For MR, it holds TaskInputOutputContext > - For Tez, it holds TezProcessorContext > - For Fetch, it holds FetchContext > Note that it is under the shims package because TezProcessorContext is not > visible when -Dhadoopversion=20. > 2) Refactor PigStatusReporter and PigHadoopLogger by using generic > TaskContext instead of MR-specific TaskInputOutputContext. > 3) Whitespace fixes. > > The diff file in this RB request is for tez branch. I'll post another to the > jira for trunk. > > > Diffs > ----- > > > shims/src/hadoop20/org/apache/pig/backend/hadoop/executionengine/shims/TaskContext.java > e69de29 > > shims/src/hadoop23/org/apache/pig/backend/hadoop/executionengine/shims/TaskContext.java > e69de29 > src/org/apache/pig/TypedOutputEvalFunc.java 5c73bf5 > src/org/apache/pig/backend/hadoop/executionengine/fetch/FetchLauncher.java > 689e424 > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/MapReducePOStoreImpl.java > 215ff89 > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigCombiner.java > b41648f > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapBase.java > c52603f > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigGenericMapReduce.java > bb10f0c > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigHadoopLogger.java > 4db4a11 > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigMapReduceCounter.java > 2695be3 > > src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigRecordReader.java > 0c221e0 > > src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/PigLogger.java > 4ef44e8 > > src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POUserFunc.java > 16b6fb9 > > src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/util/MonitoredUDFExecutor.java > 8fc0c65 > src/org/apache/pig/backend/hadoop/executionengine/tez/PigProcessor.java > 7c8286a > src/org/apache/pig/backend/hadoop/executionengine/tez/PigTezLogger.java > c835e93 > > src/org/apache/pig/backend/hadoop/executionengine/tez/TezStatusReporter.java > e1b6157 > src/org/apache/pig/tools/counters/PigCounterHelper.java 0023035 > src/org/apache/pig/tools/pigstats/PigStatusReporter.java 5b1bc42 > > Diff: https://reviews.apache.org/r/20761/diff/ > > > Testing > ------- > > All unit tests pass. > All e2e tests pass except Warning_4 (known - PIG-3739). > > > Thanks, > > Cheolsoo Park > >
