[
https://issues.apache.org/jira/browse/PIG-3457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780398#comment-13780398
]
Daniel Dai commented on PIG-3457:
---------------------------------
Thanks for looking into it. Here is my answer:
1. The goal is to provide a backward compatible way for PPNL/PigStats in both
0.12/0.13. The patch provide a hack to achieve it, I am also open to explore
other solutions. So the answer is depends, but we need to provide backward
compatibility.
2. What I did here is to provide a JobStats copy of MRJobStats.
PigStats.JobGraph still have a MRJobStats plan internally. When we present to
user, we want user to get JobStats instead. Since we cannot upcast an object in
Java, so I create a new JobStats object and wrap the MRJobStats object.
Alternatively, I can create a new JobStats object, and copy every fields of
MRJobStats over. However, many fields in MRJobStats is marked private.
> Provide backward compatibility for PigStatsUtil and JobStats
> ------------------------------------------------------------
>
> Key: PIG-3457
> URL: https://issues.apache.org/jira/browse/PIG-3457
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.12.0
>
> Attachments: PIG-3457-1.patch, PIG-3457-2.patch, PIG-3457-3.patch,
> PIG-3457-4.patch, PIG-3457-5.patch
>
>
> PIG-3419 restructured PigStatsUtil which break downstream projects such as
> Oozie. Oozie uses PigStatsUtil.{HDFS_BYTES_WRITTEN, MAP_INPUT_RECORDS,
> MAP_OUTPUT_RECORDS, REDUCE_INPUT_RECORDS, REDUCE_OUTPUT_RECORDS}. We need to
> provide a backward compatible way.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
