[jira] [Assigned] (MAPREDUCE-6185) YARN M/R may return NaN for reducer progress after Job completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-6185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned MAPREDUCE-6185: -- Assignee: Weiwei Yang YARN M/R may return NaN for reducer progress after Job

[jira] [Commented] (MAPREDUCE-6185) YARN M/R may return NaN for reducer progress after Job completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-6185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14718076#comment-14718076 ] Weiwei Yang commented on MAPREDUCE-6185: I tried on 2.7.1 version, I did not

[jira] [Resolved] (MAPREDUCE-6185) YARN M/R may return NaN for reducer progress after Job completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-6185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved MAPREDUCE-6185. Resolution: Cannot Reproduce YARN M/R may return NaN for reducer progress after Job

[jira] [Assigned] (MAPREDUCE-5937) hadoop/mapred job -history shows the counters twice in the output.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned MAPREDUCE-5937: -- Assignee: Weiwei Yang (was: Jinghui Wang) > hadoop/mapred job -history shows the

[jira] [Updated] (MAPREDUCE-5937) hadoop/mapred job -history shows the counters twice in the output.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-5937: --- Assignee: (was: Weiwei Yang) > hadoop/mapred job -history shows the counters twice

[jira] [Updated] (MAPREDUCE-5937) hadoop/mapred job -history shows the counters twice in the output.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-5937: --- Assignee: Andres Perez (was: Andres Perez) > hadoop/mapred job -history shows the

[jira] [Updated] (MAPREDUCE-5937) hadoop/mapred job -history shows the counters twice in the output.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-5937: --- Assignee: Andres Perez > hadoop/mapred job -history shows the counters twice in the >

[jira] [Comment Edited] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868749#comment-15868749 ] Weiwei Yang edited comment on MAPREDUCE-6847 at 2/16/17 3:30 AM: -

[jira] [Comment Edited] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868749#comment-15868749 ] Weiwei Yang edited comment on MAPREDUCE-6847 at 2/16/17 3:32 AM: -

[jira] [Resolved] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved MAPREDUCE-6847. Resolution: Won't Fix > Job history server should release jobs from cache after a fixed

[jira] [Updated] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-6847: --- Status: Open (was: Patch Available) > Job history server should release jobs from cache

[jira] [Commented] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877292#comment-15877292 ] Weiwei Yang commented on MAPREDUCE-6847: Thanks [~jlowe] and [~haibochen] to provide your

[jira] [Updated] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-6847: --- Attachment: MAPREDUCE-6847.01.patch > Job history server should release jobs from cache

[jira] [Updated] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-6847: --- Status: Patch Available (was: Open) > Job history server should release jobs from cache

[jira] [Created] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

Weiwei Yang created MAPREDUCE-6847: -- Summary: Job history server should release jobs from cache after a fixed duration Key: MAPREDUCE-6847 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6847

[jira] [Commented] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15870168#comment-15870168 ] Weiwei Yang commented on MAPREDUCE-6847: Hi [~jlowe] I agree with most of your comments, I

[jira] [Commented] (MAPREDUCE-6847) Job history server should release jobs from cache after a fixed duration

[ https://issues.apache.org/jira/browse/MAPREDUCE-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868749#comment-15868749 ] Weiwei Yang commented on MAPREDUCE-6847: Hello [~jlowe] At present, JHS cache works like (for

[jira] [Commented] (MAPREDUCE-6762) ControlledJob#toString failed with NPE when job status is not successfully updated

[ https://issues.apache.org/jira/browse/MAPREDUCE-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429939#comment-15429939 ] Weiwei Yang commented on MAPREDUCE-6762: Thanks a lot [~varun_saxena]. >

[jira] [Created] (MAPREDUCE-6762) ControlledJob#toString failed with NPE when job status is not successfully updated

Weiwei Yang created MAPREDUCE-6762: -- Summary: ControlledJob#toString failed with NPE when job status is not successfully updated Key: MAPREDUCE-6762 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6762

[jira] [Commented] (MAPREDUCE-6762) ControlledJob#toString failed with NPE when job status is not successfully updated

[ https://issues.apache.org/jira/browse/MAPREDUCE-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427590#comment-15427590 ] Weiwei Yang commented on MAPREDUCE-6762: The error we saw from Pig console {code} 2016-07-20

[jira] [Commented] (MAPREDUCE-6762) ControlledJob#toString failed with NPE when job status is not successfully updated

[ https://issues.apache.org/jira/browse/MAPREDUCE-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427592#comment-15427592 ] Weiwei Yang commented on MAPREDUCE-6762: Attached v1 patch, including the test case to

[jira] [Updated] (MAPREDUCE-6762) ControlledJob#toString failed with NPE when job status is not successfully updated

[ https://issues.apache.org/jira/browse/MAPREDUCE-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-6762: --- Status: Patch Available (was: Open) > ControlledJob#toString failed with NPE when job

[jira] [Updated] (MAPREDUCE-6762) ControlledJob#toString failed with NPE when job status is not successfully updated

[ https://issues.apache.org/jira/browse/MAPREDUCE-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-6762: --- Attachment: MAPREDUCE-6762.001.patch > ControlledJob#toString failed with NPE when job

[jira] [Commented] (MAPREDUCE-6881) Fix warnings from Spotbugs in hadoop-mapreduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15984982#comment-15984982 ] Weiwei Yang commented on MAPREDUCE-6881: Thanks [~ajisakaa] for your review. Appreciate. >

[jira] [Commented] (MAPREDUCE-6881) Fix warnings from Spotbugs in hadoop-mapreduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986119#comment-15986119 ] Weiwei Yang commented on MAPREDUCE-6881: [~ajisakaa] Glad to help :). > Fix warnings from

[jira] [Updated] (MAPREDUCE-7100) Provide options to skip adding resource request for data-local and rack-local respectively

[ https://issues.apache.org/jira/browse/MAPREDUCE-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7100: --- Priority: Critical (was: Minor) > Provide options to skip adding resource request for

[jira] [Commented] (MAPREDUCE-7100) Provide options to skip adding resource request for data-local and rack-local respectively

[ https://issues.apache.org/jira/browse/MAPREDUCE-7100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16501377#comment-16501377 ] Weiwei Yang commented on MAPREDUCE-7100: Hi [~water] I just took a quick look at this issue,

[jira] [Updated] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7059: --- Priority: Critical (was: Minor) > Compatibility issue: job submission fails with

[jira] [Updated] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7059: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Updated] (MAPREDUCE-7059) Downward Compatibility issue: job submission fails with RpcNoSuchMethodException from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7059: --- Summary: Downward Compatibility issue: job submission fails with RpcNoSuchMethodException

[jira] [Updated] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7059: --- Summary: Downward Compatibility issue: MR job fails because of unknown

[jira] [Commented] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383064#comment-16383064 ] Weiwei Yang commented on MAPREDUCE-7059: Hi [~jlowe], yeah, I just cherry-picked this to

[jira] [Updated] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7059: --- Fix Version/s: 3.0.2 > Downward Compatibility issue: MR job fails because of unknown >

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378302#comment-16378302 ] Weiwei Yang commented on MAPREDUCE-7059: Thanks [~yangjiandan] for reporting this, I have

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379737#comment-16379737 ] Weiwei Yang commented on MAPREDUCE-7059: Hi [~yangjiandan] Thanks for the update, looks good

[jira] [Commented] (MAPREDUCE-7153) Protect XML Entity expansion while parsing XML in AllocationFileLoaderService

[ https://issues.apache.org/jira/browse/MAPREDUCE-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655356#comment-16655356 ] Weiwei Yang commented on MAPREDUCE-7153: +1, change looks good. But pls remove the unused

[jira] [Assigned] (MAPREDUCE-7174) mapreduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned MAPREDUCE-7174: -- Assignee: Fei Hui > mapreduce example wordmedian should handle generic options >

[jira] [Commented] (MAPREDUCE-7174) mapreduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16731839#comment-16731839 ] Weiwei Yang commented on MAPREDUCE-7174: Thanks [~ferhui]. This is a straightforward patch,

[jira] [Updated] (MAPREDUCE-7174) mapreduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7174: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0

[jira] [Updated] (MAPREDUCE-7174) mapreduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7174: --- Fix Version/s: 3.2.0 > mapreduce example wordmedian should handle generic options >

[jira] [Updated] (MAPREDUCE-7174) MapReduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7174: --- Summary: MapReduce example wordmedian should handle generic options (was: mapreduce

[jira] [Updated] (MAPREDUCE-7174) MapReduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7174: --- Fix Version/s: 3.1.2 > MapReduce example wordmedian should handle generic options >

[jira] [Updated] (MAPREDUCE-7174) MapReduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7174: --- Fix Version/s: 3.0.4 > MapReduce example wordmedian should handle generic options >

[jira] [Commented] (MAPREDUCE-7174) MapReduce example wordmedian should handle generic options

[ https://issues.apache.org/jira/browse/MAPREDUCE-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732137#comment-16732137 ] Weiwei Yang commented on MAPREDUCE-7174: I've committed the patch to all 3.x branches. Thanks

[jira] [Commented] (MAPREDUCE-7191) JobHistoryServer should log exception when loading/parsing history file failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789224#comment-16789224 ] Weiwei Yang commented on MAPREDUCE-7191: Hi [~yangjiandan] Thanks for the updates, it makes

[jira] [Commented] (MAPREDUCE-7192) JobHistoryServer attempts page support jump to containers log page in NM when logAggregation is disable

[ https://issues.apache.org/jira/browse/MAPREDUCE-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791465#comment-16791465 ] Weiwei Yang commented on MAPREDUCE-7192: Thanks [~yangjiandan] for the patch, and offline

[jira] [Updated] (MAPREDUCE-7192) JobHistoryServer attempts page support jump to containers log page in NM when logAggregation is disable

[ https://issues.apache.org/jira/browse/MAPREDUCE-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7192: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0

[jira] [Updated] (MAPREDUCE-7191) JobHistoryServer should log exception when loading/parsing history file failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7191: --- Priority: Minor (was: Major) > JobHistoryServer should log exception when

[jira] [Updated] (MAPREDUCE-7191) JobHistoryServer should log exception when loading/parsing history file failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7191: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.3

[jira] [Updated] (MAPREDUCE-7192) JobHistoryServer attempts page support jump to containers log page in NM when logAggregation is disable

[ https://issues.apache.org/jira/browse/MAPREDUCE-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated MAPREDUCE-7192: --- Fix Version/s: 3.2.1 > JobHistoryServer attempts page support jump to containers log

[jira] [Commented] (MAPREDUCE-7192) JobHistoryServer attempts page support jump to containers log page in NM when logAggregation is disable

[ https://issues.apache.org/jira/browse/MAPREDUCE-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791733#comment-16791733 ] Weiwei Yang commented on MAPREDUCE-7192: Pushed to trunk, cherry picked to branch-3.2. Thanks

[jira] [Comment Edited] (MAPREDUCE-7191) JobHistoryServer should log exception when loading/parsing history file failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787508#comment-16787508 ] Weiwei Yang edited comment on MAPREDUCE-7191 at 3/8/19 4:01 AM: Sure,

[jira] [Commented] (MAPREDUCE-7191) JobHistoryServer should log exception when loading/parsing history file failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787508#comment-16787508 ] Weiwei Yang commented on MAPREDUCE-7191: Sure, thanks [~yangjiandan] for filing the issue.