[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13914390#comment-13914390 ] Hudson commented on MAPREDUCE-5766: --- FAILURE: Integrated in Hadoop-Yarn-trunk #494 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/494/]) MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level inside the ApplicationMaster log. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1572380) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/TaskAttemptListenerImpl.java Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 2.4.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch, MAPREDUCE-5766.branch-2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13914524#comment-13914524 ] Hudson commented on MAPREDUCE-5766: --- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1686 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/1686/]) MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level inside the ApplicationMaster log. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1572380) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/TaskAttemptListenerImpl.java Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 2.4.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch, MAPREDUCE-5766.branch-2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13914603#comment-13914603 ] Hudson commented on MAPREDUCE-5766: --- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1711 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1711/]) MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level inside the ApplicationMaster log. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1572380) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/TaskAttemptListenerImpl.java Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 2.4.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch, MAPREDUCE-5766.branch-2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13913606#comment-13913606 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5766: The latest patch looks good. +1. Jian, it looks like we need a completely different patch for branch-2. Can you please look at that too? Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13913712#comment-13913712 ] Jian He commented on MAPREDUCE-5766: the ping is used to report child's aliveness to the parent, if no status progress available. trunk and branch-2 has diverged the implementation. upload the patch for branch-2 Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13913734#comment-13913734 ] Hadoop QA commented on MAPREDUCE-5766: -- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12631382/MAPREDUCE-5766.branch-2.patch against trunk revision . {color:red}-1 patch{color}. The patch command could not apply the patch. Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4380//console This message is automatically generated. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch, MAPREDUCE-5766.branch-2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13914006#comment-13914006 ] Hudson commented on MAPREDUCE-5766: --- SUCCESS: Integrated in Hadoop-trunk-Commit #5236 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/5236/]) MAPREDUCE-5766. Moved ping messages from TaskAttempts to be at DEBUG level inside the ApplicationMaster log. Contributed by Jian He. (vinodkv: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1572380) * /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt * /hadoop/common/trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/src/main/java/org/apache/hadoop/mapred/TaskAttemptListenerImpl.java Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 2.4.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch, MAPREDUCE-5766.branch-2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911630#comment-13911630 ] Jason Lowe commented on MAPREDUCE-5766: --- I understand the desire to move ping requests and JVM asking for task messages to debug, but do we really want to move status updates to debug? They are particularly useful for debugging why a particular task didn't speculate (a common ask from our users) as those messages report the progress of the task. It's also useful to verify the last time the AM saw a progress report from a task when the task expiry timeout gets triggered. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911815#comment-13911815 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5766: The message {{JVM with ID : + jvmId + asked for a task}} is also useful, we should retain it. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911857#comment-13911857 ] Hadoop QA commented on MAPREDUCE-5766: -- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12630992/MAPREDUCE-5766.2.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4373//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4373//console This message is automatically generated. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13912362#comment-13912362 ] Hadoop QA commented on MAPREDUCE-5766: -- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12631082/MAPREDUCE-5766.3.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4376//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4376//console This message is automatically generated. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch, MAPREDUCE-5766.2.patch, MAPREDUCE-5766.3.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911153#comment-13911153 ] Jian He commented on MAPREDUCE-5766: Trivial patch to move some logging into debug level. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)
[jira] [Commented] (MAPREDUCE-5766) Ping messages from attempts should be moved to DEBUG
[ https://issues.apache.org/jira/browse/MAPREDUCE-5766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911179#comment-13911179 ] Hadoop QA commented on MAPREDUCE-5766: -- {color:red}-1 overall{color}. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12630868/MAPREDUCE-5766.1.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. {color:green}+1 javac{color}. The applied patch does not increase the total number of javac compiler warnings. {color:green}+1 javadoc{color}. There were no new javadoc warning messages. {color:green}+1 eclipse:eclipse{color}. The patch built with eclipse:eclipse. {color:green}+1 findbugs{color}. The patch does not introduce any new Findbugs (version 1.3.9) warnings. {color:green}+1 release audit{color}. The applied patch does not increase the total number of release audit warnings. {color:green}+1 core tests{color}. The patch passed unit tests in hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app. {color:green}+1 contrib tests{color}. The patch passed contrib unit tests. Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4370//testReport/ Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/4370//console This message is automatically generated. Ping messages from attempts should be moved to DEBUG Key: MAPREDUCE-5766 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5766 Project: Hadoop Map/Reduce Issue Type: Bug Components: applicationmaster Reporter: Ramya Sunil Assignee: Jian He Priority: Minor Fix For: 0.24.0 Attachments: MAPREDUCE-5766.1.patch Messages such as org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1391416522080_0015_m_00_0 in AM logs should be moved to DEBUG. -- This message was sent by Atlassian JIRA (v6.1.5#6160)