[jira] [Updated] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Tsuyoshi OZAWA (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsuyoshi OZAWA updated MAPREDUCE-5463:
--

Status: Patch Available  (was: Open)

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
 Attachments: MAPREDUCE-5463.1.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Tsuyoshi OZAWA (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsuyoshi OZAWA updated MAPREDUCE-5463:
--

Attachment: MAPREDUCE-5463.1.patch

Marked SLOTS_MILLIS_MAPS and SLOTS_MILLIS_REDUCES as deprecated.

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
 Attachments: MAPREDUCE-5463.1.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Tsuyoshi OZAWA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760004#comment-13760004
 ] 

Tsuyoshi OZAWA commented on MAPREDUCE-5463:
---

Additionally, should FALLOW_SLOTS_MILLIS_MAPS and FALLOW_SLOTS_MILLIS_REDUCES 
be marked as deprecated?

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
 Attachments: MAPREDUCE-5463.1.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Sandy Ryza (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760007#comment-13760007
 ] 

Sandy Ryza commented on MAPREDUCE-5463:
---

Yeah, the FALLOW properties should be marked as deprecated as well.

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
 Attachments: MAPREDUCE-5463.1.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760011#comment-13760011
 ] 

Hadoop QA commented on MAPREDUCE-5463:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12601773/MAPREDUCE-5463.1.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

  {color:red}-1 javac{color}.  The applied patch generated 1170 javac 
compiler warnings (more than the trunk's current 1146 warnings).

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3984//testReport/
Javac warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3984//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3984//console

This message is automatically generated.

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
 Attachments: MAPREDUCE-5463.1.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-5441) JobClient exit whenever RM issue Reboot command to 1st attempt App Master.

2013-09-06 Thread Priyank Rastogi (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Priyank Rastogi updated MAPREDUCE-5441:
---

Affects Version/s: (was: 2.1.1-beta)

 JobClient exit whenever RM issue Reboot command to 1st attempt App Master.
 --

 Key: MAPREDUCE-5441
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5441
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: applicationmaster, client
Affects Versions: 2.1.0-beta, 2.0.5-alpha
Reporter: Rohith Sharma K S
Assignee: Jian He
 Fix For: 2.1.1-beta

 Attachments: MAPREDUCE-5441.1.patch, MAPREDUCE-5441.2.patch, 
 MAPREDUCE-5441.3.patch, MAPREDUCE-5441.4.patch, MAPREDUCE-5441.patch


 When RM issue Reboot command to app master, app master shutdown gracefully. 
 All the history event are writtent to hdfs with job status set as ERROR. 
 Jobclient get job state as ERROR and exit. 
 But RM launches 2nd attempt app master where no client are there to get job 
 status.In RM UI, job status is displayed as SUCCESS but for client Job is 
 Failed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Created] (MAPREDUCE-5498) maven Junit dependency should be test only

2013-09-06 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-5498:
-

 Summary: maven Junit dependency should be test only
 Key: MAPREDUCE-5498
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5498
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: build
Affects Versions: 2.1.0-beta, 3.0.0
Reporter: Steve Loughran
Priority: Minor


The maven dependencies for the YARN artifacts don't restrict to test time, so 
it gets picked up by all downstream users.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-5498) maven Junit dependency should be test only

2013-09-06 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated MAPREDUCE-5498:
--

Attachment: HADOOP-9935-001.patch

Patch from André Kelpe for HADOOP-9935; this JIRA is to test the MRv2 section

 maven Junit dependency should be test only
 --

 Key: MAPREDUCE-5498
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5498
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: build
Affects Versions: 3.0.0, 2.1.0-beta
Reporter: Steve Loughran
Priority: Minor
 Attachments: HADOOP-9935-001.patch


 The maven dependencies for the YARN artifacts don't restrict to test time, so 
 it gets picked up by all downstream users.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-5498) maven Junit dependency should be test only

2013-09-06 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated MAPREDUCE-5498:
--

Status: Patch Available  (was: Open)

 maven Junit dependency should be test only
 --

 Key: MAPREDUCE-5498
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5498
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: build
Affects Versions: 2.1.0-beta, 3.0.0
Reporter: Steve Loughran
Priority: Minor
 Attachments: HADOOP-9935-001.patch


 The maven dependencies for the YARN artifacts don't restrict to test time, so 
 it gets picked up by all downstream users.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Tsuyoshi OZAWA (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsuyoshi OZAWA updated MAPREDUCE-5463:
--

Assignee: Tsuyoshi OZAWA

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
Assignee: Tsuyoshi OZAWA
 Attachments: MAPREDUCE-5463.1.patch, MAPREDUCE-5463.2.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (MAPREDUCE-5498) maven Junit dependency should be test only

2013-09-06 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760316#comment-13760316
 ] 

Hadoop QA commented on MAPREDUCE-5498:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12601836/HADOOP-9935-001.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in .

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3985//testReport/
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3985//console

This message is automatically generated.

 maven Junit dependency should be test only
 --

 Key: MAPREDUCE-5498
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5498
 Project: Hadoop Map/Reduce
  Issue Type: Bug
  Components: build
Affects Versions: 3.0.0, 2.1.0-beta
Reporter: Steve Loughran
Priority: Minor
 Attachments: HADOOP-9935-001.patch


 The maven dependencies for the YARN artifacts don't restrict to test time, so 
 it gets picked up by all downstream users.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760340#comment-13760340
 ] 

Hadoop QA commented on MAPREDUCE-5463:
--

{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12601843/MAPREDUCE-5463.2.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

  {color:red}-1 javac{color}.  The applied patch generated 1170 javac 
compiler warnings (more than the trunk's current 1146 warnings).

{color:green}+1 javadoc{color}.  The javadoc tool did not generate any 
warning messages.

{color:green}+1 eclipse:eclipse{color}.  The patch built with 
eclipse:eclipse.

{color:green}+1 findbugs{color}.  The patch does not introduce any new 
Findbugs (version 1.3.9) warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core.

{color:green}+1 contrib tests{color}.  The patch passed contrib unit tests.

Test results: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3986//testReport/
Javac warnings: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3986//artifact/trunk/patchprocess/diffJavacWarnings.txt
Console output: 
https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/3986//console

This message is automatically generated.

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
Assignee: Tsuyoshi OZAWA
 Attachments: MAPREDUCE-5463.1.patch, MAPREDUCE-5463.2.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-4980) Parallel test execution of hadoop-mapreduce-client-core

2013-09-06 Thread Andrey Klochkov (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrey Klochkov updated MAPREDUCE-4980:
---

Status: Open  (was: Patch Available)

the patch needs to be rebased, I'm working on it.

 Parallel test execution of hadoop-mapreduce-client-core
 ---

 Key: MAPREDUCE-4980
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4980
 Project: Hadoop Map/Reduce
  Issue Type: Test
  Components: test
Affects Versions: 3.0.0
Reporter: Tsuyoshi OZAWA
Assignee: Andrey Klochkov
 Attachments: MAPREDUCE-4980.1.patch, MAPREDUCE-4980--n3.patch, 
 MAPREDUCE-4980--n4.patch, MAPREDUCE-4980--n5.patch, MAPREDUCE-4980.patch


 The maven surefire plugin supports parallel testing feature. By using it, the 
 tests can be run more faster.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (MAPREDUCE-5463) Deprecate SLOTS_MILLIS counters

2013-09-06 Thread Tsuyoshi OZAWA (JIRA)

 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-5463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsuyoshi OZAWA updated MAPREDUCE-5463:
--

Attachment: MAPREDUCE-5463.2.patch

Update FALLOW_SLOTS_MILLIS_MAPS and FALLOW_SLOTS_MILLIS_REDUCES to be marked as 
deprecated.

The javac warnings seems to be generated because the deprecated counters are 
still used. This problem should be resolved in other jira.

 Deprecate SLOTS_MILLIS counters
 ---

 Key: MAPREDUCE-5463
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5463
 Project: Hadoop Map/Reduce
  Issue Type: Task
Affects Versions: 2.1.0-beta
Reporter: Sandy Ryza
 Attachments: MAPREDUCE-5463.1.patch, MAPREDUCE-5463.2.patch


 As discussed in MAPREDUCE-5311, the SLOTS_MILLIS_MAPS and 
 SLOTS_MILLIS_REDUCES counters don't really make sense in MR2, and should be 
 deprecated so that they can eventually be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira