date:20151103

Hadoop-Mapreduce-trunk - Build # 2562 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2562/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32797 lines...]
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.007 sec - in 
org.apache.hadoop.mapreduce.lib.chain.TestChainErrors
Running org.apache.hadoop.mapreduce.lib.map.TestMultithreadedMapper
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.96 sec - in 
org.apache.hadoop.mapreduce.lib.map.TestMultithreadedMapper
Running org.apache.hadoop.mapreduce.TestMapCollection
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.993 sec - 
in org.apache.hadoop.mapreduce.TestMapCollection
Running org.apache.hadoop.io.TestSequenceFileMergeProgress
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.571 sec - in 
org.apache.hadoop.io.TestSequenceFileMergeProgress

Results :

Tests in error: 
  TestMRTimelineEventHandling.testMRTimelineEventHandling:99 » IO Job didn't 
fin...
  TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled:162 » IO 
Jo...

Tests run: 523, Failures: 0, Errors: 2, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.244 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:50 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 31.598 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  5.325 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [09:44 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [05:47 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:46 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:04 h
[INFO] Finished at: 2015-11-03T10:28:59+00:00
[INFO] Final Memory: 35M/708M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HADOOP-12437
Updating HADOOP-12541
Updating HADOOP-12542
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMRTimelineEventHandling

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMRTimelineEventHandling(TestMRTimelineEventHandling.java:99)


FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled(TestMRTimelineEventHandling.java:162)

Re: Planning Apache Hadoop 2.7.2

2015-11-03 Thread Vinod Vavilapalli

Got this count a bit wrong:
 - There are 13 tickets marked against 2.7.2 but only committed to 2.8.0
 - There are 10 tickets resolved without a patch - duplicates / invalids etc.
 - There are 77 patches marked and committed to 2.7.2.
 - There are a whole bunch of unresolved tickets in that 112 patches count, 
only at non-blocker/non-critical priority - 55 open major / minor / trivial 
tickets

Scanning through these remaining 55 unresolved major / minor / trivial tickets 
to see if there is anything important there.

Thanks
+Vinod


We already have about 112 patches in 2.7.2 already.

Hadoop-Mapreduce-trunk-Java8 - Build # 622 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/622/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10817 lines...]
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.743 sec - in 
org.apache.hadoop.mapred.TestJavaSerialization
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.149 sec - in 
org.apache.hadoop.mapred.TestSpecialCharactersInOutputPath
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.ipc.TestMRCJCSocketFactory
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.32 sec - in 
org.apache.hadoop.ipc.TestMRCJCSocketFactory

Results :

Tests in error: 
  TestMRTimelineEventHandling.testMRTimelineEventHandling:100 » IO Job didn't 
fi...
  TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled:162 » IO 
Jo...

Tests run: 523, Failures: 0, Errors: 2, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  2.155 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:25 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 25.676 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  4.170 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [10:50 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [06:06 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:42 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:01 h
[INFO] Finished at: 2015-11-03T23:16:47+00:00
[INFO] Final Memory: 34M/267M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HDFS-9362
Updating HDFS-9354
Updating YARN-4326
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMRTimelineEventHandling

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMRTimelineEventHandling(TestMRTimelineEventHandling.java:100)


FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled(TestMRTimelineEventHandling.java:162)

Hadoop-Mapreduce-trunk - Build # 2563 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2563/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32514 lines...]
  TestJobEndNotifier.testNotificationOnLastRetryNormalShutdown:204 
NoClassDefFound
  
TestJobEndNotifier.testAbsentNotificationOnNotLastRetryUnregistrationFailure:227
 NoClassDefFound
  TestJobEndNotifier.testNotificationOnLastRetryUnregistrationFailure:254 
NoClassDefFound
  TestJobHistoryEventHandler.testFirstFlushOnCompletionEvent:109 » 
ExceptionInInitializer
  TestJobHistoryEventHandler.testProcessDoneFilesNotLastAMRetry:330 » 
NoClassDefFound
  TestJobHistoryEventHandler.testTimelineEventHandling:489 » NoClassDefFound 
Cou...
  TestJobHistoryEventHandler.testProcessDoneFilesOnLastAMRetry:284 » 
NoClassDefFound
  TestJobHistoryEventHandler.testDefaultFsIsUsedForHistory:387 » NoClassDefFound
  TestJobHistoryEventHandler.testSigTermedFunctionality:794 » NoClassDefFound 
or...
  TestJobHistoryEventHandler.testMaxUnflushedCompletionEvents:152 » 
NoClassDefFound
  TestJobHistoryEventHandler.testAMStartedEvent:447 » NoClassDefFound Could not 
...
  TestJobHistoryEventHandler.testUnflushedTimer:197 » NoClassDefFound Could not 
...
  TestJobHistoryEventHandler.testBatchedFlushJobEndMultiplier:240 » 
NoClassDefFound

Tests run: 340, Failures: 0, Errors: 18, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  3.346 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:43 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 32.582 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  5.471 s]
[INFO] Apache Hadoop MapReduce App ... FAILURE [08:39 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 11:06 min
[INFO] Finished at: 2015-11-03T20:45:01+00:00
[INFO] Final Memory: 52M/1249M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HDFS-9362
Updating HDFS-9354
Updating YARN-4326
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
18 tests failed.
FAILED:  
org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler.testFirstFlushOnCompletionEvent

Error Message:
null

Stack Trace:
java.lang.ExceptionInInitializerError: null
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:190)
at

Re: Planning Apache Hadoop 2.7.2

2015-11-03 Thread Vinod Vavilapalli

I’m closing down 2.7.2 now, almost there.

Created a new branch-2.7.2 for the release so that any 2.7.3 patches can go 
into branch-2.7 directly.

Please reach out to me if you have any questions.

Thanks
+Vinod

On Nov 2, 2015, at 2:15 PM, Vinod Kumar Vavilapalli 
> wrote:

We are down to 4 now (https://issues.apache.org/jira/issues/?filter=12332867), 
appreciate help moving forward with them.

Thanks
+Vinod

On Oct 26, 2015, at 11:34 AM, Vinod Kumar Vavilapalli 
> wrote:

Got swamped again.

We already have about 112 patches in 2.7.2 already.

There are 15 open tickets in progress. I’ll push progress on them for an RC 
towards end of this week.

Thanks
+Vinod

On Sep 25, 2015, at 3:27 PM, Vinod Kumar Vavilapalli 
> wrote:

Hi all,

We released 2.7.1 nearly 2.5 months ago. I got caught up with a very long 
release process for 2.6.1 so couldn't make progress on a 2.7.2. Now is the time!

Things to do

 (#1) Branch
-- Branch 2.7 has been open to 2.7.2 commits for a while.
-- In order to converge on a release, I will branch out 2.7.2 soon.

  (#2) Patches
-- 2.7.2 already has a boat load [1] of fixes.
-- The list of open blocker / critical tickets [2] is not small. I'll start 
triaging and see what can make it in a week or so of time.

  (#3) Release
-- Even if we can get half of the blocker / critical tickets in, the full 
list [3] will be big enough for us to start voting on an RC in no less than a 
week.
-- Leaving aside some buffer time, I plan to start RC process by end of 
first week of October.

Thoughts?

Appreciate help in moving open tickets [2] forward.

A general note:  Please consider putting any critical / blocker tickets on 2.8 
into 2.6.2 and 2.7.2 releases.

Thanks
+Vinod

[1] 2.7.2 Fixed Tickets: https://issues.apache.org/jira/issues/?filter=12333473
[2] 2.7.2 Open Blockers / Critical Tickets: 
https://issues.apache.org/jira/issues/?filter=12332867
[3] 2.7.2 Release Tickets: 
https://issues.apache.org/jira/issues/?filter=12333461

Hadoop-Mapreduce-trunk - Build # 2564 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2564/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32035 lines...]
Running org.apache.hadoop.mapred.TestMapFileOutputFormat
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.332 sec - in 
org.apache.hadoop.mapred.TestMapFileOutputFormat
Running org.apache.hadoop.mapred.TestJobAclsManager
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.57 sec - in 
org.apache.hadoop.mapred.TestJobAclsManager
Running org.apache.hadoop.mapred.TestLineRecordReader
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.284 sec - 
in org.apache.hadoop.mapred.TestLineRecordReader
Running org.apache.hadoop.mapred.TestClock
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.208 sec - in 
org.apache.hadoop.mapred.TestClock
Running org.apache.hadoop.mapred.TestJobQueueClient
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.23 sec - in 
org.apache.hadoop.mapred.TestJobQueueClient

Results :

Failed tests: 
  TestJobEndNotifier.testNotificationTimeout:182 null

Tests run: 208, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [ 12.018 s]
[INFO] Apache Hadoop MapReduce Core .. FAILURE [05:08 min]
[INFO] Apache Hadoop MapReduce Common  SKIPPED
[INFO] Apache Hadoop MapReduce Shuffle ... SKIPPED
[INFO] Apache Hadoop MapReduce App ... SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 05:24 min
[INFO] Finished at: 2015-11-04T00:32:29+00:00
[INFO] Final Memory: 44M/1292M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-core: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-core
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HDFS-9289
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapred.TestJobEndNotifier.testNotificationTimeout

Error Message:
null

Stack Trace:
junit.framework.AssertionFailedError: null
at junit.framework.Assert.fail(Assert.java:55)
at junit.framework.Assert.assertTrue(Assert.java:22)
at junit.framework.Assert.assertTrue(Assert.java:31)
at junit.framework.TestCase.assertTrue(TestCase.java:201)
at 
org.apache.hadoop.mapred.TestJobEndNotifier.testNotificationTimeout(TestJobEndNotifier.java:182)

Re: Planning Apache Hadoop 2.7.2

2015-11-03 Thread Jian He

sorry, missed the cut.. 
I’d like to merge YARN-4127 into branch-2.7.2 also. 
That’s important because it prevents RM to startup, if the problem is hit.


> On Nov 3, 2015, at 3:24 PM, Vinod Vavilapalli  wrote:
> 
> I’m closing down 2.7.2 now, almost there.
> 
> Created a new branch-2.7.2 for the release so that any 2.7.3 patches can go 
> into branch-2.7 directly.
> 
> Please reach out to me if you have any questions.
> 
> Thanks
> +Vinod
> 
> On Nov 2, 2015, at 2:15 PM, Vinod Kumar Vavilapalli 
> > wrote:
> 
> We are down to 4 now 
> (https://issues.apache.org/jira/issues/?filter=12332867), appreciate help 
> moving forward with them.
> 
> Thanks
> +Vinod
> 
> On Oct 26, 2015, at 11:34 AM, Vinod Kumar Vavilapalli 
> > wrote:
> 
> Got swamped again.
> 
> We already have about 112 patches in 2.7.2 already.
> 
> There are 15 open tickets in progress. I’ll push progress on them for an RC 
> towards end of this week.
> 
> Thanks
> +Vinod
> 
> On Sep 25, 2015, at 3:27 PM, Vinod Kumar Vavilapalli 
> > wrote:
> 
> Hi all,
> 
> We released 2.7.1 nearly 2.5 months ago. I got caught up with a very long 
> release process for 2.6.1 so couldn't make progress on a 2.7.2. Now is the 
> time!
> 
> Things to do
> 
> (#1) Branch
>-- Branch 2.7 has been open to 2.7.2 commits for a while.
>-- In order to converge on a release, I will branch out 2.7.2 soon.
> 
>  (#2) Patches
>-- 2.7.2 already has a boat load [1] of fixes.
>-- The list of open blocker / critical tickets [2] is not small. I'll 
> start triaging and see what can make it in a week or so of time.
> 
>  (#3) Release
>-- Even if we can get half of the blocker / critical tickets in, the full 
> list [3] will be big enough for us to start voting on an RC in no less than a 
> week.
>-- Leaving aside some buffer time, I plan to start RC process by end of 
> first week of October.
> 
> Thoughts?
> 
> Appreciate help in moving open tickets [2] forward.
> 
> A general note:  Please consider putting any critical / blocker tickets on 
> 2.8 into 2.6.2 and 2.7.2 releases.
> 
> Thanks
> +Vinod
> 
> [1] 2.7.2 Fixed Tickets: 
> https://issues.apache.org/jira/issues/?filter=12333473
> [2] 2.7.2 Open Blockers / Critical Tickets: 
> https://issues.apache.org/jira/issues/?filter=12332867
> [3] 2.7.2 Release Tickets: 
> https://issues.apache.org/jira/issues/?filter=12333461
> 
> 
>

[jira] [Resolved] (MAPREDUCE-6355) 2.5 client cannot communicate with 2.5 job on 2.6 cluster

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)


 [ 
https://issues.apache.org/jira/browse/MAPREDUCE-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinod Kumar Vavilapalli resolved MAPREDUCE-6355.

Resolution: Won't Fix

Similar to YARN-3575, this token format-change (YARN-668) was a _"necessary 
evil"_ to support rolling-upgrades starting Hadoop 2.6. I requested offline 
that this be filed largely for documentation concerns.

There is only one way sites can avoid this incompatibility: all apps are to be 
upgraded to 2.6+ once you migrate your cluster to 2.6+ from < 2.6.

We *can* have an elaborate fix where the 2.5 clients tells YARN of its version 
so that RM can generate and propagate the right token-format, but at this 
stage, I am not sure of its value. Closing this for now as won't fix. Please 
reopen if you disagree. Thanks.


> 2.5 client cannot communicate with 2.5 job on 2.6 cluster
> -
>
> Key: MAPREDUCE-6355
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6355
> Project: Hadoop Map/Reduce
>  Issue Type: Bug
>Affects Versions: 2.6.0
>Reporter: Jason Lowe
>
> Trying to run a job on a Hadoop 2.6 cluster from a Hadoop 2.5 client 
> submitting a job that uses Hadoop 2.5 jars results in a job that succeeds but 
> the client cannot communicate with the AM while the job is running.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk-Java8 - Build # 623 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/623/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10814 lines...]
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.lib.chain.TestChainErrors
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.909 sec - in 
org.apache.hadoop.mapreduce.lib.chain.TestChainErrors
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.lib.map.TestMultithreadedMapper
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.973 sec - in 
org.apache.hadoop.mapreduce.lib.map.TestMultithreadedMapper
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.TestMapCollection
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.982 sec - 
in org.apache.hadoop.mapreduce.TestMapCollection
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.io.TestSequenceFileMergeProgress
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.365 sec - in 
org.apache.hadoop.io.TestSequenceFileMergeProgress

Results :

Tests in error: 
  TestMRTimelineEventHandling.testMRTimelineEventHandling:100 » IO Job didn't 
fi...
  TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled:162 » IO 
Jo...

Tests run: 521, Failures: 0, Errors: 2, Skipped: 11

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  2.252 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:28 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 25.695 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  4.190 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [10:59 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SUCCESS [06:22 min]
[INFO] Apache Hadoop MapReduce JobClient . FAILURE [  01:52 h]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 02:12 h
[INFO] Finished at: 2015-11-04T03:11:11+00:00
[INFO] Final Memory: 39M/209M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-jobclient: There was a timeout or other error 
in the fork -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-jobclient
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HDFS-9289
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
2 tests failed.
FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMRTimelineEventHandling

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at 
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMRTimelineEventHandling(TestMRTimelineEventHandling.java:100)


FAILED:  
org.apache.hadoop.mapred.TestMRTimelineEventHandling.testMapreduceJobTimelineServiceEnabled

Error Message:
Job didn't finish in 30 seconds

Stack Trace:
java.io.IOException: Job didn't finish in 30 seconds
at 
org.apache.hadoop.mapred.UtilsForTests.runJobSucceed(UtilsForTests.java:622)
at

Hadoop-Mapreduce-trunk-Java8 - Build # 624 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/624/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 10098 lines...]
Tests run: 23, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 24.789 sec - 
in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.954 sec - 
in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.jobhistory.TestJobSummary
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.359 sec - in 
org.apache.hadoop.mapreduce.jobhistory.TestJobSummary
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; 
support was removed in 8.0
Running org.apache.hadoop.mapreduce.jobhistory.TestEvents
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.625 sec - in 
org.apache.hadoop.mapreduce.jobhistory.TestEvents

Results :

Failed tests: 
  TestKill.testKillJob:84 Task state not correct expected: but was:

Tests run: 340, Failures: 1, Errors: 0, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  2.513 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [01:44 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [ 32.325 s]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [  5.454 s]
[INFO] Apache Hadoop MapReduce App ... FAILURE [11:57 min]
[INFO] Apache Hadoop MapReduce HistoryServer . SKIPPED
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 14:23 min
[INFO] Finished at: 2015-11-04T05:34:41+00:00
[INFO] Final Memory: 41M/246M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-app: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk-Java8/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-app
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HDFS-9351
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapreduce.v2.app.TestKill.testKillJob

Error Message:
Task state not correct expected: but was:

Stack Trace:
java.lang.AssertionError: Task state not correct expected: but was:
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:743)
at org.junit.Assert.assertEquals(Assert.java:118)
at 
org.apache.hadoop.mapreduce.v2.app.TestKill.testKillJob(TestKill.java:84)

Hadoop-Mapreduce-trunk - Build # 2565 - Still Failing

2015-11-03 Thread Apache Jenkins Server

See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2565/

###
## LAST 60 LINES OF THE CONSOLE 
###
[...truncated 32377 lines...]
Running org.apache.hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesAttempts
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.182 sec - 
in org.apache.hadoop.mapreduce.v2.hs.webapp.TestHsWebServicesAttempts
Running org.apache.hadoop.mapreduce.v2.hs.webapp.TestHsWebServices
Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.988 sec - 
in org.apache.hadoop.mapreduce.v2.hs.webapp.TestHsWebServices
Running org.apache.hadoop.mapreduce.v2.hs.webapp.TestBlocks
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.454 sec - in 
org.apache.hadoop.mapreduce.v2.hs.webapp.TestBlocks
Running org.apache.hadoop.mapreduce.v2.hs.webapp.TestHSWebApp
Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.439 sec - 
in org.apache.hadoop.mapreduce.v2.hs.webapp.TestHSWebApp
Running org.apache.hadoop.mapreduce.v2.hs.TestCompletedTask
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.931 sec - in 
org.apache.hadoop.mapreduce.v2.hs.TestCompletedTask

Results :

Tests in error: 
  TestJobListCache.testAddExisting:39 »  test timed out after 1000 milliseconds

Tests run: 198, Failures: 0, Errors: 1, Skipped: 0

[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop MapReduce Client  SUCCESS [  6.614 s]
[INFO] Apache Hadoop MapReduce Core .. SUCCESS [04:01 min]
[INFO] Apache Hadoop MapReduce Common  SUCCESS [01:04 min]
[INFO] Apache Hadoop MapReduce Shuffle ... SUCCESS [ 12.554 s]
[INFO] Apache Hadoop MapReduce App ... SUCCESS [17:01 min]
[INFO] Apache Hadoop MapReduce HistoryServer . FAILURE [09:20 min]
[INFO] Apache Hadoop MapReduce JobClient . SKIPPED
[INFO] Apache Hadoop MapReduce HistoryServer Plugins . SKIPPED
[INFO] Apache Hadoop MapReduce NativeTask  SKIPPED
[INFO] Apache Hadoop MapReduce Examples .. SKIPPED
[INFO] Apache Hadoop MapReduce ... SKIPPED
[INFO] 
[INFO] BUILD FAILURE
[INFO] 
[INFO] Total time: 31:50 min
[INFO] Finished at: 2015-11-04T05:05:19+00:00
[INFO] Final Memory: 49M/1180M
[INFO] 
[ERROR] Failed to execute goal 
org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on 
project hadoop-mapreduce-client-hs: There are test failures.
[ERROR] 
[ERROR] Please refer to 
/home/jenkins/jenkins-slave/workspace/Hadoop-Mapreduce-trunk/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/target/surefire-reports
 for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e 
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please 
read the following articles:
[ERROR] [Help 1] 
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn  -rf :hadoop-mapreduce-client-hs
Build step 'Execute shell' marked build as failure
[FINDBUGS] Skipping publisher since build result is FAILURE
Archiving artifacts
Recording test results
Updating HDFS-9351
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



###
## FAILED TESTS (if any) 
##
1 tests failed.
FAILED:  org.apache.hadoop.mapreduce.v2.hs.TestJobListCache.testAddExisting

Error Message:
test timed out after 1000 milliseconds

Stack Trace:
java.lang.Exception: test timed out after 1000 milliseconds
at org.mockito.internal.MockitoCore.(MockitoCore.java:40)
at org.mockito.Mockito.(Mockito.java:674)
at 
org.apache.hadoop.mapreduce.v2.hs.TestJobListCache.testAddExisting(TestJobListCache.java:39)

[jira] [Created] (MAPREDUCE-6534) Sorting based on applicaiton attempt not working in JHS

2015-11-03 Thread Bibin A Chundatt (JIRA)

Bibin A Chundatt created MAPREDUCE-6534:
---

 Summary: Sorting based on applicaiton attempt not working in JHS
 Key: MAPREDUCE-6534
 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6534
 Project: Hadoop Map/Reduce
  Issue Type: Bug
Reporter: Bibin A Chundatt


Steps to reproduce
===

1.Submit application with 1100 maps
2.Check successful maps in JHS
3.Try sorting based on attempt

/jobhistory/attempts/job_1446629175560_0005/m/SUCCESSFUL



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Hadoop-Mapreduce-trunk - Build # 2562 - Still Failing

Re: Planning Apache Hadoop 2.7.2

Hadoop-Mapreduce-trunk-Java8 - Build # 622 - Still Failing

Hadoop-Mapreduce-trunk - Build # 2563 - Still Failing

Re: Planning Apache Hadoop 2.7.2

Hadoop-Mapreduce-trunk - Build # 2564 - Still Failing

Re: Planning Apache Hadoop 2.7.2

[jira] [Resolved] (MAPREDUCE-6355) 2.5 client cannot communicate with 2.5 job on 2.6 cluster

Hadoop-Mapreduce-trunk-Java8 - Build # 623 - Still Failing

Hadoop-Mapreduce-trunk-Java8 - Build # 624 - Still Failing

Hadoop-Mapreduce-trunk - Build # 2565 - Still Failing

[jira] [Created] (MAPREDUCE-6534) Sorting based on applicaiton attempt not working in JHS

12 matches

Site Navigation

Mail list logo

Footer information