See <https://builds.apache.org/job/Tez-Build/124/changes>
Changes: [hitesh] TEZ-402. Define a TezTaskContext for user code to interact with the AM. (hitesh) [sseth] TEZ-208. Update Input, Output and Processor APIs as part of Tez [hitesh] Revert "TEZ-402. Define a TezTaskContext for user code to interact with the AM. (hitesh)" [hitesh] Re-apply correct patch. TEZ-402. Define a TezTaskContext for user code to interact with the AM. (hitesh) [hitesh] TEZ-415. Initial work on Tez*Context impls to aid integration. (hitesh) [sseth] TEZ-400. Change RuntimeTask to handle Input/Output lifecycle (part of [hitesh] TEZ-416. Simplify Event class heirarchy. (hitesh) [hitesh] TEZ-423. Move new re-factor classes to appropriate module. (hitesh) [bikas] TEZ-424. Add input information and failed events (bikas) [sseth] TEZ-425. Create DataMovementEvent and InputInformationEvent user [sseth] TEZ-427. Rename InputDataErrorEvent to InputReadErrorEvent and add [hitesh] TEZ-426. Changes in YarnTezDagChild for logical task using TaskSpec. (hitesh) [hitesh] TEZ-428. Add index info to event meta data. (hitesh) [hitesh] TEZ-429. Basic event router for Logical Runtime task. (hitesh) [hitesh] TEZ-430. Remove use of event lock. (hitesh) [sseth] TEZ-417. Change Shuffle Input/Output to work with the new APIs (part of [hitesh] TEZ-434. Rename EventMetaData Generator to enforce clarity on both producer/consumer semantics. (hitesh) [bikas] TEZ-407. Support multiple inputs and connection patterns in Tez (bikas) [hitesh] TEZ-435. Handle out-of-band fatal errors from inputs/outputs. (hitesh) [sseth] TEZ-418. Change SimpleInput to work with the new engine APIs (part of [bikas] TEZ-437. Make newmapreduce.TaskAttemptContextImpl use TezTaskContext (bikas) [hitesh] TEZ-419. Change SimpleOutput to work with the new engine APIs. (hitesh) [sseth] TEZ-432. Make JobToken available to inputs / outputs (part of TEZ-398). [hitesh] TEZ-436. Send regular progress updates from tez task to AM. (hitesh) [bikas] TEZ-420. Change Map/Reduce Processor to work with the new engine APIs (bikas) [sseth] TEZ-442. Handle events generated by I/O initialize and close (part of [sseth] TEZ-438. Allow users to configure a Partitioner in Tez-Engine [hitesh] TEZ-441. Move tez event handling thread into the LogicalTask from YarnTezDagChild. (hitesh) [bikas] TEZ-420. Change Map/Reduce Processor to work with the new engine APIs. Addendum (bikas) [sseth] Allow only a single instance of SimpleInput.RecordReader to be created [sseth] TEZ-446. Update YARNRunner, examples etc to use the new Inputs, Outputs [hitesh] TEZ-447. Make child jvm error out in case of heartbeat errors. (hitesh) [hitesh] TEZ-448. Fix serialization error in TezEvent. (hitesh) [sseth] TEZ-449. Several bug fixes in new api implementation (part of TEZ-398). [sseth] TEZ-452. Handle the case where heartbeatResponse.eventList is empty [hitesh] TEZ-453. Fix umbilical heartbeat handshake with AM. (hitesh) [sseth] TEZ-454. Fix Partitioner instantiation (part of TEZ-398). (sseth) [sseth] TEZ-455. Fix local dir setup and committer setup for MRTask (part of [bikas] TEZ-460. Fix TaskAttempt status update via heartbeat events (bikas) [hitesh] TEZ-461. Fix MapProcessor to handle map only jobs. (hitesh) [bikas] TEZ-456. Fix heartbeat response counting to depend on Container and not TaskAttempt (bikas) [bikas] TEZ-462. VertexName not set on the Status_Update_Event (hitesh via bikas) [bikas] Addendum to TEZ-456. Fix heartbeat response counting to depend on Container and not TaskAttempt (bikas) [bikas] Addendum to TEZ-456. Fix heartbeat response counting to depend on Container and not TaskAttempt (bikas) [bikas] TEZ-440. Remove shuffle port from AM code (bikas) [hitesh] TEZ-463. Fixes for events in Child JVM. (hitesh) [bikas] TEZ-464. Dont send 2 events to fail an attempt. Send die signal to non-registered container (bikas) [bikas] TEZ-466. Make OrderedWordCount job work after Engine API changes (bikas) [hitesh] TEZ-467. Fix WordCount job to work after recent changes in Tez Engine. (hitesh) [hitesh] TEZ-468. Add log messages to new engine impl to aid in debugging. (hitesh) [sseth] TEZ-414. Implement a non sorted, non aggregated K-V input/output pair. [bikas] TEZ-439. Fix task attempt commit flow (bikas) [hitesh] TEZ-470. Fix TestMRRJobsDAGApi to work with modified engine layer. (hitesh) [sseth] TEZ-433. Change Combiner to work with new APIs (part of TEZ-398). [hitesh] TEZ-472. Various fixes including NPE in shuffle when run MR jobs using mapred apis. (hitesh) [sseth] TEZ-477. Fix NPEs etc caused by TEZ-433 (part of TEZ-398). (sseth) [sseth] TEZ-444. Rename *.new* packages back to what they should be, remove [sseth] Rename *.new* packages back to what they should be, remove dead code [sseth] TEZ-443. Merge tez-dag-api and tez-engine-api into a single module - [sseth] TEZ-474. Fix TestMapProcessor and TestReduceProcessor unit tests (part [sseth] TEZ-490. Rename SimpleInput / SimpleOutput to be MR specific (part of [hitesh] Rename tez-engine-api to tez-runtime-api and tez-engine is split into 2: [bikas] TEZ-431. Implement fault tolerance, retries and event flow for dealing with failed inputs (bikas) ------------------------------------------ [...truncated 6690 lines...] [INFO] --- maven-surefire-plugin:2.14.1:test (default-test) @ tez-mapreduce-examples --- [INFO] Skipping execution of surefire because it has already been run for this configuration [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ tez-mapreduce-examples --- [INFO] Building jar: <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/target/tez-mapreduce-examples-0.2.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-jar-plugin:2.3.1:test-jar (default) @ tez-mapreduce-examples --- [INFO] Building jar: <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/target/tez-mapreduce-examples-0.2.0-SNAPSHOT-tests.jar> [INFO] [INFO] --- maven-install-plugin:2.3.1:install (default-install) @ tez-mapreduce-examples --- [INFO] Installing <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/target/tez-mapreduce-examples-0.2.0-SNAPSHOT.jar> to /home/jenkins/.m2/repository/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-SNAPSHOT.jar [INFO] Installing <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/pom.xml> to /home/jenkins/.m2/repository/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-SNAPSHOT.pom [INFO] Installing <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/target/tez-mapreduce-examples-0.2.0-SNAPSHOT-tests.jar> to /home/jenkins/.m2/repository/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-SNAPSHOT-tests.jar [INFO] [INFO] --- maven-deploy-plugin:2.7:deploy (default-deploy) @ tez-mapreduce-examples --- Downloading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/maven-metadata.xml 1002 B Downloaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/maven-metadata.xml (1002 B at 1.0 KB/sec) Uploading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-20130925.075356-32.jar 4 KB 8 KB 12 KB 16 KB 20 KB 24 KB 28 KB 32 KB 36 KB 40 KB 44 KB 48 KB 52 KB 56 KB 60 KB 64 KB 68 KB 72 KB 76 KB 80 KB 84 KB 88 KB 92 KB 96 KB 100 KB 104 KB 108 KB 112 KB 116 KB 120 KB 124 KB 128 KB 132 KB 136 KB 140 KB 144 KB 148 KB 151 KB Uploaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-20130925.075356-32.jar (151 KB at 314.5 KB/sec) Uploading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-20130925.075356-32.pom 3 KB Uploaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-20130925.075356-32.pom (3 KB at 12.5 KB/sec) Downloading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/maven-metadata.xml 296 B Downloaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/maven-metadata.xml (296 B at 0.7 KB/sec) Uploading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/maven-metadata.xml 1002 B Uploaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/maven-metadata.xml (1002 B at 1.8 KB/sec) Uploading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/maven-metadata.xml 296 B Uploaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/maven-metadata.xml (296 B at 0.9 KB/sec) Uploading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-20130925.075356-32-tests.jar 4 KB 5 KB Uploaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/tez-mapreduce-examples-0.2.0-20130925.075356-32-tests.jar (5 KB at 20.5 KB/sec) Uploading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/maven-metadata.xml 1002 B Uploaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-mapreduce-examples/0.2.0-SNAPSHOT/maven-metadata.xml (1002 B at 5.5 KB/sec) [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ tez-mapreduce-examples --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/src/main/resources> [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ tez-mapreduce-examples --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tez-mapreduce-examples --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/src/test/resources> [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ tez-mapreduce-examples --- [INFO] Nothing to compile - all classes are up to date [INFO] [INFO] --- maven-surefire-plugin:2.14.1:test (default-test) @ tez-mapreduce-examples --- [INFO] Skipping execution of surefire because it has already been run for this configuration [INFO] [INFO] --- maven-jar-plugin:2.3.1:jar (default-jar) @ tez-mapreduce-examples --- [INFO] Building jar: <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/target/tez-mapreduce-examples-0.2.0-SNAPSHOT.jar> [INFO] [INFO] --- maven-jar-plugin:2.3.1:test-jar (default) @ tez-mapreduce-examples --- [INFO] Building jar: <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-examples/target/tez-mapreduce-examples-0.2.0-SNAPSHOT-tests.jar> [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-mapreduce-tests 0.2.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ tez-mapreduce-tests --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ tez-mapreduce-tests --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-tests/src/main/resources> [INFO] [INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @ tez-mapreduce-tests --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tez-mapreduce-tests --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-tests/src/test/resources> [INFO] [INFO] --- maven-compiler-plugin:2.3.2:testCompile (default-testCompile) @ tez-mapreduce-tests --- [WARNING] File encoding has not been set, using platform encoding ISO-8859-1, i.e. build is platform dependent! [INFO] Compiling 3 source files to <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-tests/target/test-classes> [INFO] [INFO] --- maven-surefire-plugin:2.14.1:test (default-test) @ tez-mapreduce-tests --- [INFO] Surefire report directory: <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-tests/target/surefire-reports> ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.tez.mapreduce.TestMRRJobs Tests run: 5, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 135.657 sec <<< FAILURE! testMRRSleepJob(org.apache.tez.mapreduce.TestMRRJobs) Time elapsed: 21.507 sec <<< FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.tez.mapreduce.TestMRRJobs.testMRRSleepJob(TestMRRJobs.java:160) testMRRSleepJobWithCompression(org.apache.tez.mapreduce.TestMRRJobs) Time elapsed: 26.973 sec <<< FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.tez.mapreduce.TestMRRJobs.testMRRSleepJobWithCompression(TestMRRJobs.java:326) testFailingAttempt(org.apache.tez.mapreduce.TestMRRJobs) Time elapsed: 25.842 sec <<< FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:86) at org.junit.Assert.assertTrue(Assert.java:41) at org.junit.Assert.assertTrue(Assert.java:52) at org.apache.tez.mapreduce.TestMRRJobs.testFailingAttempt(TestMRRJobs.java:286) Running org.apache.tez.mapreduce.TestMRRJobsDAGApi Tests run: 5, Failures: 4, Errors: 0, Skipped: 0, Time elapsed: 93.825 sec <<< FAILURE! testMRRSleepJobDagSubmit(org.apache.tez.mapreduce.TestMRRJobsDAGApi) Time elapsed: 21.167 sec <<< FAILURE! java.lang.AssertionError: expected:<SUCCEEDED> but was:<FAILED> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.tez.mapreduce.TestMRRJobsDAGApi.testMRRSleepJobDagSubmit(TestMRRJobsDAGApi.java:187) testMRRSleepJobDagSubmitAndKillViaRPC(org.apache.tez.mapreduce.TestMRRJobsDAGApi) Time elapsed: 10.369 sec <<< FAILURE! java.lang.AssertionError: expected:<KILLED> but was:<ERROR> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.tez.mapreduce.TestMRRJobsDAGApi.testMRRSleepJobDagSubmitAndKillViaRPC(TestMRRJobsDAGApi.java:218) testMRRSleepJobDagSubmitAndKill(org.apache.tez.mapreduce.TestMRRJobsDAGApi) Time elapsed: 10.11 sec <<< FAILURE! java.lang.AssertionError: expected:<KILLED> but was:<ERROR> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.tez.mapreduce.TestMRRJobsDAGApi.testMRRSleepJobDagSubmitAndKill(TestMRRJobsDAGApi.java:198) testMRRSleepJobPlanViaRPC(org.apache.tez.mapreduce.TestMRRJobsDAGApi) Time elapsed: 24.947 sec <<< FAILURE! java.lang.AssertionError: expected:<SUCCEEDED> but was:<FAILED> at org.junit.Assert.fail(Assert.java:88) at org.junit.Assert.failNotEquals(Assert.java:743) at org.junit.Assert.assertEquals(Assert.java:118) at org.junit.Assert.assertEquals(Assert.java:144) at org.apache.tez.mapreduce.TestMRRJobsDAGApi.testMRRSleepJobPlanViaRPC(TestMRRJobsDAGApi.java:209) Results : Failed tests: TestMRRJobs.testMRRSleepJob:160 null TestMRRJobs.testMRRSleepJobWithCompression:326 null TestMRRJobs.testFailingAttempt:286 null TestMRRJobsDAGApi.testMRRSleepJobDagSubmit:187 expected:<SUCCEEDED> but was:<FAILED> TestMRRJobsDAGApi.testMRRSleepJobDagSubmitAndKillViaRPC:218 expected:<KILLED> but was:<ERROR> TestMRRJobsDAGApi.testMRRSleepJobDagSubmitAndKill:198 expected:<KILLED> but was:<ERROR> TestMRRJobsDAGApi.testMRRSleepJobPlanViaRPC:209 expected:<SUCCEEDED> but was:<FAILED> Tests run: 10, Failures: 7, Errors: 0, Skipped: 0 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] tez ............................................... SUCCESS [6.768s] [INFO] tez-api ........................................... SUCCESS [58.378s] [INFO] tez-common ........................................ SUCCESS [5.919s] [INFO] tez-runtime-library ............................... SUCCESS [6.937s] [INFO] tez-runtime-internals ............................. SUCCESS [6.767s] [INFO] tez-mapreduce ..................................... SUCCESS [58.864s] [INFO] tez-yarn-client ................................... SUCCESS [3.898s] [INFO] tez-dag ........................................... SUCCESS [31.081s] [INFO] tez-mapreduce-examples ............................ SUCCESS [10.102s] [INFO] tez-mapreduce-tests ............................... FAILURE [3:51.525s] [INFO] tez-dist .......................................... SKIPPED [INFO] Tez ............................................... SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 7:00.689s [INFO] Finished at: Wed Sep 25 07:57:50 UTC 2013 [INFO] Final Memory: 144M/446M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.14.1:test (default-test) on project tez-mapreduce-tests: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Tez-Build/ws/tez-mapreduce-tests/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :tez-mapreduce-tests Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results
