See <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/157/changes>
Changes: [sseth] TEZ-2734. Add a test to verify the filename generated by OnDiskMerge. (sseth) [rbalamohan] Updating CHANGES.txt (rbalamohan) [rbalamohan] Updating CHANGES.txt (rbalamohan) [sseth] TEZ-2019. Temporarily allow the scheduler and launcher to be specified [sseth] TEZ-2006. Task communication plane needs to be pluggable. (sseth) [sseth] TEZ-2090. Add tests for jobs running in external services. (sseth) [sseth] TEZ-2117. Add a manager for ContainerLaunchers running in the AM. [sseth] TEZ-2122. Setup pluggable components at AM/Vertex level. (sseth) [sseth] TEZ-2123. Fix component managers to use pluggable components. Enable [sseth] TEZ-2125. Create a task communicator for local mode. Allow tasks to run [sseth] TEZ-2131. Add additional tests for tasks running in the AM. (sseth) [sseth] TEZ-2138. Fix minor bugs in adding default scheduler, getting launchers. (sseth) [sseth] TEZ-2139. Update version to 0.7.0-TEZ-2003-SNAPSHOT. (sseth) [sseth] TEZ-2175. Task priority should be available to the TaskCommunicator plugin. (sseth) [sseth] TEZ-2187. Allow TaskCommunicators to report failed / killed attempts. (sseth) [sseth] TEZ-2241. Miscellaneous fixes after last reabse. (sseth) [sseth] TEZ-2283. Fixes after rebase 04/07. (sseth) [sseth] TEZ-2284. Separate TaskReporter into an interface. (sseth) [sseth] TEZ-2285. Allow TaskCommunicators to indicate task/container liveness. (sseth) [sseth] TEZ-2302. Allow TaskCommunicators to subscribe for Vertex updates. (sseth) [sseth] TEZ-2347. Expose additional information in TaskCommunicatorContext. (sseth) [sseth] TEZ-2361. Propagate dag completion to TaskCommunicator. (sseth) [sseth] TEZ-2381. Fixes after rebase 04/28. (sseth) [sseth] TEZ-2388. Send dag identifier as part of the fetcher request string. (sseth) [sseth] TEZ-2414. LogicalIOProcessorRuntimeTask, RuntimeTask, TezTaskRunner should handle interrupts & carry out necessary cleanups. Contribtued by Rajesh Balamohan. [sseth] TEZ-2420. TaskRunner returning before executing the task. (sseth) [sseth] TEZ-2433. Fixes after rebase 05/08. (sseth) [sseth] TEZ-2438. tez-tools version in the branch is incorrect. (sseth) [sseth] TEZ-2434. Allow tasks to be killed in the runtime. (sseth) [sseth] TEZ-2443. TaskRunner2 should call abort, NPEs while cleaning up tasks. (sseth) [sseth] TEZ-2465. Retrun the status of a kill request in TaskRunner2. (sseth) [sseth] TEZ-2471. NPE in LogicalIOProcessorRuntimeTask while printing thread info. (sseth) [sseth] TEZ-2495. Inform TaskCommunicaor about Task and Container termination reasons. (sseth) [sseth] TEZ-2502. Fix for TezTaskRunner2 not killing tasks properly in all situations. (sseth) [sseth] TEZ-2508. rebase 06/01. (sseth) [sseth] TEZ-2526. Fix version for tez-history-parser. Contributed by Sergey Shelukhin. [sseth] TEZ-2621. rebase 07/14. (sseth) [sseth] TEZ-2124. Change Node tracking to work per external container source. (sseth) [sseth] TEZ-2004. Define basic interface for pluggable ContainerLaunchers. (sseth) [sseth] TEZ-2005. Define basic interface for pluggable TaskScheduler. (sseth) [sseth] TEZ-2651. Pluggable services should not extend AbstractService. (sseth) [sseth] TEZ-2652. Cleanup the way services are specified for an AM and vertices. (sseth) [sseth] TEZ-2653. Change service contexts to expose a user specified payload [sseth] TEZ-2441. Add tests for TezTaskRunner2. (sseth) [sseth] TEZ-2657. Add tests for client side changes - specifying plugins, etc. (sseth) [sseth] TEZ-2626. Fix log lines with DEBUG in messages, consolidate TEZ-2003 TODOs. (sseth) [sseth] TEZ-2126. Add unit tests for verifying multiple schedulers, launchers, [sseth] TEZ-2698. rebase 08/05 (sseth) [sseth] TEZ-2675. Add javadocs for new pluggable components, fix problems [sseth] TEZ-2703. TEZ-2003 build fails (zjffdu) [sseth] TEZ-2678. Fix comments from reviews - part 1. (sseth) [sseth] TEZ-2707. Fix comments from reviews - part 2. (sseth) [sseth] TEZ-2713. Add tests for node handling when there's multiple schedulers. (sseth) [sseth] TEZ-2713 addendum. Fix CHANGES.txt [sseth] TEZ-2721. rebase 08/14 (sseth) [sseth] TEZ-2714. Fix comments from review - part 3. (sseth) [sseth] TEZ-2727. Fix findbugs warnings. (sseth) [sseth] TEZ-2670. Remove TaskAttempt holder used within TezTaskCommunicator. (sseth) [sseth] TEZ-2735. rebase 08/21 (sseth) [sseth] TEZ-2736. Pre-merge: Update CHANGES.txt and version in branch. (sseth) ------------------------------------------ [...truncated 1167 lines...] [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] Copying 2 resources [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ tez-ui --- [INFO] No sources to compile [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tez-ui --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-ui/src/test/resources> [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ tez-ui --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.14.1:test (default-test) @ tez-ui --- [INFO] No tests to run. [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-plugins 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-plugins --- [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-plugins --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288369928 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-plugins --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-mbeans-resource-calculator 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-mbeans-resource-calculator --- [INFO] Deleting <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator/target> [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-mbeans-resource-calculator --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288370029 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-mbeans-resource-calculator --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ tez-mbeans-resource-calculator --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator/src/main/resources> [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ tez-mbeans-resource-calculator --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator/target/classes> [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tez-mbeans-resource-calculator --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator/src/test/resources> [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ tez-mbeans-resource-calculator --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 1 source file to <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator/target/test-classes> [INFO] [INFO] --- maven-surefire-plugin:2.14.1:test (default-test) @ tez-mbeans-resource-calculator --- [INFO] Surefire report directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-plugins/tez-mbeans-resource-calculator/target/surefire-reports> ------------------------------------------------------- T E S T S ------------------------------------------------------- ------------------------------------------------------- T E S T S ------------------------------------------------------- Running org.apache.tez.util.TestTezMxBeanResourceCalculator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.403 sec Results : Tests run: 1, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-tools 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-tools --- [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-tools --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288370873 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-tools --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-perf-analyzer 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-perf-analyzer --- [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-perf-analyzer --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288370887 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-perf-analyzer --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-job-analyzer 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ Downloading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-history-parser/0.8.0-SNAPSHOT/maven-metadata.xml Downloading: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-yarn-timeline-history/0.8.0-SNAPSHOT/maven-metadata.xml 1009/1009 B Downloaded: https://repository.apache.org/content/repositories/snapshots/org/apache/tez/tez-yarn-timeline-history/0.8.0-SNAPSHOT/maven-metadata.xml (1009 B at 0.3 KB/sec) [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-job-analyzer --- [INFO] Deleting <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer/target> [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-job-analyzer --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288375595 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-job-analyzer --- [INFO] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ tez-job-analyzer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer/src/main/resources> [INFO] [INFO] --- maven-compiler-plugin:3.1:compile (default-compile) @ tez-job-analyzer --- [INFO] Changes detected - recompiling the module! [INFO] Compiling 15 source files to <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer/target/classes> [INFO] [INFO] --- maven-resources-plugin:2.6:testResources (default-testResources) @ tez-job-analyzer --- [INFO] Using 'UTF-8' encoding to copy filtered resources. [INFO] skip non existing resourceDirectory <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-tools/analyzers/job-analyzer/src/test/resources> [INFO] [INFO] --- maven-compiler-plugin:3.1:testCompile (default-testCompile) @ tez-job-analyzer --- [INFO] No sources to compile [INFO] [INFO] --- maven-surefire-plugin:2.14.1:test (default-test) @ tez-job-analyzer --- [INFO] No tests to run. [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building tez-dist 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-dist --- [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-dist --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-dist> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-dist> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288375815 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-dist> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-dist> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-dist --- [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Tez 0.8.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ tez-docs --- [INFO] [INFO] --- buildnumber-maven-plugin:1.1:create (default) @ tez-docs --- [INFO] Checking for local modifications: skipped. [INFO] Updating project files from SCM: skipped. [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/docs> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/docs> [INFO] Storing buildNumber: 2e62e98ec071a8fa3d41cad2c1aca04e3a26f22d at timestamp: 1440288375830 [INFO] Executing: /bin/sh -c cd <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/docs> && git rev-parse --verify HEAD [INFO] Working directory: <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/docs> [INFO] Storing buildScmBranch: UNKNOWN [INFO] [INFO] --- build-helper-maven-plugin:1.8:maven-version (maven-version) @ tez-docs --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] tez ............................................... SUCCESS [ 1.258 s] [INFO] tez-api ........................................... SUCCESS [ 38.062 s] [INFO] tez-common ........................................ SUCCESS [ 3.461 s] [INFO] tez-runtime-internals ............................. SUCCESS [ 14.100 s] [INFO] tez-runtime-library ............................... SUCCESS [02:05 min] [INFO] tez-mapreduce ..................................... SUCCESS [ 28.362 s] [INFO] tez-examples ...................................... SUCCESS [ 0.285 s] [INFO] tez-dag ........................................... SUCCESS [02:11 min] [INFO] tez-tests ......................................... SUCCESS [27:47 min] [INFO] tez-ext-service-tests ............................. FAILURE [ 0.589 s] [INFO] tez-ui ............................................ SUCCESS [ 17.606 s] [INFO] tez-plugins ....................................... SUCCESS [ 0.014 s] [INFO] tez-mbeans-resource-calculator .................... SUCCESS [ 0.930 s] [INFO] tez-tools ......................................... SUCCESS [ 0.014 s] [INFO] tez-perf-analyzer ................................. SUCCESS [ 0.015 s] [INFO] tez-job-analyzer .................................. SUCCESS [ 4.914 s] [INFO] tez-dist .......................................... SUCCESS [ 0.014 s] [INFO] Tez ............................................... SUCCESS [ 0.014 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 33:54 min [INFO] Finished at: 2015-08-23T00:06:15+00:00 [INFO] Final Memory: 62M/834M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-testCompile) on project tez-ext-service-tests: Compilation failure: Compilation failure: [ERROR] <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-ext-service-tests/src/test/java/org/apache/tez/shufflehandler/ShuffleHandler.java>:[693,46] constructor FadvisedFileRegion in class org.apache.hadoop.mapred.FadvisedFileRegion cannot be applied to given types; [ERROR] required: java.io.RandomAccessFile,long,long,boolean,int,org.apache.hadoop.io.ReadaheadPool,java.lang.String [ERROR] found: java.io.RandomAccessFile,long,long,boolean,int,org.apache.hadoop.io.ReadaheadPool,java.lang.String,int,boolean [ERROR] reason: actual and formal argument lists differ in length [ERROR] <https://builds.apache.org/job/Tez-Build-Hadoop-2.2/ws/tez-ext-service-tests/src/test/java/org/apache/tez/shufflehandler/ShuffleHandler.java>:[704,24] cannot find symbol [ERROR] symbol: method transferSuccessful() [ERROR] location: variable partition of type org.apache.hadoop.mapred.FadvisedFileRegion [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :tez-ext-service-tests Build step 'Execute shell' marked build as failure Recording test results
